---- robots.txt (contents follow) User-agent: * Disallow: /cgi-bin/ Disallow: /vault Disallow: /create Disallow: /testindex Disallow: /TI ---- end (Contents above)