# This file tells Web spiders which files are off-limits. # For robots.txt info see # http://info.webcrawler.com/mak/projects/robots/norobots.html User-agent: * Disallow: /cgi-bin Disallow: /error.html Disallow: /errors Disallow: /gifs Disallow: /images Disallow: /includes Disallow: /linkdocs Disallow: /maps Disallow: /sitemap_full.html Disallow: /tl_new_front