# /robots.txt file for http://pabs2000.com/ # mail pabs2000@hotmail.com for constructive criticism User-agent: webcrawler Disallow: /tmp Disallow: /logs #User-agent: webcrawler #Disallow: User-agent: Lycos Disallow: /tmp Disallow: /logs User-agent: Googlebot Disallow: /tmp Disallow: /logs User-agent: Wired Digital Disallow: /tmp Disallow: /logs User-agent: Northern Light Gulliver Disallow: /tmp Disallow: /logs User-agent: InfoSeek Robot 1.0 Disallow: /tmp Disallow: /logs User-agent: Infoseek Sidewinder Disallow: /tmp Disallow: /logs User-agent: Jeeves Disallow: /tmp Disallow: /logs User-agent: PerlCrawler 1.0 Disallow: /tmp Disallow: /logs User-agent: Direct Hit Grabber Disallow: /tmp Disallow: /logs #this shuts off from all #User-agent: lycra #Disallow: / #all other robots User-agent: * Disallow: /tmp Disallow: /logs #see http://info.webcrawler.com/mak/projects/robots/faq.html for more info