# Robots.txt file created by Sally Houghton 01-Aug-1998 # For more information see # http://info.webcrawler.com/mak/projects/robots/robots.html User-agent: * Disallow: /Excite/ Disallow: /sphider/ Disallow: /ikons/ Disallow: /cgi-bin/