# this documanets disallows robots access to cgi-bin # (allegedly, some robots can get stuck in sgi) # for more info on writing robots.txt see http://info.webcrawler.com/mak/projects/robots/norobots.html User-agent: * Disallow: /sgi-bin Disallow: /stats