bad bots

Kelly Thomas kthomas at siu.edu
Thu May 3 13:40:06 CDT 2007


The INKTOMI/Yahoo bot is hammering my servers for several months now.  
They said I should add
some code to the robots.txt file.

   http://help.yahoo.com/help/us/ysearch/slurp/slurp-03.html
   http://www.webmasterworld.com/forum93/768.htm

User-agent: Slurp
Crawl-delay: 10

I found a robots in #newsite but nothing I could edit. Is there  
somewhere else I should look?

Thanks!

/kelly thomas
SIU
Daily Egyptian




More information about the Manila-Users mailing list