bad bots

[Lawrence Lee]

You'll find it in the Advanced Prefs page and then the Robots.txt option.

Lawrence Lee
UserLand Software
www.userland.com 


-----Original Message-----
From: manila-users-bounces at userland.com
[mailto:manila-users-bounces at userland.com] On Behalf Of Kelly Thomas
Sent: May 3, 2007 11:40 AM
To: manila-users at userland.com
Subject: bad bots

The INKTOMI/Yahoo bot is hammering my servers for several months now.  
They said I should add
some code to the robots.txt file.

   http://help.yahoo.com/help/us/ysearch/slurp/slurp-03.html
   http://www.webmasterworld.com/forum93/768.htm

User-agent: Slurp
Crawl-delay: 10

I found a robots in #newsite but nothing I could edit. Is there somewhere
else I should look?

Thanks!

/kelly thomas
SIU
Daily Egyptian