bad bots

[Kelly Thomas]

? I went there first and all I can do is add a path. This command is  
bot specific and different. see below.

/kt


On May 4, 2007, at 12:00 PM, manila-users-request at userland.com wrote:

> You'll find it in the Advanced Prefs page and then the Robots.txt  
> option.
...
> They said I should add
> some code to the robots.txt file.
>
>   http://help.yahoo.com/help/us/ysearch/slurp/slurp-03.html
>   http://www.webmasterworld.com/forum93/768.htm
>
> User-agent: Slurp
> Crawl-delay: 10