New Message: Re: Robots.txt for Manila sites - also on top level?

[webmaster at userland.com]

A new message was posted:

Address: http://manila.userland.com/discuss/msgReader$157

By: Jake Savin (jake at userland.com)

/is it also possible to save a whole manilasite from indexing with robots.txt - not just /discuss or /gems ..and so on - i mean the top-level directory-path?/

To prevent your entire site from being indexed, add a path which is just a slash, and then delete any other restricted paths.

This is a Manila site.. http://manila.userland.com/.