New Message: Re: Robots.txt for Manila sites - also on top level?
webmaster at userland.com
webmaster at userland.com
Sun Jul 13 23:48:02 PDT 2003
A new message was posted:
Address: http://manila.userland.com/discuss/msgReader$154
By: Alexander Mueller (alexander.mueller at donau-uni.ac.at)
hello jake
at first thanks for the great tool, second
i would like to have one question to you:
is it also possible to save a whole manilasite
from indexing with robots.txt - not just /discuss or /gems ..and so on - i mean the top-level directory-path?
- for example:
everything behind http://manilasite_xx.xx/....
with kind regards
a.mueller
This is a Manila site.. http://manila.userland.com/.
More information about the Frontier-Users
mailing list