New Message: Re: Robots.txt for Manila sites - also on top level?

webmaster at userland.com webmaster at userland.com
Sun Jul 13 23:48:02 PDT 2003


A new message was posted:

Address: http://manila.userland.com/discuss/msgReader$154

By: Alexander Mueller (alexander.mueller at donau-uni.ac.at)

hello jake

at first thanks for the great tool, second
i would like to have one question to you:

is it also possible to save a whole manilasite
from indexing with robots.txt - not just /discuss or /gems ..and so on - i mean the top-level directory-path?

- for example:

everything behind http://manilasite_xx.xx/....

with kind regards

a.mueller

This is a Manila site.. http://manila.userland.com/.




More information about the Frontier-Users mailing list