New Message: Re: Correct Syntax For Robots.txt?

[webmaster at userland.com]

A new message was posted:

Address: http://frontier.userland.com/discuss/msgReader$14451

By: Lawrence Lee (lawrence at userland.com)

You can either set it up on the top-level site with /test or using the robots.txt on the site you want to be ignored you can just set it up as: /

After you've done this, I would check the robots.txt for both:
caxton.stockton.edu/robots.txt and caxton.stockton.edu/test/robots.txt to verify.

Lawrence

This is a Manila site... http://manila.userland.com/.