New Message: Correct Syntax For Robots.txt?

[webmaster at userland.com]

A new message was posted:

Address: http://frontier.userland.com/discuss/msgReader$14449

By: ken tompkins (ken at loki.stockton.edu)

I'd like to confirm the correct syntax for robots.txt. I've read the doc and am not 100% sure. What I have entered as the part of the site I want ignored seems not to be working -- hence this question.

Say I want to have the search engines ignore a complete site. Do I put the whole address into the robots.txt form as

caxton.stockton.edu/test

or do I simply put

/test

because ALL of the sites on the server have the caxton.stockton.edu address?

I have, as I said, tried both of these but to no obvious effect.

Thanks....

ken tompkins

This is a Manila site... http://manila.userland.com/.