New Message: Re: Robots.txt for Manila sites

[webmaster at userland.com]

A new message was posted:

Address: http://manila.userland.com/discuss/msgReader$156

By: Robert Black (robert at brainwave.wow.aust.com)

FYI Jake: Using http://www.searchengineworld.com/cgi-bin/robotcheck.cgi, it appears that the wrong type of linefeed is being used in some cases.

On my server running with MacOS X, the validator returns an error, which indicates that it successfully read the robots.txt file, but all as one line, which doesn't validate.

Some examples of files that don't work with the validator:

 http://www.robertblack.com.au/robots.txt

 http://plugins.weblogger.com/robots.txt

This is a Manila site.. http://manila.userland.com/.