New Message: Prefs>Advanced>Robots.txt
webmaster at userland.com
webmaster at userland.com
Sun Dec 2 19:57:54 CST 2007
A new message was posted:
Address: http://manila.userland.com/discuss/msgReader$2979
By: Ben Collis (ben at dp.co.nz)
Do many people out there use them ?
We like the idea of preventing say google image bots from crawling the site - simply to save world (and my) bandwidth. Not sure that it is possible to specify agent types is it ?
Also - there were issues in the distant past (I think I was told) are they all resolved now ?
cheers in advance ..
This is a Manila site... http://manila.userland.com/.
More information about the Manila-Users
mailing list