It appears that the people at SeekOn think that if "someone" submits your site to their service, just anyone according to them, they have the right to crawl your site. Better yet, they don't even bother to look for ROBOTS.TXT, oh fuck no, they expect you to use META TAGS on all your pages to control robots instead of that one handy little robots.txt file.
Just block "SeekOn Spider" in your .htaccess file and they can kiss your ass at that point.
Saturday, April 08, 2006
SeekOn Elsewhere
Posted by IncrediBILL at 4/08/2006 04:02:00 PM
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment