Some search engine called Sagool from Japan [translated] sent a spider caledl MaSagool that came crawling from 2 IP addresses. Didn't look for robots.txt or any other damn thing so probably a good idea just to block this thing until they teach it some manners.
59.158.235.21
[59x158x235x21.ap59.ftth.ucom.ne.jp.]
"MaSagool/1.0 (MaSagool; http://sagool.jp/; info@sagool.jp)"
124.32.246.45
[124x32x246x45.ap124.ftth.ucom.ne.jp.]
"MaSagool/1.0 (MaSagool; http://sagool.jp/; info@sagool.jp)"
3 comments:
Over in WebmasterWorld is a good start:
Search Engine Spider Identification forum:
http://www.webmasterworld.com/search_engien_spider/
Or the Robots.txt forum:
http://www.webmasterworld.com/robots_txt/
Sorry for all the trouble our spider gave you. This is SAGOOL Search Engine Support Team.
Actually our spider "MaSagool" understands robots.txt. So in case there is any problem with our spider, would you please let us know your site's URL if you don't mind. It will be very helpful and appreciated.
Thank you.
Don't mind the spider, just wish I could read more about it in English.
Post a Comment