Monday, July 03, 2006

First Look - MaSagool spider

Some search engine called Sagool from Japan [translated] sent a spider caledl MaSagool that came crawling from 2 IP addresses. Didn't look for robots.txt or any other damn thing so probably a good idea just to block this thing until they teach it some manners.

59.158.235.21
[59x158x235x21.ap59.ftth.ucom.ne.jp.]
"MaSagool/1.0 (MaSagool; http://sagool.jp/; info@sagool.jp)"

124.32.246.45
[124x32x246x45.ap124.ftth.ucom.ne.jp.]
"MaSagool/1.0 (MaSagool; http://sagool.jp/; info@sagool.jp)"

4 comments:

BlazinBeats said...

whats up, hey where can i learn more about this kinda stuff?

IncrediBILL said...

Over in WebmasterWorld is a good start:

Search Engine Spider Identification forum:
http://www.webmasterworld.com/search_engien_spider/

Or the Robots.txt forum:
http://www.webmasterworld.com/robots_txt/

SAGOOL Support Team said...

Sorry for all the trouble our spider gave you. This is SAGOOL Search Engine Support Team.

Actually our spider "MaSagool" understands robots.txt. So in case there is any problem with our spider, would you please let us know your site's URL if you don't mind. It will be very helpful and appreciated.

Thank you.

GorgeousOnLife said...

Don't mind the spider, just wish I could read more about it in English.