Looks like I'm on the bleeding edge with MetagerBot as there's almost a void of information about this bot that comes calling from the University of Hannover.
130.75.2.12 [kursix.rrzn.uni-hannover.de.] requested 1 pages as "MetagerBot/0.8-dev (MetagerBot; http://metager.de; )"The part that I'm confused about is what do they need their own bot for as they're claiming to be a meta search engine powered by Exalead?
Some references indicated they were using [big shock] nutch:
metagerbot/0.8-dev-mnebel-20050827 (mgbot; http://metager.de/; __nutch-agent@metager.de)Played around with their search for a bit and it did cough up a few new things of interest I hadn't encountered, but it was slower than shit most of the time and waiting on results can be a bit tedious.
So does this mean we should let Exalead crawl?
No clue.
No comments:
Post a Comment