Don't know who these guys are at Omni-Explorer but it always seemed like a legit group that claims to honor robots.txt and posts their IP range so on and so forth. I always let them crawl since they claimed to be venture backed which made me think something useful would show up eventually and being a Silicon Valley guy I'm always curious about venture backed start-ups. However, it's been YEARS now and the bot keeps crawling with no benefit for me that I can see in the near future.
Sorry guys, but your exploration has ended.
OmniExplorer_Bot is now officially arachnida non grata
Wednesday, January 25, 2006
Exploration Halted
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment