Wednesday, September 26, 2007

Cyberspider Crap-of-the-Day Bot Award

No clue what this spider does as it only asked for my home page but I know what it doesn't do, it doesn't ask for robots.txt.

Here's the 411 on this bad bot:
81.56.161.126 [veigy.globalitsolution.com.] requested 1 pages as "cyberspider"
These crappy crawlers just keep coming...
at

7 comments:

  1. Da Scritch9/27/2007 7:40 AM

    I have a big problem with Sogou. My website has numerous big mp3 files as a podcaster, and they don't follow rel=nofollow policy.

    Their mail adresses are not responding... do you want a copy of my mail complain ?

    ReplyDelete
  2. Anonymous9/27/2007 10:52 AM

    da scritch,

    Ban them! That continent is home to the worth bandwidth sucking trash.

    IPs China

    I don't think Bill will mind that link

    ReplyDelete
  3. IncrediBILL9/27/2007 12:11 PM

    I've always said that if you don't sell to them, the best way to stop bandwidth abuse and spam is to install the Great Firewall of China.

    Then Russia, Romania, Korea and a few other sources of nonsense and you'll notice most of the spam and port probes on your server go away.

    ReplyDelete
  4. Anonymous9/27/2007 2:20 PM

    Have you ever heard about biosearch? ;-)

    ReplyDelete
  5. IncrediBILL9/27/2007 5:24 PM

    John, that might clearly be the Crap-of-the-Decade bot.

    ReplyDelete
  6. R10/03/2007 10:44 PM

    Here's a post on DP with some proxy prevention. Maybe you can comment?
    Bad proxies

    ReplyDelete
  7. Anonymous10/05/2007 5:28 AM

    Don't think I can beat the biosearch example, but I had one called "Pockey" which is pretty damn stupid.

    ReplyDelete