No clue what this spider does as it only asked for my home page but I know what it doesn't do, it doesn't ask for robots.txt.
Here's the 411 on this bad bot:
81.56.161.126 [veigy.globalitsolution.com.] requested 1 pages as "cyberspider"These crappy crawlers just keep coming...
7 comments:
I have a big problem with Sogou. My website has numerous big mp3 files as a podcaster, and they don't follow rel=nofollow policy.
Their mail adresses are not responding... do you want a copy of my mail complain ?
da scritch,
Ban them! That continent is home to the worth bandwidth sucking trash.
IPs China
I don't think Bill will mind that link
I've always said that if you don't sell to them, the best way to stop bandwidth abuse and spam is to install the Great Firewall of China.
Then Russia, Romania, Korea and a few other sources of nonsense and you'll notice most of the spam and port probes on your server go away.
Have you ever heard about biosearch? ;-)
John, that might clearly be the Crap-of-the-Decade bot.
Here's a post on DP with some proxy prevention. Maybe you can comment?
Bad proxies
Don't think I can beat the biosearch example, but I had one called "Pockey" which is pretty damn stupid.
Post a Comment