Caught this story on WebmasterWorld about eBay scraping and sure enough found evidence of the same thing in my site.
The first IP is definitely a stealth bot, it's blocked, yet keeps asking for pages over the last couple of months.
216.113.181.67 "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; Q312461; .NET CLR 1.1.4322)"This IP address used a banned user agent so it would never be allowed to crawl in the first place yet still asked for a couple of page names it already knew about, weird.
216.113.168.141 "Java/1.5.0_09"Here's eBay's info so you can block whatever the hell they're doing:
OrgName: eBay, IncWhat will they do with the information they collect, sell it to the highest bidding scraper?
OrgID: EBAY
Address: 2145 Hamilton Ave
City: San Jose
StateProv: CA
PostalCode: 95008
Country: US
NetRange: 216.113.160.0 - 216.113.191.255
CIDR: 216.113.160.0/19
No comments:
Post a Comment