Welcome to the wonderful world of dumb fucking robots that haven't a goddamn clue.
Maybe ActiveTourist was attempting referrer spam as I have no idea what this digital dungheap was actually doing.
See for yourself:
80.229.187.190 -"GET /robots.txt" "Mozilla/4.0 (ActiveTouristBot V1.2 ;http://www.activetourist.com)"This spastic fucking bot eats robot.txt files like they're candy.
80.229.187.190 - "GET /robots.txt" "Mozilla/4.0 (ActiveTouristBot V1.2 ;http://www.activetourist.com)"
80.229.187.190 - "GET /robots.txt" "Mozilla/4.0 (ActiveTouristBot V1.2 ;http://www.activetourist.com)"
80.229.187.190 - "GET /robots.txt" "Mozilla/4.0 (ActiveTouristBot V1.2 ;http://www.activetourist.com)"
80.229.187.190 -"GET /AnActualFuckingPage.html HTTP/1.1" "Mozilla/4.0 (ActiveTouristBot V1.2 ;http://www.activetourist.com)"
80.229.187.190 - "GET /AnotherFuckingPage.html" "Mozilla/4.0 (ActiveTouristBot V1.2 ;http://www.activetourist.com)"
80.229.187.190 - "GET /TheFuckOffMyServer.html" "Mozilla/4.0 (ActiveTouristBot V1.2 ;http://www.activetourist.com)"
80.229.187.190 - "GET /YourHeadOutOfYourAss.html" "Mozilla/4.0 (ActiveTouristBot V1.2 ;http://www.activetourist.com)"
80.229.187.190 - "GET /robots.txt" "Mozilla/4.0 (ActiveTouristBot V1.2 ;http://www.activetourist.com)"
80.229.187.190 - "GET /robots.txt" "Mozilla/4.0 (ActiveTouristBot V1.2 ;http://www.activetourist.com)"
80.229.187.190 - "GET /robots.txt" "Mozilla/4.0 (ActiveTouristBot V1.2 ;http://www.activetourist.com)"
80.229.187.190 - "GET /MoreRobotsTxtFilesYummy.html" "Mozilla/4.0 (ActiveTouristBot V1.2 ;http://www.activetourist.com)"
80.229.187.190 - "GET /MoreShitYouArentGetting.html" "Mozilla/4.0 (ActiveTouristBot V1.2 ;http://www.activetourist.com)"
80.229.187.190 - "GET /AFuckingClue.html" "Mozilla/4.0 (ActiveTouristBot V1.2 ;http://www.activetourist.com)"
Didn't find any specific information on that tragedy they call a website about what they even support in robots.txt, but it doesn't really matter as they got nothing from me except a place of honor on my blog.
1 comment:
Hi incrediBILL
Referance my post on webmasters world, can you put this post on your site.
As for the bot, it is my intention to ensure that it behaves correctly. the bot started out as V1.0 and is now at V1.3 as any problems encounted are fixed and the upgrade is displayed in the version number.
The reason the website is included in the bot name is to allow any webmasters who encounter problems to contact me, so that it can be looked into, i do not include a email address as this is giving any spammers a free meal if the bot visits their site.
So if any webmasters encounter problems with the bot, please visit the site and use the contact form, in the subject list there is a "spider" option, select that for your mail.
I hope this post answers any question people have about the bot.
Regards
George
Post a Comment