What the hell's going on with Alexa trying to crawl my site with NO user agent string!
Had an attempted anonymous crawl from 22.214.171.124 which is:
whois 126.96.36.199They still read the robots.txt file, but no clue who it was:
Alexa Internet ALEXA-INTERNET (NET-209-237-237-0-1)
188.8.131.52 - 184.108.40.206
220.127.116.11 - - "GET /robots.txt HTTP/1.0" 200 111 "-" ""What the hell's going on Alexa?
Someone break the crawler or you just trying to sneak under the radar after everyone blocked your ass?
You claim to crawl as "ia_archiver" but I don't see any ID here whatsoever!
Please explain, inquiring minds want to know!