What I find amusing are security companies that claim to be protecting the web while violating access control measures on web servers all over the world.
Here's what I see coming from WebSense that's obvious:
184.108.40.206 Mozilla/5.0 (compatible; Konqueror/3.0-rc2; i686 Linux; 20020108)It makes me wonder if deliberately trying to bypass security measures in place that are designed to keep robots like WebSense off a server, such as robots.txt, .htaccess and other access controls, may violate the "Computer Hacking and Unauthorized Access Laws"?
220.127.116.11 Mozilla/5.0 (compatible; Konqueror/3.0-rc4; i686 Linux; 20020418)
18.104.22.168 Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Q312462)
22.214.171.124 Mozilla/5.0 (compatible; Konqueror/3.1; i686 Linux; 20020213)
126.96.36.199 Mozilla/5.0 (compatible; Konqueror/3.0-rc1; i686 Linux; 20020328)
188.8.131.52 Mozilla/5.0 (compatible; Konqueror/3.1-rc4; i686 Linux; 20020520)
184.108.40.206 Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Q312466)
220.127.116.11 Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Q312462)
18.104.22.168 Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Q312460)
22.214.171.124 Mozilla/5.0 (compatible; Konqueror/3.0-rc6; i686 Linux; 20020204)
Proving they've been busily sneaking around on lots of servers won't be too hard either.
Maybe WebSense should just claim any site that blocks them is off limits since we don't want them on our servers instead of trying to circumvent our security measures.
That would make too much sense wouldn't it?
Of course someone could claim that bad sites would just cloak clean content if they know it's WebSense. However, I'd rather give explicit permission for WebSense and then it wouldn't bother me so much if they crawled in stealth from a different IP address knowing that I gave permission in the first place.
Here's some of their known IP ranges:
Websense 126.96.36.199 - 188.8.131.52Not sure these are the same company as a couple are in Canada and the other is in a different city, but what the heck, make up your own mind on these:
Websense 184.108.40.206 - 220.127.116.11
Websense, Inc 18.104.22.168 - 22.214.171.124
Websense Inc 126.96.36.199 - 188.8.131.52There you go, some good bot blocking to go with your morning coffee should start off a fine Monday!
Websense Systems Inc. 184.108.40.206 - 220.127.116.11
Websense Systems Inc. 18.104.22.168 - 22.214.171.124