I'm not sure what Brett's up to on WebmasterWorld but his new robots.txt file blocks all robots including Google so now you can't even search WebmasterWorld unless you want to resort to using Yahoo. He claims he's trying to stop rogue bots but that's fairly easy to do unless they're using a series of random URLs which is very rare.
I'm not sure what's going on but we'll be keeping an eye on this fiasco as it progresses.
Wednesday, November 23, 2005
Robots Blocked?
Subscribe to:
Post Comments (Atom)
2 comments:
Yes, what is Brett up to?
OptiRex I've noticed the same thing.
I'll try WW from a different computer that's never been on WW later today but I'm speculating he's tracking IPs and not allowing anonymous access from an IP with a known user on the account, not sure.
Plus I think Brett changed the cookies the other day as I was logged in already and it made me log in yet again.
I have no clue what's going on over there but it's stranger than fiction at the moment.
Post a Comment