Wednesday, November 23, 2005

Robots Blocked?

I'm not sure what Brett's up to on WebmasterWorld but his new robots.txt file blocks all robots including Google so now you can't even search WebmasterWorld unless you want to resort to using Yahoo. He claims he's trying to stop rogue bots but that's fairly easy to do unless they're using a series of random URLs which is very rare.

I'm not sure what's going on but we'll be keeping an eye on this fiasco as it progresses.


Gary Freedman said...

Yes, what is Brett up to?

OptiRex said...

WMW is starting to pi$$ me off!

The mods are getting worse than any Politically Correct Police deleting posts or entire threads deemed "whatever".

Today, Thursday 24th, I visited the board and wanted to check a thread and damn me now I have to log in just to read it!!!

This ain't fun any more, methinks the Google Dollars may be having influence...I sincerely hope not.

IncrediBILL said...

OptiRex I've noticed the same thing.

I'll try WW from a different computer that's never been on WW later today but I'm speculating he's tracking IPs and not allowing anonymous access from an IP with a known user on the account, not sure.

Plus I think Brett changed the cookies the other day as I was logged in already and it made me log in yet again.

I have no clue what's going on over there but it's stranger than fiction at the moment.