Not sure what good old Yahoo is up to exactly as this spider hasn't shown up in my spider trap before but Yahoo Blogs is attempting to crawl the content from my RSS Feeds directly. Not sure if they intend to display the content directly to the user or still redirect to my site so I'm not sure I'm letting them step past the RSS feed just yet.
209.191.83.13 Yahoo-Blogs/v3.9 (compatible; Mozilla 4.0; MSIE 5.5; http://help.yahoo.com/help/us/ysearch/crawling/crawling-02.html )
Official Name: crc4.opn.search.mud.yahoo.com
IP address: 209.191.83.13
Maybe it's harmless and I'll let it pass, something to contemplate over a beer.
Thursday, February 02, 2006
Yahoo Blogs Doing a Content Crawl
Subscribe to:
Post Comments (Atom)
1 comment:
Good find, IncrediBILL.
Post a Comment