New User Agent for News

«Webmaster Level: Intermediate Today we are announcing a new user agent for robots.txt called Googlebot-News that gives publishers even more control over their content. In case you haven’t heard of robots.txt , it’s a web-wide standard that has been in use since 1994 and which has support from al…»   » source  |  + cache
 

See original post by Chris Gilmer