Speaking the language of robots

<<Written by Sean Harding, Webmaster Tools Team We all know how friendly Googlebot is . And like all benevolent robots, he listens to us and respects our wishes about parts of our site that we don’t want crawled. We can just give him a robots.txt file explaining what we want, and he’ll happily c…>>   (more…)

See original post by Chris Gilmer