What does Google see in the website at first time?
1. Http header tool 2. Robots.txt 3. .htaccess file I think Google first see http header tool then robots.txt and .htaccess file. Am i right? Give your useful comment. See original post by AmbrellCooder