Robot.txt or remove the page
A simple question. Why we need robot.txt while we can simply remove the page from the website?
See original post by invalid@example.com (Mubashir Ahmad)
Google Adsense and Competing Pay-per-click Ad Networks
A simple question. Why we need robot.txt while we can simply remove the page from the website?
See original post by invalid@example.com (Mubashir Ahmad)
Leave a Reply
You must be logged in to post a comment.