Robots.txt Question
Hello,
What does it mean in robots.txt ?
User-agent: *
Disallow: /
Allow: /$
Does it only allow index page domain?
Also if i add:
Allow: /category/
Will it allow http://www.domain.com/category/catname/ ?
Thank you.
See original post by invalid@example.com (PaRaDiGm13)
Leave a Reply
You must be logged in to post a comment.