Dev Shed Forums – Robots.txt
Date: September 21st, 2012 11:44 AM – Nullified – Robots.txt
Post: User-agent: *
Allow: /
Allow: /my/announcements*
Allow: /my/knowledgebase*
Allow: /my/downloads*
Disallow: /my/
Disallow: /images/
Disallow: /includes/
SITEMAP: http://www.option9.com/sitemap.xml
I would like to not permi…
See original post by AdMarketeers
Leave a Reply
You must be logged in to post a comment.