Dev Shed Forums – Robots.txt

Date: September 21st, 2012 11:44 AM – Nullified – Robots.txt
Post: User-agent: *
Allow: /
Allow: /my/announcements*
Allow: /my/knowledgebase*
Allow: /my/downloads*
Disallow: /my/
Disallow: /images/
Disallow: /includes/
SITEMAP: http://www.option9.com/sitemap.xml
I would like to not permi…

See original post by AdMarketeers