I have recently updated my Robots.txt file and was wondering if I am blocking items that I should. Also, the way I currently have it, is it doing any harm to my site ranking/indexing wise?
My site is: http://techfleece.com/
My robots.txt file reads as:
User-agent: * Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content User-agent: Mediapartners-Google Allow: / User-agent: Adsbot-Google Allow: / User-agent: Googlebot-Image Allow: / User-agent: Googlebot-Mobile Allow: / User-Agent: bingbot Allow: /