I am getting the following errors when I submit a sitemap to google or bing. The error that I get is “Sitemap contains urls which are blocked by robots.txt”. It shows that I have submitted 145 items and that 44 items are blocked by the robots.txt file.
I have added the following to my robots.txt
User-agent: * Allow: / Disallow: Sitemap: http://www.mobeustech.com/sitemap_index.xml
I have checked the reading page in my admin panel and made sure that Discourage Search Engine Visibility was unchecked.
My .htaccess file is the wordpress default for %postname%. I really have no ideas on what to look at.
My server is centOS 6.2, php 5.3, mysql 5.2, apache 2.2
- The topic ‘Site Indexing errors’ is closed to new replies.