Yoast SEO
Sitemap URLs blocked by robots.txt (1 post)

  1. Klypy
    Posted 2 years ago #

    WP - 3.5.1
    WP SEO - 1.4.2

    Issue: Url blocked by robots.txt.
    Description: Sitemap contains urls which are blocked by robots.txt.

    The plugin seemed to be working fine since the last few months. But i noticed a few days back that Google Webmaster tools showed URL blocked by robots.txt for both the home page (http://www.couponminister.in) and all the sitemaps (available at http://www.couponminister.in/sitemap_index.xml)

    I changed the robots.txt text to allow everything. After the next crawl by google 2-3 days later http://www.couponminister.in now is not blocked by robots.txt. But i get a warning for all the sitemaps. I am not able to figure out why the xml sitemaps are showing url blocked by robots.txt.

    Please help.


Topic Closed

This topic has been closed to new replies.

About this Plugin

  • Yoast SEO
  • Frequently Asked Questions
  • Support Threads
  • Reviews

About this Topic