Ready to get started?Download WordPress


WordPress SEO by Yoast
Sitemap URLs blocked by robots.txt (1 post)

  1. CouponMinister
    Posted 1 year ago #

    WP - 3.5.1
    WP SEO - 1.4.2

    Issue: Url blocked by robots.txt.
    Description: Sitemap contains urls which are blocked by robots.txt.

    The plugin seemed to be working fine since the last few months. But i noticed a few days back that Google Webmaster tools showed URL blocked by robots.txt for both the home page (http://www.couponminister.in) and all the sitemaps (available at http://www.couponminister.in/sitemap_index.xml)

    I changed the robots.txt text to allow everything. After the next crawl by google 2-3 days later http://www.couponminister.in now is not blocked by robots.txt. But i get a warning for all the sitemaps. I am not able to figure out why the xml sitemaps are showing url blocked by robots.txt.

    Please help.


Topic Closed

This topic has been closed to new replies.

About this Plugin

About this Topic