WordPress.org

Ready to get started?Download WordPress

Forums

WordPress SEO by Yoast
Sitemap contains urls which are blocked by robots.txt - Yoast SEO p (3 posts)

  1. zerpex
    Member
    Posted 1 year ago #

    Hi,

    I've installed Yoast SEO plugin, and I enabled the sitemap thingy.

    I then submitted the sitemap_index.xml to GWT, but getting the error: Sitemap contains urls which are blocked by robots.txt.

    Some examples GWT gives:
    https://hosting4real.net/category-sitemap.xml
    https://hosting4real.net/post-sitemap.xml
    https://hosting4real.net/page-sitemap.xml

    My robots.txt is located at:
    https://hosting4real.net/robots.txt

    And my sitemap_index.xml at:
    https://hosting4real.net/sitemap_index.xml

    It's the only robots.txt file that is stored on the account (Im on a dedicated server).
    Do anybody know what I could do, so it would not think that I'm actually blocking it, which I isn't?

    Best regards,
    Lucas R

    http://wordpress.org/extend/plugins/wordpress-seo/

  2. Night Hawk
    Member
    Posted 1 year ago #

    me too I get this: Url blocked by robots.txt.

  3. AzzX
    Member
    Posted 1 year ago #

    I think the /wp-admin and related non user paths are automatically blocked via WordPress which causes this error, would be nice for Webmaster tools to be more specific though.

Topic Closed

This topic has been closed to new replies.

About this Plugin

About this Topic