WordPress.org

Ready to get started?Download WordPress

Forums

WordPress SEO by Yoast
Sitemap not accepted by Google? (5 posts)

  1. ninostar78
    Member
    Posted 8 months ago #

    Hi,

    I've installed fresh copy of WP and also added WordPress SEO by Yoast plugin. I wanted to use XML Sitemaps, but when I test it with Google Webmaster, it's not accepted by Google spider - get message url is limited with file robots.txt (but I don't have that file on my server)!

    Is this XML Sitemaps compatible with Google standards?! How can I solve this?

    Kind regards

    http://wordpress.org/plugins/wordpress-seo/

  2. jhguynn
    Member
    Posted 8 months ago #

    I'm getting a similar error message: "URL blocked by robots.txt / Sitemap contains urls which are blocked by robots.txt" I'm wondering if Cloudflare is hanging onto a cached version of my robots.txt file (which had no index, no follow instructions). Any help from someone would be greatly appreciated.

  3. jhguynn
    Member
    Posted 8 months ago #

    As an added note to my post above: (a) I'm using an actual robots.txt file (not the virtual one supplied by WP), and (b) I verified that my robots.txt file is correct (no URLs are being blocked).

  4. ninostar78
    Member
    Posted 8 months ago #

    I also blocked some of my pages with robots.txt, but not all! It seems that this is some kind of issue with cache?! I've manually added new robots.txt file with all allowed record and location of new sitemap.

    Don't know if that will help?

  5. jhguynn
    Member
    Posted 8 months ago #

    I'm in wait and look mode right now as well. Let me know how it goes.

Reply

You must log in to post.

About this Plugin

About this Topic

Tags

No tags yet.