The Support Forums will be in read-only mode for a scheduled maintenance window on 01 September 2016 14:00 UTC - 20:00 UTC. More information.

Yoast SEO
Sitemap not accepted by Google? (5 posts)

  1. ninostar78
    Posted 3 years ago #


    I've installed fresh copy of WP and also added WordPress SEO by Yoast plugin. I wanted to use XML Sitemaps, but when I test it with Google Webmaster, it's not accepted by Google spider - get message url is limited with file robots.txt (but I don't have that file on my server)!

    Is this XML Sitemaps compatible with Google standards?! How can I solve this?

    Kind regards


  2. jhguynn
    Posted 3 years ago #

    I'm getting a similar error message: "URL blocked by robots.txt / Sitemap contains urls which are blocked by robots.txt" I'm wondering if Cloudflare is hanging onto a cached version of my robots.txt file (which had no index, no follow instructions). Any help from someone would be greatly appreciated.

  3. jhguynn
    Posted 3 years ago #

    As an added note to my post above: (a) I'm using an actual robots.txt file (not the virtual one supplied by WP), and (b) I verified that my robots.txt file is correct (no URLs are being blocked).

  4. ninostar78
    Posted 3 years ago #

    I also blocked some of my pages with robots.txt, but not all! It seems that this is some kind of issue with cache?! I've manually added new robots.txt file with all allowed record and location of new sitemap.

    Don't know if that will help?

  5. jhguynn
    Posted 3 years ago #

    I'm in wait and look mode right now as well. Let me know how it goes.

Topic Closed

This topic has been closed to new replies.

About this Plugin

  • Yoast SEO
  • Frequently Asked Questions
  • Support Threads
  • Reviews

About this Topic


No tags yet.