Support » Plugin: Yoast SEO » Blocked by robots.txt

  • WordPress SEO version:

    I installed the plugin – set the privacy settings in wordpress to allow the search engines to index the site.

    I submitted the sitemaps to webmaster tools

    The home page is showing as being ‘blocked by robots.txt’ as well as 55 other URLs.

    The page sitemap is showing that 14 URLs have been submitted but only one is indexed.

    The post sitemap is showing that 2 URLs were submitted and one is blocked.

    the robots.txt file shows
    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/

    site is

Viewing 2 replies - 1 through 2 (of 2 total)
  • I have the exact same problem.

    Google has indexed the site, but it says:
    A description for this result is not available because of this site’s robots.txt – learn more.

    (Yoast) WordPress SEO Version

    I managed to fix it myself – as there was no response here. and now i can’t remember what i did !!

    I think I disabled the xml sitemaps – and installed the google xml sitemap creator.

    I then did something else with the robots.txt file….

    can’t remember what though…

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Blocked by robots.txt’ is closed to new replies.