Error in Google Webmaster Tools – fetching robots.txt failed

  • euronash

    (@euronash)


    10 years, 11 months ago

    Hello,

    WordPress version: 3.5.1
    WordPress SEO version: 1.4.7

    It’s been 2 days since I switched to WP from different CMS.

    Today I have received a message in my Google Webmaster Tools: “Google couldn’t crawl your site because we were unable to access the robots.txt file”

    I have the following set to Noindex in WordPress SEO plugin:
    subpages of archives, all the taxonomies to Noindex, follow, as well as author and date archives.

    In GWT this what is shown for robots.txt:

    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/

    Further more, there is no sitemap visible in GWT.
    I can’t access either one of the files though my browser.

    Any help would be greatly appreciated.

    Nash

    http://wordpress.org/extend/plugins/wordpress-seo/

  • The topic ‘Error in Google Webmaster Tools – fetching robots.txt failed’ is closed to new replies.