Support » Fixing WordPress » Google scrawl errors produced by WordPress/wp-admin/ files

  • Hello,
    All of a sudden (I think it has to do with the update of a WordPress plugin, but I am not sure) I found several crawl errors when checking the site health in Google Webmaster Tools.
    Specifically, these are


    Googlebot couldn’t access the contents of this URL because the server had an internal error when trying to process the request.

    At the same time, I observed that my keyword rankings have deteriorated drastically.
    Since I didn’t change anything on my website, can it be due to these crawl errors?

    I am desperate and would appreciate any help.

    I have two websites with the main website in the root directory of my space and the WordPress blog in the WordPress directory.
    The crawl errors relate to the main website (root directory).

    No idea… Please help!

Viewing 2 replies - 1 through 2 (of 2 total)
  • I have /wp-admin/ disallowed in my robots.txt file. I see no reason for bots to see or link to anything there. If I log out of my blog none of the visible links even go to the wp-admin directory. Actually, /wp-admin/ isn’t even present in my page source.

    Thanks, Mark!
    I already thought about it.
    But what I don’t get is: why now?
    There are no links to wp-admin/ on my website (in the root directory).
    And then the issue with keyword rankings.
    Well, should I start with robots.txt like

    User-agent: *
    Disallow: /WordPress/wp-admin


    User-agent: *
    Disallow: /blog/*.js$
    Disallow: /blog/*.css$
    Disallow: /blog/wp-admin/
    Disallow: /blog/wp-includes/


    Happy holidays!!

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Google scrawl errors produced by WordPress/wp-admin/ files’ is closed to new replies.