Googlebot is blocked from my site (4 posts)

  1. aw1980
    Posted 4 years ago #

    I cant find the robots.txt to edit it and have changed settings in privacy. when I look at my robots.txt this is what it shows

    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/

    Been searching for a solution for hours :(

  2. s_ha_dum
    Posted 4 years ago #

    You don't need a solution for that. Google has no business in wp-admin or wp-includes. Google couldn't get into wp-admin if it tried (It would need a username and password) and direct access to files in wp-include should just get you a blank page. Try it.

    Type site:yoursite.com into Google's search button and see if you are listed.

  3. aw1980
    Posted 4 years ago #

    Hi google webmaster tools is showing me 52 blocked urls how do i fix that.
    and when i submit sitemap i get this error (Sitemap contains urls which are blocked by robots.txt.) I have my privacy setting set up ok

    my site - http://www.outdoor-lounge-chairs.com

  4. s_ha_dum
    Posted 4 years ago #

    What are the URLs?

    There may be some Javascript files loading from wp-includes but Google shouldn't be crawling those.

    I looked at your sitemap and neither 'wp-admin' nor 'wp-includes' is in any of the URLs.

Topic Closed

This topic has been closed to new replies.

About this Topic


No tags yet.