WordPress.org

Ready to get started?Download WordPress

Forums

Googlebot is blocked from Website (2 posts)

  1. menton
    Member
    Posted 2 years ago #

    We have just launched a website (www.gocar.ie). For the first day the box to ask Search Engines not to index this site was ticked - I changed it to allow search engines to index this site.

    However, I am getting an issue with the robots.txt file in Google Webmaster tools - and no matter what I try, I get this message: "The page could not be crawled because it is blocked by robots.txt"

    My robots.txt is as follows, but I don't believe this to be this issue:

    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/

    Anybody got any ideas? Google Webmaster Tools is saying Googlebot is blocked from the site, and the sitemap has 800 issues (www.gocar.ie/sitemap.xml) despite the fact there are only 32 pages in the sitemap.xml.

    All help is appreciated - can't get my head around this issue.

  2. Pothi
    Member
    Posted 2 years ago #

    Please try to add a line in your robots.txt file. As Google doesn't check a new site often, please wait for a few hours for Google to check your robots.txt file.

    Sitemap: http://www.gocar.ie/sitemap.xml

Topic Closed

This topic has been closed to new replies.

About this Topic