[Resolved] Googlebot is blocked by robots.txt
I have a problem with getting Google to index my WordPress site.
I am getting errors and warnings saying “Googlebot is blocked” from my site and “URL restricted by robots.txt” in my sitemap uploads.
Initially while I was creating my website I ticked the ‘Ask search engines not to index this site” in the Privacy settings. I have now ticked “Allow search engines to index this site” option, and I have checked http://www.recphysiomassage.com.au/robots.txt. It looks fine and when I test in ismyblogworking.com. it confirms that my robots.txt exists and allows search engines to index.
Has anyone experienced this problem? Is there a solution I can try to overcome the googlebot problem? Will the problem go away when Google next tries to index my site or will it remain blocked?
I am very concerned that I will not be able to get my site listed on Google searches because of this.
- The topic ‘[Resolved] Googlebot is blocked by robots.txt’ is closed to new replies.