WordPress.org

1. Scarrty
   Member
   Posted 3 years ago #

   Heya,
   so a friend and I made a blog it was online before Google should start crawling it so we set Privacy to users only of course. But now where it should be crawled I set the settings back to allow Google and co but Google tells me in Webmaster tools that my site is still blocked cause of a robots.txt that I can't find.
   Pls some help.
   Scarrty

2. iridiax
   Member
   Posted 3 years ago #

   Check in the root level of your domain for the robots.txt. Also, Google can be slow to revisit your site and then update their webmaster tools data. You may have to wait a few days.

3. Scarrty
   Member
   Posted 3 years ago #

   Thx for answer, my root has no robots.txt so I'll have to wait *sigh*

4. Saurus
   Member
   Posted 3 years ago #

   Go to google and submit your site url to their spider - it may catch you faster.

5. Scarrty
   Member
   Posted 3 years ago #

   So I waited for 2 days, but my robots.txt still exists and disallows everything. Google said that it can't enter my site. I don't know what to do I tried everything I know.

6. iridiax
   Member
   Posted 3 years ago #

   Check the date of Google's last visit to make sure that it is after you disabled the privacy settings. Try deleting or renaming the robots.txt file. Also try a site search in Google to see if any of your pages have been picked up:

   site:yoursite.com

7. Scarrty
   Member
   Posted 3 years ago #

   when I use site:mysite.de it shows no sites, and everywhere in Webmastertools it says updated 20th January
   I only use the automatic generated robots.txt from WordPress

Topic Closed

This topic has been closed to new replies.