I have a few sites i built this weekend and when I started I disabled the button in WP so would not be crawled yet. I have now enabled that and cannot get the sitemap to go in Webmaster Tools and keeps telling me it is blocked. Three sites one worked just fine and 2 others keep saying blocked.
If I check my Robots.Txt it is this and just recently changed to this to see if would help.
In Webmaster tools it says this in one place..
Home Page Access
Googlebot is blocked from http://bestgolfingvideos.com/
This is the error I keep getting.
URL restricted by robots.txt
Only 2 plug-ins: Contact us Form and WordPress Seo
Could it be that since I just hit the button for the robots to start could it take a bit to allow this and just wait.
Or any suggestions as what to do as to make the 2 sites load the site map in Webmaster like the other 1 did.
- The topic ‘WP Site Blocked from bots’ is closed to new replies.