I’ve installed wordpress on to a domain here – http://shedalarms.com
After verifying the site with google webmaster I was told the site is being blocked from google using the robot.txt file. I checked the privacy settings and it was indeed blocked so I made sure it was crawlable.
My robots.txt file on the domain currently reads as follows (no forward slash so I assume nothing is blocked!) – http://shedalarms.com/robots.txt
However in google webmaster it still reads as
I’ve also tried adding my own robots file with allow all, but google is still reading it as above despite telling it to check my site again.
Can anyone offer up any suggestions as to why this is happening? Do I just need to leave it to refresh or is something wrong?
- The topic ‘Google webmaster robots.txt problem’ is closed to new replies.