Support » Fixing WordPress » Sitemap and Google WMT issue
4 years, 6 months ago
I recently setup a new website of my own (www.jameslawler.co)
I have done about 40 WP sites in the past but I am well and truely stuck with this one.
I have setup my sitemap and robots.txt file, but having submitted it to GWMT I am getting the error.
URL restricted by robots.txt
I have also tried doing a Fetch on the URL but it tells me access is denied by robots.txt
I have also tried putting the content of the robots file into ‘Blocked URLs’ and this returned results that suggest its valid.
I am now completely stumped as to why GWMT cannot see my site. Anyone have any suggestions?
It takes time or for a visit from a google bot to update your robots.txt in GWMT, mine’s about 24 hrs before I see changes.
Yeah the only weird this is that its been over 24 hours. Im hoping its just slightly delayed because I had the site set to private and the eventually public.