WordPress.org

Ready to get started?Download WordPress

Forums

Sitemap and Google WMT issue (3 posts)

  1. jameslaw
    Member
    Posted 2 years ago #

    I recently setup a new website of my own (www.jameslawler.co)

    I have done about 40 WP sites in the past but I am well and truely stuck with this one.

    I have setup my sitemap and robots.txt file, but having submitted it to GWMT I am getting the error.
    URL restricted by robots.txt
    screenshot: http://screencast.com/t/uIFnjGHHwcX7

    I have also tried doing a Fetch on the URL but it tells me access is denied by robots.txt
    screenshot: http://screencast.com/t/oTg940qLyh

    I have also tried putting the content of the robots file into 'Blocked URLs' and this returned results that suggest its valid.
    screenshot: http://screencast.com/t/fWUs0fg5V3

    I am now completely stumped as to why GWMT cannot see my site. Anyone have any suggestions?

  2. cjc1867
    Member
    Posted 2 years ago #

    It takes time or for a visit from a google bot to update your robots.txt in GWMT, mine's about 24 hrs before I see changes.

  3. jameslaw
    Member
    Posted 2 years ago #

    Yeah the only weird this is that its been over 24 hours. Im hoping its just slightly delayed because I had the site set to private and the eventually public.

Topic Closed

This topic has been closed to new replies.

About this Topic