• I have tried adding the sitemap to Google webmaster, but it says
    URL restricted by robots.txt. Is there any way around this?

Viewing 9 replies - 1 through 9 (of 9 total)
  • Edit your robots.txt file to allow robots the access to your sitemap.

    Thread Starter martinbelton

    (@martinbelton)

    Where is the default folder location for this?

    Thread Starter martinbelton

    (@martinbelton)

    It doesn’t appear to exist :/

    If it is manually added, it shoud be in the root directory of your blog.

    Else, if it is dynamically generated by WordPress, check if there’s actually a block present in the file by going to – YourDomain.com/robots.txt
    Replace YourDomain with your actual domain name.

    Thread Starter martinbelton

    (@martinbelton)

    It’s not there – should I create one?

    You don’t need to, if you are not looking to add specific blocks.

    Just check in your Dashboard> Settings> Reading that the box in front of Discourage search engines from indexing this site is unchecked. If it is checked, un-check it and save the changes.

    Thread Starter martinbelton

    (@martinbelton)

    It is unchecked

    Strange! What text shows up when you open YourDomain.com/robots.txt

    Certainly a plugin is doing that change to your dynamic robots file.

    Thread Starter martinbelton

    (@martinbelton)

    This is somewhat embarrassing, isn’t it?
    It seems we can’t find what you’re looking for. Perhaps searching can help.

Viewing 9 replies - 1 through 9 (of 9 total)
  • The topic ‘Sitemap restricted by robots.txt’ is closed to new replies.