WordPress.org

Forums

Restricted by robot (6 posts)

  1. jmor65
    Member
    Posted 5 years ago #

    Hello,

    In G webmaster tools I get this message:
    Your site is indexed as http://example.com/ not as http://www.example.com/. If you want to see all data for your site, you need to add and verify http://example.com/ as well.

    I added and verified both versions but in dashboard of http://www site it shows as url restricted. On the dashboard of http:// site it shows all to be ok with no restrictions.

    I am wondering how I fix this or if I should.

  2. esmi
    Forum Moderator
    Posted 5 years ago #

    You don't need to. If you've submitted a sitemap to Google, it will assume that the urls used in that sitemap are your preferred urls. It uses this preference when returning results for your site to ensure that it doesn't list each page twice - one with www and once without. This doesn't harm your site's indexing or page rank in any way.

  3. esmi
    Forum Moderator
    Posted 5 years ago #

    Another thought - do you have a robots.txt file in your root folder? Have you checked that to see if it restricts the www domain?

  4. jmor65
    Member
    Posted 5 years ago #

    Hi there,

    Thanks for the explanation and the help. That makes sense...

    Yes now I have a robots.txt file in the root as of last night. I uploaded this file:

    User-agent: *
    Allow: /

    This should work, correct?

  5. devicbojan
    Member
    Posted 5 years ago #

    Your robots.txt is not blocking anything so it's not a problem.

  6. jmor65
    Member
    Posted 5 years ago #

    Great! thanks....

Topic Closed

This topic has been closed to new replies.

About this Topic

Tags

No tags yet.