WordPress.org

Ready to get started?Download WordPress

Forums

[resolved] Google Not Indexing Site (10 posts)

  1. louseey
    Member
    Posted 1 year ago #

    We launched a website about two weeks ago (a new site, migrating most of the content from an old wordpress site to new). The URL did change, and now Google's not seeing the site or indexing it. If I do the search for "site:http://themavinsgroup.com" I get a message saying to check the robots.txt file, but I'm not sure how to do that. The privacy setting is not checked so it shouldn't be blocked by search engines. If I view the source for the home page, I see this: <meta name="robots" content="noodp,noydir" />
    Thanks for any help.

  2. Krishna
    Volunteer Moderator
    Posted 1 year ago #

    If I view the source for the home page, I see this: <meta name="robots" content="noodp,noydir" />

    It will not affect indexing because the metatag only tells search engines not to use Open Directory Project (odp) or yahoo directory listings.

    Did you check your privacy settings? Also check if you have a robots txt file in your root directory or where you have WordPress, and see if there are restrictions.

  3. louseey
    Member
    Posted 1 year ago #

    Hi Krishna,
    Yes, I do see a robots.txt file in the root directory. I'm not sure what you mean by where do I have WordPress? Do you mean who is hosting the site?
    Thanks!

  4. Krishna
    Volunteer Moderator
    Posted 1 year ago #

    Check the robots.txt file in your root directory to see if you have restrictive features. I just meant the location where you have WordPress installed, if not in root.

    Also read:
    http://support.google.com/webmasters/bin/answer.py?hl=en&answer=156449

  5. louseey
    Member
    Posted 1 year ago #

    Krishna, Next to the file on the FTP list, it says "Web Visible" - do you think that means it's unrestrictive? I am pretty sure WP is installed in the root. It's the only site hosted on this account.

    And thank you for the link, I will read it now.

  6. louseey
    Member
    Posted 1 year ago #

    Krishna, I just read that link. So now I'm really confused. If there IS a robots.txt file listed in my root directory, should I request that the developer delete it?

  7. louseey
    Member
    Posted 1 year ago #

    Krishna, in Google Webmaster Tools, I checked blocked URLs, and this is what I found,

    http://www.themavinsgroup.com/robots.txt

    User-agent: *
    Disallow:

    Then if I run the test, this is what I get:
    Allowed by line 2: Disallow:
    Detected as a directory; specific files may have different restrictions

    But I'm not sure what it means.

  8. Krishna
    Volunteer Moderator
    Posted 1 year ago #

    Keep only the first line. It allows all bots. Remove the second line (Disallow).

  9. louseey
    Member
    Posted 1 year ago #

    Thank you! You've been fantastic, I really appreciate your help.

  10. Krishna
    Volunteer Moderator
    Posted 1 year ago #

    You are welcome.

    If the issue is resolved, will you please mark the thread as resolved?

Topic Closed

This topic has been closed to new replies.

About this Topic