Forums

Posts not indexing on Google (17 posts)

  1. lbnews
    Member
    Posted 2 years ago #

    We are adding regular content everyday but for the past few weeks Google don't seem to index the new posts.

    Usually they were indexing within a few minutes.

    Can anyone help with this?

    Thanks.

  2. iridiax
    Member
    Posted 2 years ago #

    What is your url?

  3. John Hoff
    Member
    Posted 2 years ago #

    Get a Google account and use the Google Webmaster Tools to run a diagnostic on your site. It'll show if there are any crawl errors.

    Also, log into WP and under Settings -> Privacy, make sure your WP isn't blocking search engines.

  4. nazsit
    Member
    Posted 2 years ago #

    I have the same problem. New posts are not indexed. Have a google account, no crawl errors showing. Google ran throught the site on Nov 1st but the new posts are not indexed. WP settings are correct.

  5. songdogtech
    Member
    Posted 2 years ago #

    Check your page source and be sure you don't still have a "no index, no follow" meta tag. And check for a robots.txt file that is blocking bots. Other than that, wait on Google.

  6. nazsit
    Member
    Posted 2 years ago #

    Already did. Don't have a nofollow,noindex tag. Wait for what? We were indexed immediately before, popped up number 1 after all new posts, now only the old ones show up.

  7. songdogtech
    Member
    Posted 2 years ago #

    Try turning up Google's crawl rate in your sitemap account. Might work. Google also likes good original content, too, not aggregator content.

  8. nazsit
    Member
    Posted 2 years ago #

    We only have original content. I can try modifying the crawl rate but they crawled the site yesterday.

    I'd like to know what happened. I have read other similar posts as well, something happened...

  9. iridiax
    Member
    Posted 2 years ago #

    nazsit: Google can be very slow to index new sites, sometimes taking a week or more to do so. They did recently announce that they are now using site feeds for discovering and indexing, so make sure that you have WordPress set to ping update services (Dashboard -> Settings -> Writing). I'm not sure if they gather info from Google Reader, but you could try subscribing to your site in Google Reader as well.

    http://googlewebmastercentral.blogspot.com/2009/10/using-rssatom-feeds-to-discover-new.html
    http://codex.wordpress.org/Update_Services

    To see if your site is in Google, try this search with your own domain: site:example.com

  10. songdogtech
    Member
    Posted 2 years ago #

    iridiax, Really good additonal info re: Goggle and feeds.....

  11. nazsit
    Member
    Posted 2 years ago #

    The blog is NOT new. It's been around - and well indexed - since 2006.

    Google just recently stopped indexing new posts. Google is crawling the site just not adding the new posts.

  12. iridiax
    Member
    Posted 2 years ago #

    If your site is not new and Google stops indexing or starts dropping indexed pages from its index, then check with Google Webmaster Tools for any site issues (malware, penalties, URL unreachable errors, robots.txt problems, etc.). I had this exact problem at one web host due to network unreachable and robots.txt file unreachable errors.

  13. alism
    Member
    Posted 2 years ago #

    What's the site URL?

  14. roshanratnayake
    Member
    Posted 2 years ago #

    have the same problem http://roshanratnayake.wordpress.com/

    please advise how i can fix

  15. MichaelH
    Volunteer
    Posted 2 years ago #

    rosh---you will want to ask that at http://en.support.wordpress.com/contact/

  16. leslienorth
    Member
    Posted 1 year ago #

    Would love to get some help on this same topic.

    My blog is not being indexed by search engines and as it turns out google is saying that they robot.txt file is unreachable.

    This is the error message that I get for this URL:
    http://thetravelmonster.com/robots.txt

    Internal Server Error

    The server encountered an internal error or misconfiguration and was unable to complete your request.

    Please contact the server administrator, [no address given] and inform them of the time the error occurred, and anything you might have done that may have caused the error.

    More information about this error may be available in the server error log.

    Additionally, a 500 Internal Server Error error was encountered while trying to use an ErrorDocument to handle the request.

    Can someone help?

    Also, I host my blog through network solutions just in case that is a factor.

    Thanks so much!

  17. alism
    Member
    Posted 1 year ago #

    leslienorth, Take a look at your .htaccess just to make sure it's not got an errors or corrupt. Try renaming it temporarily to see if it makes things work again.

    Otherwise, I'd delete the robots.txt entirely for the time being. If there's anything particular you do want to block, create a new one in your favourite text editor and upload it via FTP in ascii mode.

    If you're still having problems after that, speak to your host as they'll probably be able to troubleshoot any config probs quite quickly.

Topic Closed

This topic has been closed to new replies.

About this Topic

Tags

No tags yet.