WordPress.org

Forums

Page shows on Google Blog search, but not standard Google? (24 posts)

  1. Mammatus
    Member
    Posted 8 years ago #

    I recently started a new page on my own domain (www.notesinthemargin.com) and it has been up for around a week or so. It is now showing up when I use a google blog search, but none of my pages/information shows up on a standard google search. I know that the process can take time, but it seems as though they should show up there by now. Some other pages that reference my domain (such as a post I made in this forum earlier in the week) do show up on a standard google search, but not any posts/pages from my own domain.

    It seems as though google only sees my domain as a blog and will not allow any searches to return any hits via a standard search. Is there anyone that can help me get my page to show up in google (not in their blog search)?

    Thanks!

  2. Class
    Member
    Posted 8 years ago #

    A few things. Are you using google sitemaps? Do you have a robots.txt file in the root of your webfolder that may be blocking spiders like google?

    It can take some time like you say for your site to be indexed.

  3. xinfo
    Member
    Posted 8 years ago #

    there are two kind of bot's one is for blog appear when every jyou make a post and other for crawl

  4. Class
    Member
    Posted 8 years ago #

    Really? My logs only show one from Google, "Googlebot".
    Are you perhaps thinking of what happens when you publish a post and "ping" other sites?

  5. Try adding a sitemap and signing up at Google's webmaster tools. Then you can verify that the site is being seen correctly and determine why it's not.

    The sitemaps plugin is an excellent tool for WordPress blogs. Makes it very easy to get your site indexed by Google.

  6. Mammatus
    Member
    Posted 8 years ago #

    I recently added a sitemap (several days ago) which google webmaster tools states was verified, but my site is still not being indexed.

    The webmaster tools page says my page has been verified and that Googlebot last visited my page on February 3rd...nearly 2 weeks ago. Shouldn't it be visited every day?

  7. No. If you have a sitemap, Googlebot will usually only visit your site when the sitemap gets updated (when you ping Google, which the sitemap plugin does on new posts and such). That's sort of the whole point, so that Googlebot doesn't have to visit you every day. And even then, sometimes it'll be a day or two after the update before the bot gets around to it.

  8. Mammatus
    Member
    Posted 8 years ago #

    Gotcha - that makes sense about the sitemap.

    The thing is, I have updated the page several times since adding the sitemap and the sitemap has been verified, as has the domain, but google still tells me that it has not indexed any pages. When I do a search for my domain name, it cannot find it. It finds some outside links (like some diggs and even THIS THREAD since I've put the domain name in here), but not any actual pages from my domain.

    I can find several of my posts if I do a BLOG search, but none appear during a regular google search, and I'd like them to. Is there a reason they only appear when doing a google blog search rather than a standard search?

    I have tried to analyze the robots.txt file via google's webmaster tool, but it says the robots.txt file is greater than 5000 characters, so it cannot be analyzed...could there be an issue there?

    For the record, the site I'm talking about is here:
    http://www.notesinthemargin.com

    Thanks for everyone's tips!

  9. Your robots.txt is redirecting to your homepage. That's not right.

    It appears that you're using default permalinks with an .htaccess file. That's probably causing most of your problems. Switch to one of the non-default permalinks settings in Options->Permalinks. This will give you nicer permalinks and correct this problem (by allowing your blog to return 404's). Alternatively, delete the .htaccess file that you currently have. Either one will do.

    No idea if this will help with your Google issues or not, but it cannot hurt.

  10. Mammatus
    Member
    Posted 8 years ago #

    Thanks for the tip on the .htaccess file. I changed the permalink structure to a different one (including "archive" in the address...).

    It still seems strange that the google crawler last visited my page nearly 2 weeks ago (on Feburary 3rd according to the google webmaster tools site) even though I have posted several times since then and my sitemap has been updated and notified google each time it was changed (according to the sitemap plugin on my wordpress dashboard).

    Regarding the robots.txt file, I am not familiar with how to use it and I fear that perhaps that is part of my google issues...I have read about the robots.txt file on the google webmaster tools page, but it was a bit beyond my ability to tackle...anyone know of any good tutorials or even better yet, some sort of plugin to construct/format the proper robots.txt file so that google is happy with it?

    Thanks again for the suggestions - I appreciate them more than you know!

  11. No robots.txt file is a good robots.txt file.

    The robots.txt file can only *block* search engines. If you don't want to block them, then you don't need to have it at all.

  12. Mammatus
    Member
    Posted 8 years ago #

    Gotcha...then since I apparently don't have a robots.txt, I'll just leave that as-is.

    I'm still hoping the sitemap does its magic and allows my page to start showing up on google. I'll keep checking and if it is still not indexing in a few days, I'll post again and see what ideas anyone has. It still seems strange that it only shows up on the blog search but not the regular search.

    Anyone with any more tips on why google is not indexing any of my pages (it even says that on the webmaster tools...even though the URL has been submitted and verified, along with a valid sitemap) then I'd love to hear the suggestions!

    Thanks again for all your help - it is much appreciated!

  13. notesinthemargin
    Member
    Posted 8 years ago #

    So now I seem to have a robots.txt (I didn't even create it or change anything in the past few days though...strange) but you can see it when you visit my page:
    http://www.notesinthemargin.com/robots.txt
    And from what my understanding is, that robots.txt file will allow any/all robots to index my site.

    That is a good thing, right?

  14. Mammatus
    Member
    Posted 8 years ago #

    So my robots.txt file is good.
    My sitemap is all set and verified.
    My URL has been added (and verified) by google.
    My page has been frequently updated.
    My page/posts are linked to from other pages.
    Several posts have even been "dugg".
    My posts and pages appear on google "blog search".

    My page is still not indexed by google.

    Augh!

    Any input would be appreciated!

  15. Mammatus
    Member
    Posted 8 years ago #

    Still not showing up on google...

    Shows up on most other search engines: msn, yahoo, askjeeves, and others...

    If anyone has any suggestions I'd love to hear them!

  16. Mammatus
    Member
    Posted 8 years ago #

    This is STILL a problem. I realize it is not directly a WP problem, but the google webmaster forums and other places I've visited haven't helped, so I'm upping this thead to see if anyone around here has any more ideas. Google gives a cached version of my site, but it does not appear in the indes (via a site: search or any other type).

    ANY help would be appreciated!!

  17. reln
    Member
    Posted 8 years ago #

    I am having the same problem now for several months. Google will only index the pages of my last few posts and all the others dont appear except for the cached version.

    Its extremely frustrating since I have had posts appear on the first page of search results and now they are no longer around. I get information that the pages are indexed by doing a site:www. but the pages dont appear when I do a search.

    I was told repeatedley that its a page rank issue. I think thats a load of B.S. I've had pages with a page rank of 4 drop out completely.

    i havent found anyone who was able to help now after months.

    I am starting to think that maybe its a template issue. Altough I have switched templates and the problem still isnt resolved.

  18. reln
    Member
    Posted 8 years ago #

    I am having the same problem now for several months. Google will only index the pages of my last few posts and all the others dont appear except for the cached version.

    Its extremely frustrating since I have had posts appear on the first page of search results and now they are no longer around. I get information that the pages are indexed by doing a site:www. but the pages dont appear when I do a search.

    I was told repeatedley that its a page rank issue. I think thats a load of B.S. I've had pages with a page rank of 4 drop out completely.

    i havent found anyone who was able to help now after months.

    I am starting to think that maybe its a template issue. Altough I have switched templates and the problem still isnt resolved.

  19. reln
    Member
    Posted 8 years ago #


  20. reln
    Member
    Posted 8 years ago #

    Sorry for the duplicate posts?? I cant delete them.

  21. rengel
    Member
    Posted 8 years ago #

    Hi folks. I do have somewhat the same issue with my blog. I started the blog on 25.04.07. google visited it ONCE and indexed 5 of my blog pages (site:r.engel.free.fr in google search bar). But i have written at least 50 posts since and added them on a day by day bases. i use the sitemap plugin as well. last and only google access to my site was on 10.05.07. but i have been sitemaping and pinging google manually ever since my blog was up. i have delted all old pages on my server (from other webs i had but werent good) to assure not having negative points from google for bad content.
    I wounder if the constant plugin pinging might cause a ping spam alarm with google? could that be it?
    then it might be preferable to use manual sitemap.xml creation and upload once a week for example instead the plugin.
    If anyone out there is using the plugin with success please let us know how you do it!
    thanks

  22. ghoch
    Member
    Posted 8 years ago #

    Create a XML sitemap for your site. It's easy.
    Sitemap protocol
    Or download Sitemap Writer Pro, crawl your site, create sitemap, upload it and notify Google about a new sitemap.
    Google will index your site in 2-5 days.

  23. paresthesia69
    Member
    Posted 8 years ago #

    Has the XML sitemap worked for reln and Mammatus?

    I've added this sitemap plugin as well as a meta description/keyword plugin to the blog that I am working on: http://www.talkshoe.com/blog

    ...And still, google blog search nor google search are updated with any posts to the blog.

  24. bpaul38
    Member
    Posted 7 years ago #

    My page http://www.heronswoodvoice was just started arounf 10 days ago.. When I typed in "Heronswood" I came up on the top of page 2 on the google search.

    One day later - I cant find it anywhere on Google - 10 pages down and nowhere to be found. Whats going on there?

Topic Closed

This topic has been closed to new replies.

About this Topic

Tags

No tags yet.