yahoo hosting hosting rejects googlebot (4 posts)

  1. navigadget
    Posted 9 years ago #

    I use yahoo hosting.

    When I go through my access logs I see that when googlebot tries to crawl my site it gets a 500 error from my host - almost all the time.

    There are times when all is well and it gets a 200, but I wasnt able to see the pattern.

    I'd like to know if anyone else who use yahoo other than me has seen this problem.

    Fastest way to check is to point your browser to your access log and search for " 500 ". Putting the spaces around it helps filter out unwanted stuff.

  2. navigadget
    Posted 9 years ago #

    Am I the only one using yahoo hosting?

  3. febwa1976
    Posted 9 years ago #

    I still have one site left at yahoo and googlebot seems to work just fine - seems like all day every day!

    I have a google sitemap - wonder if that helps?

  4. navigadget
    Posted 9 years ago #

    I'm using sitemaps. I don't think it is making a difference.

    I called yahoo about this and their helpful support guy suggested that I tell google to send a different crawler to my site :)

Topic Closed

This topic has been closed to new replies.

About this Topic