• Resolved edgin

    (@edgin)


    Hello

    Few days ago I got lots of crawl errors 1000+
    In the error report some of them look like this:
    1. domainname/blog/tag/name-of-post/page/8/,
    2. domnain-name/blog/category/some category/,
    3. /blog/author/admin/page/22/
    and so on ..

    In permalionks i have /blog/%postname%/
    Can somebody explain me what might couse this.

Viewing 12 replies - 1 through 12 (of 12 total)
  • Do those pages actually exist? Do you have a sitemap? Are they in that?

    Thread Starter edgin

    (@edgin)

    Yes we have sitemap there.
    Some of the pages dont exist like from example
    but some on the other hand are there but in changed url
    for example blog post in the crawl error list look like this:
    http://domain-name/name-of-the-post/
    while we have it in sitemap like this
    http://domain-name/blog/name-of-the-post/

    Ok, when you’re talking about crawl errors, where are you finding these? Google, or similar?

    I assume all those examples from the sitemap are correct URLs, are they?

    Thread Starter edgin

    (@edgin)

    Yes, they are all from google webmaster docs few days ago.
    Sitemap list is accurate and valid and linked to real pages.

    So, those crawl errors means that Google has picked these up from somewhere – either a sitemap or some other site which has links to you. The latter is often some kind of phishing site so, well, it just happens. The former, well, the ones you said are similar to the real URLs might indicate that at some point you changed your permalinks, so maybe Google is still looking for those (or the sitemap didn’t update quickly so Google picked up a load of broken links until it updated).

    Either way, the important thing is, those aren’t real links. You can ignore them or inform Google they’re incorrect.

    Thread Starter edgin

    (@edgin)

    Yes one of those scenarios are considered for sure, thanks dartiss.
    What i don’t get is why for tags for example it created /blog/tag/name-of-tag instead of /tag/name-of-tag , how can i achieve this to resemble to the non existant /blog/tag/name-of-tag, if I could recreate that then I might know what happened maybe.

    Are you running a multisite installation?

    Thread Starter edgin

    (@edgin)

    No,its regular one site

    Odd. That blog prefix is the default added to a multisite.

    I’ll admit to not knowing why it’s specifically looking for those. Maybe some odd “blip” with whatever plugin created your sitemap or something.

    The good thing is, all is fine now, so those errors should drop off.

    Thread Starter edgin

    (@edgin)

    Yes that would sum up this strange sitation.
    HOpe it wont come up again.
    Thanks dartiss!!
    Great help!

    My pleasure. If you could set this discussion as “resolved” it will be appreciated πŸ™‚

    Thread Starter edgin

    (@edgin)

    This post can be marked as resolved.

Viewing 12 replies - 1 through 12 (of 12 total)

The topic ‘lots of 404 crawl errors’ is closed to new replies.