Sitemap has errors: Too many URLs

  • Resolved varunchopra

    (@varunchopra)


    7 years, 7 months ago

    Getting the following error when Google tries to index my sitemaps:

    “Your Sitemap contains too many URLs. Please create multiple Sitemaps with up to 50000 URLs each and submit all Sitemaps.
    Line: 580869”

    I was under the impression that this plugin could make multiple sitemaps but I don’t see the option anywhere, and it’s not doing this automatically. I’d like to be able to divide sitemaps into groups of 10,000 if possible. (even 50,000 would work though it gets really slow)

    • This topic was modified 7 years, 7 months ago by varunchopra.
Viewing 5 replies - 1 through 5 (of 5 total)
  • Plugin Author Rolf Allard van Hagen

    (@ravanh)

    7 years, 7 months ago

    Hi, is this a sitemap for posts or a ‘normal’ custom post type? Then you can go to Settings > XML Sitemap and set the option Split by to Year or Month. However, Pages and other non-chronologically organised post types cannot be split like this…

    Plugin Author Rolf Allard van Hagen

    (@ravanh)

    7 years, 7 months ago

    By the way, it should not be possible for any sitemap to exceed the 50k limit as it is hard-coded to not contain more than that amount of URLs. Are you sure the sitemap is coming from this plugin? Can you share a link?

    Thread Starter varunchopra

    (@varunchopra)

    7 years, 7 months ago

    The sitemap is generated for posts, and it’s coming from the plugin. The sitemap is split by month. Here are some checks:

    96k posts in August:

    
# curl https://www.website.org/sitemap-pt-post-2018-08.xml | grep website.org | wc -l
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 19.9M    0 19.9M    0     0  6401k      0 --:--:--  0:00:03 --:--:-- 6399k
96812

    168k posts in September:

    
~# curl https://www.website.org/sitemap-pt-post-2018-09.xml | grep website.org | wc -l
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 34.8M    0 34.8M    0     0  4329k      0 --:--:--  0:00:08 --:--:-- 4496k
168922

    I’m sorry I can’t share the sitemap with you, either publicly or privately. I hope it’s still possible to reach a solution via this forum.

    If possible, please let me know where the check for 50k is in the code. I don’t know PHP but I guess it doesn’t hurt to take a look.

    • This reply was modified 7 years, 7 months ago by varunchopra.
    Thread Starter varunchopra

    (@varunchopra)

    7 years, 7 months ago

    Oops, you were right. Wrong plugin.

    Plugin Author Rolf Allard van Hagen

    (@ravanh)

    7 years, 7 months ago

    Yep, that looks indeed like the URL of a different sitemap plugin 😉

Viewing 5 replies - 1 through 5 (of 5 total)

The topic ‘Sitemap has errors: Too many URLs’ is closed to new replies.