Sounds like it needs more PHP memory to finish processing 4k+ tags. Do you know what the PHP memory limit on your hosting is?
Try increasing it by adding this to your wp-config.php :
define( 'WP_MEMORY_LIMIT', '64M' );
Use a higher value like 96M or 128M if it’s not enough, but it’s not wise to go crazy high…
By the way, are you sure you want to feed all those taxonomy archive pages to Google? The real content is on the post pages themselves, no?
I agree. I could see duplicate content and so I have removed it. Now, Google can see I have 7k+ images but it has indexed only six of them on this sitemap. Any solutions to that. Thank you for your help so far.
Sadly, there is no way to force Google to index images — maybe that’s a good thing 😉
But I do notice you are using Jetpack with Photon module activated. This causes images to be hosted on another domain (iN.wp.com) which might be the cause that Google refuses indexing the images.
According to https://support.google.com/webmasters/answer/178636 images may be hosted from another domain but that domain must be verified, which you cannot do with a wp.com domain… I’ll be working on a way to force the image URL in the sitemaps to take the site’s own domain instead of letting Photon take control.
But this is still no guarantee because in your posts, the wp.com domains are still used. Google may interpret them as different images, and conclude the images in the sitemap are not in the actual posts, causing the spider to ignore them again.
Since you seem to be using CloudFlare, wouldn’t it be logical to use that (instead of Photon) for images too?
New issue out of the blue. My post sitemaps have 404 error now 🙁
Yes, I noticed that Cloudflare was showing their 404 page… Anything related it your error logs?
None, I could spot. Any other ways to check the logs? Developer is away for a while.
I still have the feeling it’s something with the Permalink settings. Maybe in combination with (some setting in) Yoast SEO?
I remember Yoast SEO used to have an option to remove the /category/ prefix from category archives but that that sometimes caused very weird redirections and other unpredictable effects.
It feels the same here…
Still, it would be good to make sure it’s not simply a PHP error so if you do not have access to your server/hosting log files right now, you could try this:
1. Add these lines to your wp-config.php
define( 'WP_DEBUG', true );
define( 'WP_DEBUG_DISPLAY', false );
define( 'WP_DEBUG_LOG', true );
2. Then visit your sitemap index and try a few of the sitemaps.
Note that you might need to disable CloudFlare during this for reliable results otherwise you might be requesting cached versions, not hitting the actual WordPress site.
If there occurred any errors, they will now be written to a file called debug.log in your /wp-content/ directory. Open that file with a simple text editor to read the errors.
Afterwards, don’t forget to remove the lines from your wp-config.php again.
I have no clue what has happened, but the sitemap is working absolutely fine at the moment. :/
And now (I just checked one posts sitemap) it’s not any more… Did you change something since your last response 11 hours ago?
I thought that because I deleted the Breadcrumbs plugin. But it seems to be appearing again. I have no clue what has happened. This thing has happened once again.
Did you revisit your Settings > Permalinks admin page yet? Might just fix it…
