• Hi, I’m trying SmartCrawl on a bbpress forum, and I seem to have a couple problems:

    • By default the plugin so not consider the forums, topic, and replies in generating the sitemap, unless I edit a forum
    • If the default sitemap layout is selected it, since the forum structure bring the links to more than 1000, contrary to what the settings say it does not go to split layout
    • When the split layout is chosen the single xml files that are referenced in the main sitemap index cannot be reached

    Is there something I can do to fix the last problem?

    The page I need help with: [log in to see the link]

Viewing 10 replies - 1 through 10 (of 10 total)
  • After upgrading Hummingbird to latest version (without changing the regex for sitemaps exclusion), and cleaning cache the issue number tree seems to have disappeared.

    Plugin Support Adam – WPMU DEV Support

    (@wpmudev-support8)

    Hi @journeyman88

    I hope you’re well today and thank you for letting us know that the 3rd issue is solved now.

    As for other two:

    By default the plugin so not consider the forums, topic, and replies in generating the sitemap, unless I edit a forum

    Since forums, topics and replies are custom posts, they should be normally seen by SmartCrawl. I’ve just tested it on my test site with freshly added bbPress and those links appeared in the Sitemap as expected. I didn’t test it with any caching though so maybe that is actually a culprit here? Have you tried to temporarily disable any caching that you have on site/server and test it then?

    If the default sitemap layout is selected it, since the forum structure bring the links to more than 1000, contrary to what the settings say it does not go to split layout

    I’ve asked our SmartCrawl developers for consultation on this and am awaiting response. I’ll update you here when I get to know more.

    Best regards,
    Adam

    Hi @wpmudev-support8 for issue number 2 there’s an update: after posting an article on the blog, the sitemap generated by smartcrawl lose all info on bbpress structure (which reappears as soon as a reply is posted on the forum).

    As for caching, at wordpress lever there’s only hummingbird (in which I disabled the page cache in the last few days), and at hosting level there is no cache (active or even installed).

    Many thanks for your reply.

    Plugin Support Adam – WPMU DEV Support

    (@wpmudev-support8)

    Hello @journeyman88 and thank you for response!

    So do I correctly understand that what happens is:

    – initially there are bbPress links included
    – then if you add post to the blog those links are lost from sitemap
    – but if you edit or add e.g. reply on forum they are then getting back?

    I’m just trying to clarify the “flow” to be 100% sure that I can correctly replicate that and bring to our developers’ attention 🙂

    As for automatic splitting of the sitemap if no splitting is enabled and there’s more than 1000 links: I just had a talk with one of our SmartCrawl developers. The way it works is that SmartCrawl counts all posts of all types on the site and if there’s more than 1000 it will split the sitemap but that doesn’t necessarily happen right away during the sitemap creation.

    Instead, it’s done using the cron job so there might be a situation when it goes up to 1000 links in sitemap and it stops there, then it looks like it didn’t create additional “split” sitemap(s). But it might take a while because the task is triggered weekly. So, theoretically, it’s possible that those “split” sitemaps might even be added few days later after the sitemap was initially created.

    You could check one thing though: using e.g. WP Crontrol plugin you can look for the “wds_weekly_sitemap_check_hook” cron event and see if and if so when it was executed last time. If it was meant to be run over a week ago but still after the sitemap was initially created – it would mean that this might need further troubleshooting.

    But if it wasn’t yet run (and isn’t overdue yet) after sitemap was initially created you can either “force run” it or just wait until it’s fired up and check if those additional sitemaps did got created then.

    Best regards,
    Adam

    journeyman88

    (@journeyman88)

    Hi @wpmudev-support8 what happens is:

    1. At first sitemap.xml do not show existing bbpress posts (forum, topic, reply)
    2. After a bbpress post is edited or added, smartcrawl add the whole bbpress posts to the sitemap
    3. After a regular wordpress post (article or page) gets added, it gets added to sitemap.xml but the whole bbpress posts get expunged from it

    Best regards,
    Marco

    Plugin Support Kasia – WPMU DEV Support

    (@wpmudev-support2)

    Hello @journeyman88 ,

    Just for testing purposes, can you try adding this define to the wp-config.php file:

    define( 'SMARTCRAWL_SITEMAP_POST_LIMIT', 3000 );

    and see if the issue will be still occurring?

    kind regards,
    Kasia

    Hello @wpmudev-support2 ,
    The issue of non-automatic generation is still occurring; but after the new post of an article seems to keep the forum structure.

    Best regards,
    Marco

    • This reply was modified 1 month, 3 weeks ago by journeyman88.
    Plugin Support Adam – WPMU DEV Support

    (@wpmudev-support8)

    Hello @journeyman88

    Have you checked cron also? As suggested in my previous response:

    You could check one thing though: using e.g. WP Crontrol plugin you can look for the “wds_weekly_sitemap_check_hook” cron event and see if and if so when it was executed last time. If it was meant to be run over a week ago but still after the sitemap was initially created – it would mean that this might need further troubleshooting.

    Could you check that, please, and update us here?

    Best regards,
    Adam

    Hello @wpmudev-support8
    The Crontrol Plugin marks the “wds_weekly_sitemap_check_hook” as executed as of “2019-12-08 14:42:25”; meanwhile the sitemap re-lost forum informations.

    I’ve tried to do one more check:

    1. I “edited” one forum
    2. The sitemap is updated with forum structure
    3. Using Crontrol I’ve forced the execution of the cron job
    4. The sitemap still display the forum structure
    Plugin Support Adam – WPMU DEV Support

    (@wpmudev-support8)

    Hi @journeyman88

    Thanks for response!

    Do I correctly understand that it worked when you “force executed” the cron job but it didn’t (links lost) when cron job was triggered automatically?

    I admit that would be one of the strangest issues but I’m wondering then if it actually completes fine when it’s automatically triggered. Could you enable WP debugging and see if there are any errors showing up in debug.log in both cases

    – upon triggering the cron job manually
    – and when it’s automatically run?

    You can enable debugging by adding following lines to the “wp-config.php” file of your site, right above the “/* That’s all, stop editing */ line:

    define( 'WP_DEBUG', true );
    define( 'WP_DEBUG_DISPLAY', false );
    define( 'WP_DEBUG_LOG', true );

    After testing cron both ways, look into the “/wp-content/debug.log” file and hopefully there’ll be something that would lead us in a right direction.

    Best regards,
    Adam

Viewing 10 replies - 1 through 10 (of 10 total)
  • You must be logged in to reply to this topic.