Fairly static site but 6,000+ products, how does batching work?

  • Resolved jaewp

    (@jaewp)


    8 months, 3 weeks ago

    I’m working on someone else’s site (who’ve asked for privacy) and I’m not used to the interface for this plugin.

    I get that batches are minimized to keep them from failing but I don’t quite understand how the batches (default size or set) get process so that the feed eventually includes ALL products.

    This particular feed doesn’t need regular refreshing so I’ve set that to no refresh. Daily would be overkill.

    I’m fooling with the batch size and can get close to 2,000 products but after that do I just keep hitting the feed processing button? Currently 2,000 is the limit initially.

    Sorry if it is a dumb question but no total products in feed shown anywhere so I don’t want to resubmit if the feed is the same and only the first and second processing seem to add products.

    Update: Trying hitting that multiple times actually reduced the total number of products. Sorry but this is different than any other platform feed I’ve used which usually just pulls all products. Thanks for any help to get these 6k products loaded to Google.

    • This topic was modified 8 months, 3 weeks ago by jaewp.
    • This topic was modified 8 months, 3 weeks ago by jaewp.
Viewing 11 replies - 1 through 11 (of 11 total)
  • Plugin Author Josh Kohlbach

    (@jkohlbach)

    8 months, 3 weeks ago

    Hi @jaewp definitely not a dumb question 😉

    The feeds are refreshed via a repeating Action Scheduler job, it is pretty efficient now as we’ve made a lot of changes recently to how jobs are processed. I’d still suggest keeping it on daily.

    But if you are playing it safe you could set to No Refresh and just manually refresh it when you know there are changes. It will still use the Action Scheduler in the background even on manual refreshes.

    Hope this helps! Let me know if you have follow up questions.

    Thread Starter jaewp

    (@jaewp)

    8 months, 3 weeks ago

    Thanks but I simply can’t get it to list all the products.

    We’re not dealing with changes per. se., just trying to produce the initial feed and the most I can get is around 2,000. In fact the number often drops on refresh. It’s bizarre.

    Appreciate the super quick help.

    P.S. the most I’ve been able to do (multiple times) is actually 1992 despite the settings for 1999.

    • This reply was modified 8 months, 3 weeks ago by jaewp.
    Plugin Author Josh Kohlbach

    (@jkohlbach)

    8 months, 3 weeks ago

    Ah I see, thanks for clarifying.

    Is it possible you have some rules or filters set up that could be dropping those other products?

    Would love if you’re able to share your debug info.

    Thread Starter jaewp

    (@jaewp)

    8 months, 3 weeks ago

    My hands are a bit tied. I could SNIP the url and site identifier but even the product categories should probably be removed per my agreement. Are there sections that might be useful that are not directly related? Sorry it’s so difficult to help in this instance.

    You can certainly see my attempts but I’ve elaborated on those:

    [history_products] => Array ( [22] => Array ( [19 Feb 2025 00:41:45] => 746 ) [23] => Array ( [19 Feb 2025 00:52:00] => 1992 ) [24] => Array ( [19 Feb 2025 00:54:34] => 1992 ) [25] => Array ( [19 Feb 2025 00:58:05] => 1992 ) [26] => Array ( [19 Feb 2025 01:03:02] => 746 ) [27] => Array ( [19 Feb 2025 01:04:01] => 746 ) [28] => Array ( [19 Feb 2025 01:05:47] => 746 ) [29] => Array ( [19 Feb 2025 01:16:59] => 1992 ) [30] => Array ( [19 Feb 2025 01:18:28] => 1992 ) [31] => Array ( [19 Feb 2025 01:18:28] => 1992 )

    Plugin Author Josh Kohlbach

    (@jkohlbach)

    8 months, 3 weeks ago

    No worries, totally understand your need to keep some details private.

    I mainly need to see mappings, rules, filters for the feed in question. Plus the counts for the single, variable and total products. Ideally if you’re able to share the PHP, WP, Woo and Product Feed Pro version numbers too. None of this should be identifiable but feel free to trim out whatever you need to.

    Thread Starter jaewp

    (@jaewp)

    8 months, 3 weeks ago

    Thanks for sticking with me, I’m used to issue but with a feed this is a first time!

    No rules or filters

    Single products – 5737, variation products 126, total products 5863

    WordPress 6.72, Woo 9.62, PFP 13.4.1.3

    PHP 8.2.26

    I think that caught it all. I really just updated everything prior to this.

    • This reply was modified 8 months, 3 weeks ago by jaewp.
    Plugin Support Tanjir Al Mamun

    (@tanjiralmamun)

    8 months, 3 weeks ago

    Hi @jaewp,

    Could you please share your Feed System Report? You can find this report under Product Feed Pro > Settings > Plugin System Check screen. Click on the “Copy to Clipboard” button and share the details with support[at]adtribes.io

    Thanks!

    Thread Starter jaewp

    (@jaewp)

    8 months, 3 weeks ago

    Thanks for jumping in,! as I mentioned my agreement is to keep things pretty tight and that includes the site and even the categories so mostly I’ve provided what I’m able to. See previous post noting the multiple manual refreshes I performed. Sorry my hands are a bit tied but I have to believe the level of detail lost is not really applicable to the issue.

    Plugin Support Tanjir Al Mamun

    (@tanjiralmamun)

    8 months, 3 weeks ago

    Hi @jaewp,

    Kindly let me know if you’ve tried creating a test feed, just with default field mapping, no filters, and no rules.

    Thanks!

    Thread Starter jaewp

    (@jaewp)

    8 months, 3 weeks ago

    I will give that a try..maybe tomorrow though 😃, one of those long days (you know I’m sure).

    Thread Starter jaewp

    (@jaewp)

    8 months, 3 weeks ago

    Lol, not sleeping yet.

    Thanks Tanjir Al Mamun for the thought.

    I didn’t change mapping but switched a couple of the general initial settings, that seemed reasonable at the time, and it looks like I’m getting a whole feed first try.

    Now let’s see what Google says!

    Thanks everyone for reading and obviously Josh and Tanjir for walking with me.

    Let me know if anyone reading needs elaboration but basically just copy the first screen of any default feed you create without change.

    ZZZZzzzzzzz

    • This reply was modified 8 months, 3 weeks ago by jaewp.
    • This reply was modified 8 months, 3 weeks ago by jaewp.
Viewing 11 replies - 1 through 11 (of 11 total)

The topic ‘Fairly static site but 6,000+ products, how does batching work?’ is closed to new replies.