Request for smaller batch sizes, query optimization

Hello @wysija folks,

I am running into response timeout issues during the import process and have some thoughts that I hope you would consider in future development and testing.

I am working with a userbase of 130,000+, a decent percentage of them already subscribers. As we migrate to MailPoet from a hosted mailing provider, I think some of aspects of the import don’t scale as expected.

Specifically, the bulk update/insert of custom field records requires increasing amounts of time. I’m guessing that this is due to the rebuild of the subscriber_id_custom_field_id index. Is there a way to defer the rebuild as part of a bulk operation?

The result is a server timeout as Apache disconnects from FPM. I have the ability to modify these timeouts but I expect that not all of your customers do.