Exporting Huge 40000 Post Site taking Hours

  • Resolved samuraixx

    (@samuraixx)


    1 year, 2 months ago

    Hi, i have a site that has 40000+ articles and i have been trying to export it, now the issue is that it’s way too slow, i have my pc running for 15+ hours and the status is still like below.

    How can i increase it’s speed. Anything will help, also i dont need the uploads folder to be fetched by the plugin as it’s huge around 100gb, so that will take a lot of time, so do i exclude that? if yes then how do i do that. Please Help, thank you.

    PC Specs – i5-9600k, geforce 3080ti, 2tb nvme, 32gb ram

    Site is hosted on localhost using XAMPP.

    • This topic was modified 1 year, 2 months ago by samuraixx.
Viewing 3 replies - 1 through 3 (of 3 total)
  • Plugin Author patrickposner

    (@patrickposner)

    1 year, 2 months ago

    We don’t do performance debugging here in the support forum, but have you ever compared that to another (SaaS) solution?

    Given the amount of data, I bet there is no other solution (besides CLI-only tools) that can handle that faster – especially with 100GB of media.

    You can use WP-CLI (but that one requires the pro version) to speed up the process, you can also increase the memory limit of your WP installation massively to speed it up.

    However, I would highly encourage not exporting the media files in that scenario – SSH might be a lot better in handling that.

    You can exclude the entire uploads folder in Simply Static -> Settings ->General->Exclude

    Thread Starter samuraixx

    (@samuraixx)

    1 year, 2 months ago

    So for exclude how do i put the url?

    I see it says it needs only a URLs, or parts of a URL?

    Like – https://localhost/site/wp-content/uploads/ ? or something else.

    And does excluding the content folder will lower the generation process significantly.

    • This reply was modified 1 year, 2 months ago by samuraixx.
    Plugin Author patrickposner

    (@patrickposner)

    1 year, 2 months ago

    @samuraixx

    Just use: /wp-content/uploads/

    I can’t make promises about the speed of the generation progress, but again, this is free support, not consulting (which we offer but only for enterprise customers).

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘Exporting Huge 40000 Post Site taking Hours’ is closed to new replies.