Sudden Error with Google Storage

Resolved nolfnolf
(@nolfnolf)

1 year, 1 month ago

Hello,

I’ve been backing up to Google Storage (using the S3 Service) since 2021.
Suddently, since about 1 week ago, it always errors out.

However, in Google Storage the file seems to have been transfered.
Here’s the error log from BackWPup.

Is it something on my end or is it a known recent bug?

[19-Dec-2023 05:53:12] 1. Trying to send backup file to S3 Service …
[19-Dec-2023 05:53:12] Connected to S3 Bucket “##REDACTED##” in EUROPE-WEST1
[19-Dec-2023 05:53:12] Checking for not aborted multipart Uploads …
[19-Dec-2023 05:53:12] Starting upload to S3 Service …
[19-Dec-2023 06:01:45] ERROR: Cannot transfer backup to S3! (0)
[19-Dec-2023 06:01:46] One file deleted on S3 Bucket.
[19-Dec-2023 06:01:46] One old log deleted
[19-Dec-2023 06:01:46] ERROR: Job has ended with errors in 10874 seconds. You must resolve the errors for correct execution.

Viewing 8 replies - 1 through 8 (of 8 total)

Plugin Support happyAnt
(@duongcuong96)

1 year ago

Hi @nolfnolf

Sorry about the delayed response, do you still get the issue? did you try with a small backup job like just a database first to see if it is successful?

Also if possible, maybe you can switch to another S3 location or generate a new S3 bucket key again.

Also here is the minimum S3 permission needed for BWU you can take a look:

https://gist.github.com/ajbrown/8aea5189d8e84046a4f2
Thread Starter nolfnolf
(@nolfnolf)

1 year ago
Hey,

Thanks for your reply. Yes, it still errors out, but as I’ve said, the file is actually transfered, despite the error.
Thing is, it worked for years flawlessly and I did no changes recently.

I can’t remember what documentation I’ve followed for the Google / S3 integration, and can’t seem to find one on BackWpUp website.

Is there a tutorial for S3 / Google Cloud I can follow, so I can redo the settings?

Thanks
- This reply was modified 1 year ago by nolfnolf.
Plugin Support happyAnt
(@duongcuong96)

1 year ago

Hi @nolfnolf

You can check this guide ^^

https://wpjohnny.com/how-to-backup-your-wordpress-site-using-backwpup-plugin-and-amazon-aws-s3

Thread Starter nolfnolf
(@nolfnolf)

1 year ago

I think I know what the problem is.
My backup is now above 5GB in size.
I see others had this problem in the future, even 2 years ago.

Can this please be fixed?

https://wordpress.org/support/topic/error-cannot-transfer-backup-to-s3-0-again/

https://wordpress.org/support/topic/error-s3-large-backups

https://wordpress.org/support/topic/backup-archive-larger-than-5gb-cannot-be-uploaded-to-s3-service/

Please help.

Thread Starter nolfnolf
(@nolfnolf)

1 year ago

Ok, with the help of a friend I’ve figured it out.

In \backwpup\inc\class-destination-s3.php
There’s this line: $part_data = fread($file_handle, 1048576 * 5); //5MB Minimum part size

This seems to limit the upload to 5GB. I’ve replaced 5 with 10 and it seems to work now.
Why is this limit? AWS/Google doesn’t force it, so why does BackWpUp do it?

Plugin Support happyAnt
(@duongcuong96)

11 months, 4 weeks ago

@nolfnolf

Thank you for the suggestion, increasing the fread to read 10 or 20mb each time might not cause any side effects for BWU, so maybe we will add this to the next update!

Thread Starter nolfnolf
(@nolfnolf)

11 months, 4 weeks ago

Thanks! I think it’s mandatory to add it, otherwise nobody is able to upload more than 5GB to S3, using BackWpUp.
Why is the limit there tho? If it doesn’t cause side effects, simply remove it or increase it further (we have websites with ~20gb in backup size).

Thank you again.

Thread Starter nolfnolf
(@nolfnolf)

10 months, 3 weeks ago

A new update and this super easy fix (which seems to affect enough people) still hasn’t been added.
Any reason why? 🙂

Viewing 8 replies - 1 through 8 (of 8 total)

The topic ‘Sudden Error with Google Storage’ is closed to new replies.