Restoring points only partially uploaded to external storage, OOM error

[danepowell]

I've defined a Backblaze B2 bucket (using the Nextcloud Amazon S3 driver) as my only restoring point location.

I've created two full restoring points in the last week. Both were packed and stored locally and the local packs seem fine as far as I can tell. Each is about 35 GB, same as my data directory.

The problem is that these aren't fully uploaded to Backblaze. After two full backups, my Backlaze B2 bucket only contains 500 MB of data, about 400 MB from the first backup and 100 MB from the second.

I see one error in the logs that probably corresponds to the packing operation:

Allowed memory size of 536870912 bytes exhausted (tried to allocate 104865952 bytes) at /var/www/html/lib/private/Files/Storage/Local.php#294

I tried increasing the memory limit to 1 GB, still getting a different error:

Allowed memory size of 1073741824 bytes exhausted (tried to allocate 139810640 bytes) at /var/www/html/custom_apps/backup/lib/Service/ExternalFolderService.php#262

1000 MB should be more than enough for any performant application. It's also problematic that the Backup dashboard reports the backup health as green.

[danepowell]

Seems there are a number of other issues already about this, I'll consolidate discussion in #308