[pbs-devel] [PATCH proxmox{, -backup} v4 00/48] fix #2943: S3 storage backend for datastores

[Christian Ebner]

Some further, real-world testing using a Cloudflare R2 object store as 
backend for the datastore reveals that request rate limiting can still 
be an issue. These were not an issue with locally hosted object stores, 
e.g. via Ceph RADOS gateway.

While the Cloudflare documentation specifies limits for some bucket 
management operations [0], these should not apply to object write 
operations. However, in my test case requests are returning with an 502 
bad gateway response, reduced in occurrence if the upload to the PBS is 
limited via e.g. traffic control rate limits.

Will look into how to best implement request limits in the s3 client 
itself, ideally with a mechanism to dynamically adapt the rate in case 
of such object upload errors, including a retry logic.

[0] https://developers.cloudflare.com/r2/platform/limits/