[pbs-devel] superseded: [PATCH proxmox-backup v2 0/3] reduce GC S3 locking

Fabian Grünbichler f.gruenbichler at proxmox.com
Fri Nov 21 13:39:03 CET 2025


by https://lore.proxmox.com/pbs-devel/20251121123829.701196-1-f.gruenbichler@proxmox.com

On November 21, 2025 11:18 am, Fabian Grünbichler wrote:
> this patch series tries to reduce the number of open locks held by GC,
> in particular in case most objects returned by the S3 backend are
> garbage that need deletion.
> 
> the first patch reduces the number of open locks by at least a factor of
> 10 in the worst case (from up to 1000 to up to 100).
> 
> the second patch just refactors some now common code.
> 
> the third patch tries to reduce the number of delete calls for regular
> GC runs by batching deletes more efficiently, while still periodically
> flushing the deferred deletes.
> 
> Fabian Grünbichler (3):
>   GC: S3: reduce number of open FDs for to-be-deleted objects
>   GC: S3: factor out batch object deletion
>   GC: S3: phase2: do not force delete for every list iteration
> 
>  pbs-datastore/src/datastore.rs | 61 ++++++++++++++++++++++++----------
>  1 file changed, 44 insertions(+), 17 deletions(-)
> 
> -- 
> 2.47.3
> 
> 
> 
> _______________________________________________
> pbs-devel mailing list
> pbs-devel at lists.proxmox.com
> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pbs-devel
> 




More information about the pbs-devel mailing list