[pbs-devel] Chunk verification speedup discussion, similar speedup opportunities elsewhere

[Adam Kalisz]

Hi,

is there any progress with the chunk verification speedup with the
adjustment as suggested by Thomas?

On Fri, 2025-07-25 at 17:03 +0200, Thomas Lamprecht wrote:
> Am 25.07.25 um 13:24 schrieb Adam Kalisz:
> > I missed whether the chunk verification speedup when loading chunks
> > got applied or whether it was somehow included in the S3-like
> > storage option change set.
> 
> btw. had a quick talk with Dominik about this topic, while having the
> possibility for this would be nice, server side parallelism is a
> different thing than client-side, as being able to starve the rest of
> the system of all available IO is much easier possible in the server-
> side case, as there is currently no knob to enforce some kind of
> pacing or maximum bandwidth like the bandwidth limits that client can
> be enforced too.
> 
> So the mentioned series should IMO only be applied if it can be opted
> out, or, better in the long term, a pacing/IO bandwidth limit can be
> enforced. That is naturally a big amount of work, mostly in
> evaluating different options and deciding for what can make sense,
> that's why I mentioned that being able to opt-out could be enough,
> then admins could at least keep the status quo.

Thanks

Adam