Ok, enabling those two config lines helped to smoothen things out.
There is not much difference compared to the "849ea62" in 23.05
master with the new patch + 2 config lines:
ondemand:
performance:
Still, the "perfomance" governor provides much smoother throughput and lower latency.