The builds I've been running I've tweaked to use WLAN.HK.2.9.0.1-01385-QCAHKSWPL_SILICONZ-1 as I've found similar issues to you and was hoping that it might get resolved upstream.
There's two ways to try this, you can build the latest commit but replace package/firmware/ath11k-firmware/Makefile with this previous version:
Or you should be able to download the files from https://github.com/quic/upstream-wifi-fw/tree/main/ath11k-firmware/IPQ8074/hw2.0/testing/2.9.0.1/WLAN.HK.2.9.0.1-01385-QCAHKSWPL_SILICONZ-1 and replace the ones on your current device and reboot.
Anything later than 01385 seems to cause issues for me. I'm not sure if this discussion is related to the same thing: Xiaomi AX3600: ath11k firmware crash - qcom-q6v5-wcss-pil cd00000.q6v5_wcss: fatal error received: