Came back to the NSS firmware due to some memory leak issues in 24.0.2, and trying to debug the packet loss issues in my mesh:
192.168.0.20 is the main node connected to my main router, and the other two are satellites.
As you can see the latencies are fine but there's constantly sporadic packet loss.
In the system logs I see the following for 192.168.0.21:
Tue Sep 2 21:47:45 2025 kern.warn kernel: [27108.427330] ath11k c000000.wifi: unknown packet type received in mesh link vdev 722468872
Tue Sep 2 21:48:13 2025 kern.warn kernel: [27136.705478] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 21:53:08 2025 kern.warn kernel: [27431.354495] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 22:14:44 2025 kern.warn kernel: [28727.924761] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 22:17:44 2025 kern.warn kernel: [28907.205595] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 22:18:59 2025 kern.warn kernel: [28982.876946] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
These don't line up exactly with the packet loss events, but I don't see anything else relevant.
In the logs for 192.168.0.22 there's that and another more detailed error:
Tue Sep 2 21:45:48 2025 kern.warn kernel: [27857.935004] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 21:47:01 2025 kern.warn kernel: [27931.242080] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 21:49:39 2025 kern.warn kernel: [28089.016742] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 21:50:24 2025 kern.warn kernel: [28134.502278] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 21:51:13 2025 kern.warn kernel: [28182.939340] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 21:53:39 2025 kern.warn kernel: [28328.927142] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 21:54:44 2025 kern.warn kernel: [28394.605028] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 21:54:52 2025 kern.warn kernel: [28401.934152] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 21:55:23 2025 kern.warn kernel: [28433.372118] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 21:55:38 2025 kern.warn kernel: [28448.621881] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 21:58:32 2025 kern.warn kernel: [28622.612825] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 21:59:09 2025 kern.warn kernel: [28658.960171] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 22:01:45 2025 kern.warn kernel: [28814.908159] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 22:03:11 2025 kern.warn kernel: [28900.947429] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 22:05:35 2025 kern.warn kernel: [29044.916632] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 22:07:09 2025 kern.warn kernel: [29139.051324] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.556989] ------------[ cut here ]------------
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.557028] WARNING: CPU: 1 PID: 0 at backports-6.16/net/mac80211/rx.c:5383 ieee80211_rx_list+0x518/0xa88 [mac80211]
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.560687] Modules linked in: ecm(O) xt_connlimit nf_conncount ath11k_ahb(O) ath11k(O) xt_state xt_helper xt_conntrack xt_connmark xt_connbytes xt_DSCP xt_CT wireguard nft_redir nft_nat nft_masq nft_flow_offload nft_fib_inet nft_ct nft_chain_nat nf_nat nf_flow_table_inet nf_flow_table nf_conntrack_bridge nf_conntrack mac80211(O) libchacha20poly1305 ipt_REJECT chacha_neon cfg80211(O) xt_time xt_tcpudp xt_tcpmss xt_statistic xt_recent xt_multiport xt_mark xt_mac xt_limit xt_length xt_hl xt_ecn xt_dscp xt_comment xt_TCPMSS xt_LOG xt_HL xt_CLASSIFY sch_cake rfcomm qrtr_smd qrtr qmi_helpers(O) ppp_async poly1305_neon nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_quota nft_numgen nft_meta_bridge nft_log nft_limit nft_hash nft_fib_ipv6 nft_fib_ipv4 nft_fib nft_compat nf_tables nf_reject_ipv4 nf_log_syslog nf_defrag_ipv4 libcurve25519_generic libcrc32c libchacha l2tp_ppp iptable_mangle iptable_filter ipt_ECN ip_tables hidp hci_uart crc_ccitt compat(O) bnep bluetooth sch_tbf sch_ingress
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.560951] sch_htb sch_hfsc em_u32 cls_u32 cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact hid qca_nss_tunipip6(O) qca_nss_tun6rd(O) evdev input_core qca_nss_wifi_meshmgr(O) qca_nss_pptp(O) pptp qca_nss_pppoe(O) pppoe pppox ppp_generic slhc qca_nss_map_t(O) qca_nss_lag_mgr(O) qca_nss_gre(O) qca_nss_bridge_mgr(O) qca_nss_vlan(O) xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ipmac ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set nfnetlink ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 qca_mcs(O) bonding tls ip6_gre ip_gre gre ifb nat46(O) nf_defrag_ipv6 sit qca_nss_drv(O) l2tp_netlink l2tp_core udp_tunnel ip6_udp_tunnel ip6_tunnel tunnel6 tunnel4 ip_tunnel tun ecdh_generic ecc sha512_generic sha512_arm64 sha2_ce sha256_arm64 sha1_ce seqiv
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.638857] sha3_generic jitterentropy_rng drbg michael_mic kpp hmac geniv cmac leds_pca963x leds_gpio xhci_plat_hcd xhci_pci xhci_hcd dwc3 dwc3_qcom qca_nss_dp(O) qca_ssdk(O) gpio_button_hotplug(O) ext4 mbcache jbd2 aquantia crc_itu_t crc32c_generic
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.750210] CPU: 1 UID: 0 PID: 0 Comm: swapper/1 Tainted: G O 6.12.44 #0
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.772403] Tainted: [O]=OOT_MODULE
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.780725] Hardware name: Linksys MX4200v1 (DT)
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.783941] pstate: 80400005 (Nzcv daif +PAN -UAO -TCO -DIT -SSBS BTYPE=--)
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.788804] pc : ieee80211_rx_list+0x518/0xa88 [mac80211]
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.795485] lr : ieee80211_rx_napi+0x48/0xd8 [mac80211]
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.801040] sp : ffffffc08000bb10
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.806072] x29: ffffffc08000bb10 x28: ffffffc079122de0 x27: ffffff8005a42080
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.809551] x26: ffffff80059efe00 x25: ffffff80096ee000 x24: ffffffc079123ee8
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.816670] x23: ffffff80059efe00 x22: ffffffc08000bc30 x21: ffffff8017550a90
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.823787] x20: ffffff80059efe28 x19: ffffff8009d208c0 x18: 00001a95fa8293e1
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.830906] x17: ffffffbf9f2bd000 x16: ffffffc080008000 x15: ffffffc0904abc60
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.838024] x14: ffffff801519dc78 x13: 0000000000000310 x12: 0000000000000000
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.845143] x11: 00000000000000c0 x10: 0000000000000000 x9 : 00000000000000c0
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.852260] x8 : ffffff801feb33c0 x7 : 0000000000000000 x6 : 00000000d373713c
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.859378] x5 : 0000000000000000 x4 : 0000000000000000 x3 : ffffffc08000bc30
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.866496] x2 : 0000000000000101 x1 : 0000000000000000 x0 : ffffff8009d203c0
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.873615] Call trace:
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.880723] ieee80211_rx_list+0x518/0xa88 [mac80211]
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.882985] ieee80211_rx_napi+0x48/0xd8 [mac80211]
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.888193] ath11k_dp_tx_htt_monitor_mode_ring_config+0x2128/0x3ed0 [ath11k]
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.892885] ath11k_dp_rx_from_nss+0x7c/0x90 [ath11k]
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.900172] ath11k_coredump_collect+0x550/0x2b50 [ath11k]
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.905207] nss_core_send_buffer+0x19d0/0x212c [qca_nss_drv]
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.910590] nss_core_handle_napi_queue+0x30/0x80 [qca_nss_drv]
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.916406] __napi_poll+0x38/0x180
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.922131] net_rx_action+0x168/0x320
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.925605] handle_softirqs+0xf4/0x224
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.929423] __do_softirq+0x14/0x20
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.933156] ____do_softirq+0x10/0x20
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.936627] call_on_irq_stack+0x30/0x78
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.940449] do_softirq_own_stack+0x1c/0x40
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.944441] irq_exit_rcu+0x88/0xc0
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.948345] el1_interrupt+0x38/0x68
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.951819] el1h_64_irq_handler+0x18/0x24
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.955640] el1h_64_irq+0x68/0x6c
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.959544] default_idle_call+0x28/0x58
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.962930] do_idle+0x1c4/0x1e4
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.967010] cpu_startup_entry+0x38/0x3c
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.970222] arch_register_cpu+0x0/0x5c
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.974129] __secondary_switched+0xb8/0xbc
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.977690] ---[ end trace 0000000000000000 ]---
Tue Sep 2 22:11:01 2025 kern.warn kernel: [29371.622359] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 22:11:13 2025 kern.warn kernel: [29383.101011] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 22:13:30 2025 kern.warn kernel: [29519.909274] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 22:15:06 2025 kern.warn kernel: [29615.948062] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 22:16:12 2025 kern.warn kernel: [29681.943155] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 22:17:10 2025 kern.warn kernel: [29739.816455] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
Tue Sep 2 22:19:28 2025 kern.warn kernel: [29877.814108] ath11k c000000.wifi: unknown packet type received in mesh link vdev 1057137716
These lines seem to point towards the NSS driver:
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.892885] ath11k_dp_rx_from_nss+0x7c/0x90 [ath11k]
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.900172] ath11k_coredump_collect+0x550/0x2b50 [ath11k]
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.905207] nss_core_send_buffer+0x19d0/0x212c [qca_nss_drv]
Tue Sep 2 22:08:42 2025 kern.warn kernel: [29231.910590] nss_core_handle_napi_queue+0x30/0x80 [qca_nss_drv]