Had the same problem with qosmios build with my AX3600. Switched to AgustinLorenzos but ditched my original config and started from scratch. Works like a charm now.

Are building off the latest commit?

It was due to a mix up with the device deletion during whenever the instance was stopped/restarted.

Yea the latest one fixes it, thanks.

hi buddy,I tried removing this patch 188-ath11k-m3-ssr-dump-collection.patch,fail to boot.This is logs:


[   10.077523] Backport generated by backports.git 193becf2
[   10.090970] l2tp_ppp: PPPoL2TP kernel driver, V2.0
[   10.131763] NET: Registered PF_QIPCRTR protocol family
[   10.147759] xt_time: kernel timezone is -0000
[   10.185835] nss_cryptoapi_attach_user[2236]:ffffffc000de5100: AEAD registration failed(authenc(hmac(sha1),cbc(aes)))
[   10.185893] nss_cryptoapi_attach_user[2236]:ffffffc000de5100: AEAD registration failed(authenc(hmac(sha256),cbc(aes)))
[   10.195472] nss_cryptoapi_attach_user[2236]:ffffffc000de5100: AEAD registration failed(authenc(hmac(sha384),cbc(aes)))
[   10.196133] ath11k c000000.wifi: ipq6018 hw1.0
[   10.205954] nss_cryptoapi_attach_user[2236]:ffffffc000de5100: AEAD registration failed(authenc(hmac(sha512),cbc(aes)))
[   10.216640] ath11k c000000.wifi: FW memory mode: 0
[   10.221067] nss_cryptoapi_attach_user[2236]:ffffffc000de5100: AEAD registration failed(authenc(hmac(sha1),cbc(des3_ede)))
[   10.232044] remoteproc remoteproc0: powering up cd00000.remoteproc
[   10.236559] nss_cryptoapi_attach_user[2236]:ffffffc000de5100: AEAD registration failed(authenc(hmac(sha256),cbc(des3_ede)))
[   10.248028] remoteproc remoteproc0: Booting fw image IPQ6018/q6_fw.mdt, size 7340
[   10.253781] nss_cryptoapi_attach_user[2236]:ffffffc000de5100: AEAD registration failed(seqiv(rfc4106(gcm(aes))))
[   11.378614] remoteproc remoteproc0: remote processor cd00000.remoteproc is now up
[   11.379912] ath11k c000000.wifi: qmi ignore invalid mem req type 3
[   11.380381] kmodloader: done loading kernel modules from /etc/modules.d/*
[   11.385668] ath11k c000000.wifi: chip_id 0x0 chip_family 0x4 board_id 0xff soc_id 0xffffffff
[   11.398134] ath11k c000000.wifi: fw_version 0x240286d2 fw_build_timestamp 2021-05-05 02:32 fw_build_id WLAN.HK.2.4.0.1-01746-QCAHKSWPL_SILICONZ-1
[   11.537442] Unable to handle kernel read from unreadable memory at virtual address 0000000000000000
[   11.537488] Mem abort info:
[   11.545304]   ESR = 0x0000000096000005
[   11.548077]   EC = 0x25: DABT (current EL), IL = 32 bits
[   11.551900]   SET = 0, FnV = 0
[   11.557363]   EA = 0, S1PTW = 0
[   11.560227]   FSC = 0x05: level 1 translation fault
[   11.563269] Data abort info:
[   11.568128]   ISV = 0, ISS = 0x00000005
[   11.571254]   CM = 0, WnR = 0
[   11.574811] user pgtable: 4k pages, 39-bit VAs, pgdp=00000000474c2000
[   11.577944] [0000000000000000] pgd=0000000000000000, p4d=0000000000000000, pud=0000000000000000
[   11.584372] Internal error: Oops: 0000000096000005 [#1] PREEMPT SMP
[   11.592869] Modules linked in: ath11k_ahb ath11k nft_fib_inet nf_flow_table_inet mac80211 ipt_REJECT cfg80211 xt_time xt_tcpudp xt_state xt_nat xt_multiport xt_mark xt_mac xt_limit xt_conntrack xt_comment xt_TPROXY xt_TCPMSS xt_REDIRECT xt_MASQUERADE xt_LOG qrtr_tun qrtr_smd qrtr_mhi qrtr qmi_helpers ppp_async nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject nft_redir nft_quota nft_objref nft_numgen nft_nat nft_masq nft_log nft_limit nft_hash nft_fullcone nft_flow_offload nft_fib_ipv6 nft_fib_ipv4 nft_fib nft_ct nft_compat nft_chain_nat nf_tproxy_ipv6 nf_tproxy_ipv4 nf_tables nf_reject_ipv4 nf_log_syslog nf_flow_table nf_conntrack_netlink mhi libcrc32c l2tp_ppp iptable_nat iptable_mangle iptable_filter ip_tables crc_ccitt compat sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact qca_nss_tunipip6 qca_nss_tun6rd pwm_fan hwmon qca_nss_cfi_cryptoapi qca_nss_crypto qca_nss_qdisc qca_nss_wifi_meshmgr
[   11.593137]  qca_nss_vxlanmgr qca_nss_pptp pptp qca_nss_pppoe pppoe pppox qca_nss_map_t qca_nss_lag_mgr qca_nss_l2tpv2 ppp_generic slhc qca_nss_gre qca_nss_bridge_mgr qca_nss_vlan xt_FULLCONENAT xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ipmac ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set nfnetlink ip6table_nat nf_nat nf_conntrack nf_defrag_ipv4 ip6t_NPT ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 qca_mcs bonding ip6_gre ip_gre gre ifb nat46 nf_defrag_ipv6 sit qca_nss_drv ip6_tunnel tunnel6 tunnel4 tun ntfs autofs4 nls_utf8 nls_iso8859_1 nls_cp437 vxlan seqiv michael_mic usb_storage leds_gpio xhci_plat_hcd xhci_pci xhci_hcd dwc3 dwc3_qcom fsl_mph_dr_of ehci_platform ehci_fsl ehci_hcd qca_nss_dp qca_ssdk gpio_button_hotplug vfat fat ext4
[   11.664290]  mbcache jbd2 exfat crc32c_generic
[   11.773769] CPU: 2 PID: 52 Comm: kworker/u8:2 Not tainted 6.1.79 #0
[   11.778112] Hardware name: GL Technologies, Inc. AXT1800 (DT)
[   11.784277] Workqueue: ath11k_qmi_driver_event ath11k_qmi_deinit_service [ath11k]
[   11.790181] pstate: 40400005 (nZcv daif +PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[   11.797643] pc : ath11k_dbring_buf_cleanup+0xcfc/0x1230 [ath11k]
[   11.804414] lr : ath11k_wmi_cmd_init+0x64/0x570 [ath11k]
[   11.810662] sp : ffffffc008fc3b40
[   11.815952] x29: ffffffc008fc3b40 x28: dead000000000100 x27: dead000000000122
[   11.819173] x26: ffffff8007300000 x25: ffffff8007300168 x24: ffffff8007310000
[   11.826290] x23: ffffff8007300018 x22: ffffff80073010a0 x21: ffffff800730bf60
[   11.833409] x20: ffffff8007300000 x19: ffffff8007300000 x18: 0000000000005cf8
[   11.840526] x17: 00000000000014b8 x16: 00000000000014a0 x15: 0000000000005f00
[   11.847645] x14: 0000000000001480 x13: 0000000000000001 x12: 0000000000000000
[   11.854763] x11: 0000000000000002 x10: 0000000000000000 x9 : 0000000000000000
[   11.861880] x8 : ffffffc008fc3cd0 x7 : 0000000000000000 x6 : 000000000000003f
[   11.868998] x5 : 0000000000000000 x4 : 0000000000000002 x3 : ffffff8007310000
[   11.876116] x2 : 0000000000000000 x1 : ffffffc008fc3bc4 x0 : ffffff8007300000
[   11.883235] Call trace:
[   11.890345]  ath11k_dbring_buf_cleanup+0xcfc/0x1230 [ath11k]
[   11.892607]  ath11k_core_qmi_firmware_ready+0x190/0x5b0 [ath11k]
[   11.898510]  ath11k_qmi_deinit_service+0x11c4/0x192c [ath11k]
[   11.904500]  process_one_work+0x1f0/0x360
[   11.910139]  worker_thread+0x70/0x430
[   11.914131]  kthread+0x108/0x114
[   11.917775]  ret_from_fork+0x10/0x20
[   11.921079] Code: b9509804 d503233f f9616865 d37df042 (b86268a2)
[   11.924640] ---[ end trace 0000000000000000 ]---
[   11.930627] Kernel panic - not syncing: Oops: Fatal exception
[   11.935317] SMP: stopping secondary CPUs
[   11.940959] Kernel Offset: disabled
[   11.944946] CPU features: 0x00000,00010000,0000400b
[   11.948161] Memory Limit: none
[   12.553060] Rebooting in 1 seconds..

When I use basic NSS wifi offloading,also fail to boot,This is log:

[    9.861208]
[    9.866723] ffffffc000b50d40: NSS core 0 DDR from 40000000 to 41000000
[    9.877197] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver
[    9.882067] nat46: module (version 1182f30785e4274913f01a8c3d7e1b5437ae3819) loaded.
[    9.885327] gre: GRE over IPv4 demultiplexor driver
[    9.891295] ip_gre: GRE over IPv4 tunneling driver
[    9.898882] ip6_gre: GRE over IPv6 tunneling driver
[    9.900112] ffffffc000b50d40: nss core 0 booted successfully
[    9.907395] QCA multicast snooping installed successfully
[    9.952513] xt_FULLCONENAT: RFC3489 Full Cone NAT module
[    9.952513] xt_FULLCONENAT: Copyright (C) 2018 Chion Tang <tech@chionlab.moe>
[    9.954971] nss_vlan_mgr_init_module[1926]:Module (Build Build Id: 02/29/24, 14:14:06) loaded
[    9.971840] PPP generic driver version 2.4.2
[    9.984434] NET: Registered PF_PPPOX protocol family
[    9.988434] PPTP driver version 0.8.5
[    9.998524] nss_wifi_meshmgr_init_module[1997]:Module Build Id: 02/29/24, 14:14:12 loaded
[   10.005359] <NSS-CRYPTO>:module loaded Build_ID - 02/29/24, 14:13:45 SoC=ipq60xx
[   10.018938] GACT probability on
[   10.020009] Mirror/redirect action on
[   10.027575] u32 classifier
[   10.027633]     input device check on
[   10.029207]     Actions configured
[   10.051057] Loading modules backported from Linux version v6.6.15-0-g51f354b815c4
[   10.051103] Backport generated by backports.git 193becf2
[   10.064293] l2tp_ppp: PPPoL2TP kernel driver, V2.0
[   10.107026] NET: Registered PF_QIPCRTR protocol family
[   10.125335] xt_time: kernel timezone is -0000
[   10.158376] nss_cryptoapi_attach_user[2236]:ffffffc000de8100: AEAD registration failed(authenc(hmac(sha1),cbc(aes)))
[   10.158432] nss_cryptoapi_attach_user[2236]:ffffffc000de8100: AEAD registration failed(authenc(hmac(sha256),cbc(aes)))
[   10.168054] nss_cryptoapi_attach_user[2236]:ffffffc000de8100: AEAD registration failed(authenc(hmac(sha384),cbc(aes)))
[   10.178643] nss_cryptoapi_attach_user[2236]:ffffffc000de8100: AEAD registration failed(authenc(hmac(sha512),cbc(aes)))
[   10.179188] ath11k c000000.wifi: ipq6018 hw1.0
[   10.189174] nss_cryptoapi_attach_user[2236]:ffffffc000de8100: AEAD registration failed(authenc(hmac(sha1),cbc(des3_ede)))
[   10.199834] ath11k c000000.wifi: FW memory mode: 0
[   10.204275] nss_cryptoapi_attach_user[2236]:ffffffc000de8100: AEAD registration failed(authenc(hmac(sha256),cbc(des3_ede)))
[   10.215618] remoteproc remoteproc0: powering up cd00000.remoteproc
[   10.220152] nss_cryptoapi_attach_user[2236]:ffffffc000de8100: AEAD registration failed(seqiv(rfc4106(gcm(aes))))
[   10.231486] remoteproc remoteproc0: Booting fw image IPQ6018/q6_fw.mdt, size 7340
[   11.353083] remoteproc remoteproc0: remote processor cd00000.remoteproc is now up
[   11.354343] ath11k c000000.wifi: qmi ignore invalid mem req type 3
[   11.354818] kmodloader: done loading kernel modules from /etc/modules.d/*
[   11.360132] ath11k c000000.wifi: chip_id 0x0 chip_family 0x4 board_id 0xff soc_id 0xffffffff
[   11.372554] ath11k c000000.wifi: fw_version 0x240286d2 fw_build_timestamp 2021-05-05 02:32 fw_build_id WLAN.HK.2.4.0.1-01746-QCAHKSWPL_SILICONZ-1
[   11.725980] ath11k c000000.wifi: nss init soc nss if_num 203 userpd_id 0
[   14.758165] mtdblock: MTD device 'rootfs' is NAND, please consider using UBI block devices instead.
[   18.562647] ECM init
[   18.562731] ECM database jhash random seed: 0xbd509daf
[   18.603869] ECM init complete
[   19.530241] br-lan: port 1(eth1) entered blocking state
[   19.530300] br-lan: port 1(eth1) entered disabled state
[   19.535178] device eth1 entered promiscuous mode
[   19.551646] br-lan: port 2(eth2) entered blocking state
[   19.551708] br-lan: port 2(eth2) entered disabled state
[   19.556379] device eth2 entered promiscuous mode
[   20.447973] mtdblock: MTD device 'rootfs' is NAND, please consider using UBI block devices instead.
[   20.873778] br-lan: port 3(phy1-ap0) entered blocking state
[   20.873828] br-lan: port 3(phy1-ap0) entered disabled state
[   20.879910] device phy1-ap0 entered promiscuous mode
[   20.880640] Unable to handle kernel read from unreadable memory at virtual address 0000000020000018
[   20.885321] br-lan: port 3(phy1-ap0) entered blocking state
[   20.888941] Mem abort info:
[   20.888945]   ESR = 0x0000000096000005
[   20.888949]   EC = 0x25: DABT (current EL), IL = 32 bits
[   20.888955]   SET = 0, FnV = 0
[   20.888958]   EA = 0, S1PTW = 0
[   20.888961]   FSC = 0x05: level 1 translation fault
[   20.888965] Data abort info:
[   20.897717] br-lan: port 3(phy1-ap0) entered forwarding state
[   20.903250]   ISV = 0, ISS = 0x00000005
[   20.903253]   CM = 0, WnR = 0
[   20.903257] user pgtable: 4k pages, 39-bit VAs, pgdp=0000000051b5c000
[   20.903263] [0000000020000018] pgd=08000000507be003, p4d=08000000507be003, pud=08000000507be003, pmd=0000000000000000
[   20.948058] Internal error: Oops: 0000000096000005 [#1] PREEMPT SMP
[   20.958646] Modules linked in: ecm ath11k_ahb ath11k nft_fib_inet nf_flow_table_inet mac80211 ipt_REJECT cfg80211 xt_time xt_tcpudp xt_state xt_nat xt_multiport xt_mark xt_mac xt_limit xt_conntrack xt_comment xt_TPROXY xt_TCPMSS xt_REDIRECT xt_MASQUERADE xt_LOG qrtr_tun qrtr_smd qrtr_mhi qrtr qmi_helpers ppp_async nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject nft_redir nft_quota nft_objref nft_numgen nft_nat nft_masq nft_log nft_limit nft_hash nft_fullcone nft_flow_offload nft_fib_ipv6 nft_fib_ipv4 nft_fib nft_ct nft_compat nft_chain_nat nf_tproxy_ipv6 nf_tproxy_ipv4 nf_tables nf_reject_ipv4 nf_log_syslog nf_flow_table nf_conntrack_netlink mhi libcrc32c l2tp_ppp iptable_nat iptable_mangle iptable_filter ip_tables crc_ccitt compat sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact qca_nss_tunipip6 qca_nss_tun6rd pwm_fan hwmon qca_nss_cfi_cryptoapi qca_nss_crypto qca_nss_qdisc
[   20.958931]  qca_nss_wifi_meshmgr qca_nss_vxlanmgr qca_nss_pptp pptp qca_nss_pppoe pppoe pppox qca_nss_map_t qca_nss_lag_mgr qca_nss_l2tpv2 ppp_generic slhc qca_nss_gre qca_nss_bridge_mgr qca_nss_vlan xt_FULLCONENAT xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ipmac ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set nfnetlink ip6table_nat nf_nat nf_conntrack nf_defrag_ipv4 ip6t_NPT ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 qca_mcs bonding ip6_gre ip_gre gre ifb nat46 nf_defrag_ipv6 sit qca_nss_drv ip6_tunnel tunnel6 tunnel4 tun ntfs autofs4 nls_utf8 nls_iso8859_1 nls_cp437 vxlan seqiv michael_mic usb_storage leds_gpio xhci_plat_hcd xhci_pci xhci_hcd dwc3 dwc3_qcom fsl_mph_dr_of ehci_platform ehci_fsl ehci_hcd qca_nss_dp qca_ssdk
[   21.028521]  gpio_button_hotplug vfat fat ext4 mbcache jbd2 exfat crc32c_generic
[   21.136855] CPU: 0 PID: 2974 Comm: mac80211.sh Not tainted 6.1.79 #0
[   21.144230] Hardware name: GL Technologies, Inc. AXT1800 (DT)
[   21.150567] pstate: 004000c5 (nzcv daIF +PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[   21.156210] pc : collect_posix_cputimers+0x44/0xf0
[   21.162977] lr : posix_cpu_timers_work+0x94/0x470
[   21.167838] sp : ffffffc00ae83c40
[   21.172609] x29: ffffffc00ae83c40 x28: ffffff800f393200 x27: ffffffc00ae83d08
[   21.175915] x26: 0000000000000000 x25: 0000000000000001 x24: ffffff800f393200
[   21.183034] x23: 000000000ac9d740 x22: ffffff800f3937d8 x21: ffffff800f393954
[   21.190152] x20: ffffffc00ae83cf8 x19: 0000000020000000 x18: 0000000000000000
[   21.197269] x17: ffffffc0372e3000 x16: ffffffc008000000 x15: 0000000000000000
[   21.204386] x14: 000000000000013e x13: 0000000000000001 x12: 0000000000000001
[   21.211505] x11: ffffff803fd9da40 x10: ffffffc008bbdeb8 x9 : ffffffc008ba8a98
[   21.218624] x8 : 00000004dc8b8400 x7 : 7fffffffffffffff x6 : 000000002da972a4
[   21.225741] x5 : 000000000aecb3e4 x4 : 00000000090013c0 x3 : 000000000ac9d740
[   21.232859] x2 : ffffffc00ae83cf8 x1 : ffffffc00ae83d08 x0 : ffffff800f3937d8
[   21.239978] Call trace:
[   21.247087]  collect_posix_cputimers+0x44/0xf0
[   21.249348]  posix_cpu_timers_work+0x94/0x470
[   21.253860]  task_work_run+0x80/0xb0
[   21.258286]  do_notify_resume+0x4b8/0x83c
[   21.261933]  el0_interrupt+0x9c/0xb0
[   21.265837]  __el0_irq_handler_common+0x18/0x24
[   21.269486]  el0t_64_irq_handler+0x10/0x20
[   21.273738]  el0t_64_irq+0x174/0x178
[   21.277910] Code: d5384118 f9400ad3 f87a7b77 b40004d3 (f9400e60)
[   21.281644] ---[ end trace 0000000000000000 ]---
[   21.287631] Kernel panic - not syncing: Oops: Fatal exception
[   21.292319] SMP: stopping secondary CPUs
[   22.381292] SMP: failed to stop secondary CPUs 0-1
[   22.381313] Kernel Offset: disabled
[   22.384959] CPU features: 0x00000,00010000,0000400b
[   22.388349] Memory Limit: none
[   22.993248] Rebooting in 3 seconds..

Can you try building with newer firmware?

1 Like

just an imho shout to everyone ... it may be worth for anyone having an ipq6018 to create a separate "community build" as i did for the ipq807x although code is shared i thought it may be helpful to keep us all focused and devs also

4 Likes

Please can someone point me in the right direction to install a NSS build for the dl-wrx32? I'm currently on 23.05.2 ipq807x/generic build of openwrt. I would like to run the sqm nss package and have just downloaded sqm-scripts-nss_20230217c-1_all.ipk. Not sure if this is still required and what the process is so all help would be highly appreciated.

I've decided to return to the old working method with loading the 10G FW (wrapped with mbn header for U-Boot) from U-boot.

Edit
What I noticed is that the 10G_1 port sometimes will start only at router reboot with cable connected to it. If the cable is disconnected and then reconnected it will not start again each time (sometimes a link cannot be established and reboot is necessery).
But that is a minor pain comparing to not working at all.
Probably more skillful user could figure it out.

While creating the nsshtb qdisc, I encountered an error about adding the tc filter. After searching for a long time, I found the same error on 806x, but no solution.

Can anyone help me?

I"ve built (20240229) with ATH11K_NSS_MESH_SUPPORT, nss-drv-wifi-meshmgr and Firmware 11.4
Maybe smb can test mesh (working or not) and performance on ax3600, ax6?

1 Like

Just a word of caution, if anyone is testing this NSS 11.4 + NSS MESH version make sure you build without qca-nss-drv-qdisc/NSS SQM scripts

qca-nss-drv-qdisc will cause a flood of messages and cause the system to hang.

There were a significant number of changes between NHSS.QSDK.11.4 to NHSS.QSDK.12.0.5 in nss_qdisc

 nss_qdisc/Makefile           |  18
 nss_qdisc/nss_bf.c           |  52
 nss_qdisc/nss_blackhole.c    |  12
 nss_qdisc/nss_codel.c        |  11
 nss_qdisc/nss_fifo.c         |  12
 nss_qdisc/nss_htb.c          |  52
 nss_qdisc/nss_ppe.c          |   4
 nss_qdisc/nss_prio.c         |  11
 nss_qdisc/nss_qdisc.c        | 364
 nss_qdisc/nss_qdisc.h        |  57
 nss_qdisc/nss_qdisc_htable.c | 239
 nss_qdisc/nss_qdisc_htable.h |  37
 nss_qdisc/nss_qdisc_stats.c  | 687
 nss_qdisc/nss_qdisc_stats.h  |  28
 nss_qdisc/nss_tbl.c          |  14
 nss_qdisc/nss_wred.c         |  12
 nss_qdisc/nss_wrr.c          |  52
 17 files changed, 1242 insertions(+), 420 deletions(-)
1 Like

Question for everyone.

Has anyone recently tried to reload the ath11k module? The only way to fully load an updated ath11k module was to reboot, as this was a common issue from this post.

I just noticed I am able to reload it now.

/etc/init.d/wpad stop
/sbin/wifi down
rmmod ath11k_ahb
rmmod ath11k
rmmod mac80211
rmmod cfg80211
sleep 1
modprobe ath11k_ahb
/etc/init.d/wpad start
/sbin/wifi up

Tried it 3 times, and all 3 times it came up.

➤ dmesg --color=always|grep -E "c000000.wifi|ath11k|remoteproc"
[Fri Mar  1 12:21:36 2024] remoteproc remoteproc0: releasing cd00000.q6v5_wcss
[Fri Mar  1 12:21:39 2024] remoteproc remoteproc0: cd00000.q6v5_wcss is available
[Fri Mar  1 12:21:46 2024] ath11k c000000.wifi: ipq8074 hw2.0
[Fri Mar  1 12:21:46 2024] ath11k c000000.wifi: FW memory mode: 0
[Fri Mar  1 12:21:46 2024] remoteproc remoteproc0: powering up cd00000.q6v5_wcss
[Fri Mar  1 12:21:46 2024] remoteproc remoteproc0: Booting fw image IPQ8074/q6_fw.mdt, size 668
[Fri Mar  1 12:21:47 2024] remoteproc remoteproc0: remote processor cd00000.q6v5_wcss is now up
[Fri Mar  1 12:21:47 2024] ath11k c000000.wifi: chip_id 0x0 chip_family 0x0 board_id 0xff soc_id 0xffffffff
[Fri Mar  1 12:21:47 2024] ath11k c000000.wifi: fw_version 0x290104a5 fw_build_timestamp 2023-08-02 20:32 fw_build_id WLAN.HK.2.9.0.1-01890-QCAHKSWPL_SILICONZ-1
[Fri Mar  1 12:21:47 2024] ath11k c000000.wifi: htt event 48 not handled
[Fri Mar  1 12:21:47 2024] ath11k c000000.wifi: nss init soc nss if_num 203 userpd_id 0
[Fri Mar  1 12:22:57 2024] remoteproc remoteproc0: stopped remote processor cd00000.q6v5_wcss
[Fri Mar  1 12:22:58 2024] ath11k c000000.wifi: ipq8074 hw2.0
[Fri Mar  1 12:22:58 2024] ath11k c000000.wifi: FW memory mode: 0
[Fri Mar  1 12:22:58 2024] remoteproc remoteproc0: powering up cd00000.q6v5_wcss
[Fri Mar  1 12:22:58 2024] remoteproc remoteproc0: Booting fw image IPQ8074/q6_fw.mdt, size 668
[Fri Mar  1 12:22:59 2024] remoteproc remoteproc0: remote processor cd00000.q6v5_wcss is now up
[Fri Mar  1 12:22:59 2024] ath11k c000000.wifi: chip_id 0x0 chip_family 0x0 board_id 0xff soc_id 0xffffffff
[Fri Mar  1 12:22:59 2024] ath11k c000000.wifi: fw_version 0x290104a5 fw_build_timestamp 2023-08-02 20:32 fw_build_id WLAN.HK.2.9.0.1-01890-QCAHKSWPL_SILICONZ-1
[Fri Mar  1 12:22:59 2024] ath11k c000000.wifi: htt event 48 not handled
[Fri Mar  1 12:24:13 2024] remoteproc remoteproc0: stopped remote processor cd00000.q6v5_wcss
[Fri Mar  1 12:24:14 2024] ath11k c000000.wifi: ipq8074 hw2.0
[Fri Mar  1 12:24:14 2024] ath11k c000000.wifi: FW memory mode: 0
[Fri Mar  1 12:24:14 2024] remoteproc remoteproc0: powering up cd00000.q6v5_wcss
[Fri Mar  1 12:24:14 2024] remoteproc remoteproc0: Booting fw image IPQ8074/q6_fw.mdt, size 668
[Fri Mar  1 12:24:15 2024] remoteproc remoteproc0: remote processor cd00000.q6v5_wcss is now up
[Fri Mar  1 12:24:15 2024] ath11k c000000.wifi: chip_id 0x0 chip_family 0x0 board_id 0xff soc_id 0xffffffff
[Fri Mar  1 12:24:15 2024] ath11k c000000.wifi: fw_version 0x290104a5 fw_build_timestamp 2023-08-02 20:32 fw_build_id WLAN.HK.2.9.0.1-01890-QCAHKSWPL_SILICONZ-1
[Fri Mar  1 12:24:15 2024] ath11k c000000.wifi: htt event 48 not handled
[Fri Mar  1 12:25:27 2024] remoteproc remoteproc0: stopped remote processor cd00000.q6v5_wcss
[Fri Mar  1 12:25:28 2024] ath11k c000000.wifi: ipq8074 hw2.0
[Fri Mar  1 12:25:28 2024] ath11k c000000.wifi: FW memory mode: 0
[Fri Mar  1 12:25:28 2024] remoteproc remoteproc0: powering up cd00000.q6v5_wcss
[Fri Mar  1 12:25:28 2024] remoteproc remoteproc0: Booting fw image IPQ8074/q6_fw.mdt, size 668
[Fri Mar  1 12:25:28 2024] remoteproc remoteproc0: remote processor cd00000.q6v5_wcss is now up

I don't see anything in upstream if there was a change made to remoteproc or specific to q6v5. @robimarko / @Ansuel any insight?

Sweet, should make it easy to enable/disable NSS on the fly, and other module load params without reboots :slight_smile:

2 Likes

I've compiled @qosmio repo + wireguard, nss offload enabled, nss qdisc enabled, IoT + vlans on connection fiber, home usage stats for 24hr window https://imgur.com/a/UAjXy5l
The line with pause is moment of switch firmware between bitthef's and qosimo - so there are 6 days with old firmware and one with new - memory consumption is a bit higher, but no OOM in 24h.

also check removal and load ath11k - also no issues on ax3600

1 Like

Hello. Ax3600 here. Seems on this build nss works ok (in the previous one it didn't like some other guy mentioned above, it had huge cpu usage on speedtest). Performance seems ok. Ram seems to be good too, still have 90MB after 8 hours.
Anyway it has the old bug with playing games through wifi, it randomly timeouts every X time. This was fixed on recent builds. So this makes it non-usable in my case :frowning:

Fri Mar  1 21:59:49 2024 kern.warn kernel: [34584.882594] ath11k c000000.wifi: peer ast idx 134 can't be found
Fri Mar  1 21:59:49 2024 kern.warn kernel: [34585.013845] ath11k c000000.wifi: peer ast idx 134 can't be found
Fri Mar  1 21:59:49 2024 kern.warn kernel: [34585.415980] ath11k c000000.wifi: peer ast idx 134 can't be found
Fri Mar  1 21:59:49 2024 kern.warn kernel: [34585.422177] ath11k c000000.wifi: peer ast idx 134 can't be found
Fri Mar  1 21:59:49 2024 kern.warn kernel: [34585.525795] ath11k c000000.wifi: peer ast idx 134 can't be found
Fri Mar  1 21:59:49 2024 kern.warn kernel: [34585.596033] ath11k c000000.wifi: peer ast idx 134 can't be found
Fri Mar  1 21:59:50 2024 kern.warn kernel: [34585.670336] ath11k c000000.wifi: peer ast idx 134 can't be found
Fri Mar  1 21:59:50 2024 kern.warn kernel: [34585.687786] ath11k c000000.wifi: peer ast idx 134 can't be found
Fri Mar  1 21:59:50 2024 kern.warn kernel: [34585.733609] ath11k c000000.wifi: peer ast idx 134 can't be found
Fri Mar  1 21:59:54 2024 kern.warn kernel: [34590.162863] ath11k_warn: 26 callbacks suppressed
Fri Mar  1 21:59:54 2024 kern.warn kernel: [34590.162914] ath11k c000000.wifi: peer ast idx 134 can't be found
Fri Mar  1 21:59:54 2024 kern.warn kernel: [34590.186344] ath11k c000000.wifi: peer ast idx 134 can't be found
Fri Mar  1 21:59:54 2024 kern.warn kernel: [34590.289281] ath11k c000000.wifi: peer ast idx 134 can't be found
Fri Mar  1 21:59:55 2024 kern.warn kernel: [34590.636812] ath11k c000000.wifi: peer ast idx 134 can't be found
Fri Mar  1 21:59:55 2024 kern.warn kernel: [34590.711913] ath11k c000000.wifi: peer ast idx 134 can't be found
Fri Mar  1 21:59:55 2024 kern.warn kernel: [34590.747719] ath11k c000000.wifi: peer ast idx 134 can't be found
Fri Mar  1 21:59:55 2024 kern.warn kernel: [34591.411890] ath11k c000000.wifi: peer ast idx 134 can't be found
Fri Mar  1 21:59:55 2024 kern.warn kernel: [34591.567793] ath11k c000000.wifi: peer ast idx 134 can't be found

Your ugly hack looks really beautiful to me :slight_smile:

For temperatures I use an addon package but your output looks more refined.

3 Likes

@qosmio , exactly every 2 days uptime, my connected devices to 5 GHz cannot connect anymore, I had to reboot the router to make it work again, I checked the log it happens like this. The connection problem starts right after the hostapd: WPA group handshake. I don't know what it is doing the hostapd try to handshake all of the devices.

What happened to my device is that it connects just for a second to the Wifi then disconnects again and it repeats until I reboot the router.

Here's the log, my router is AX3600

Also randomly crashing modules for oom errors (but no router reboot) with the following log.
Pbuf is set to 512mb

Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.327329] CPU: 2 PID: 11225 Comm: utpl Not tainted 6.1.79 #0
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.337561] Hardware name: Xiaomi AX3600 (DT)
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.343201] Call trace:
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.347631]  dump_backtrace.part.0+0xc0/0xd0
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.349885]  show_stack+0x18/0x30
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.354396]  dump_stack_lvl+0x6c/0x88
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.357607]  dump_stack+0x18/0x34
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.361254]  dump_header+0x44/0x1a0
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.364550]  oom_kill_process+0x270/0x274
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.367853]  out_of_memory+0xd0/0x30c
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.372017]  __alloc_pages_slowpath.constprop.0+0x6b4/0xa30
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.375667]  __alloc_pages+0x214/0x260
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.381046]  __folio_alloc+0x14/0x20
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.384865]  alloc_zeroed_user_highpage_movable+0x24/0x30
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.388610]  __handle_mm_fault+0x38c/0xa1c
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.393896]  handle_mm_fault+0x1dc/0x260
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.397889]  do_page_fault+0x13c/0x310
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.401965]  do_translation_fault+0x88/0x94
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.405526]  do_mem_abort+0x44/0x94
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.409604]  el0_da+0x24/0x60
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.413076]  el0t_64_sync_handler+0xac/0x120
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.416204]  el0t_64_sync+0x174/0x178
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.421235] Mem-Info:
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.424118] active_anon:1134 inactive_anon:800 isolated_anon:0
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.424118]  active_file:670 inactive_file:49 isolated_file:0
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.424118]  unevictable:0 dirty:0 writeback:0
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.424118]  slab_reclaimable:2096 slab_unreclaimable:10645
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.424118]  mapped:277 shmem:352 pagetables:263
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.424118]  sec_pagetables:0 bounce:0
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.424118]  kernel_misc_reclaimable:0
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.424118]  free:12151 free_pcp:281 free_cma:0
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.442577] Node 0 active_anon:4540kB inactive_anon:3200kB active_file:2684kB inactive_file:136kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:1216kB dirty:0kB writeback:0kB shmem:1408kB writeback_tmp:0kB kernel_stack:2320kB pagetables:1052kB sec_pagetables:0kB all_unreclaimable? no
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.468613] DMA free:48404kB boost:0kB min:16384kB low:20480kB high:24576kB reserved_highatomic:0KB active_anon:4540kB inactive_anon:3200kB active_file:2448kB inactive_file:316kB unevictable:0kB writepending:0kB present:524288kB managed:415480kB mlocked:0kB bounce:0kB free_pcp:1392kB local_pcp:120kB free_cma:0kB
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.496444] lowmem_reserve[]: 0 0 0 0
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.518708] DMA: 144*4kB (UME) 403*8kB (UME) 255*16kB (UME) 898*32kB (UME) 149*64kB (UME) 11*128kB (ME) 1*256kB (M) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 47816kB
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.522143] 1136 total pagecache pages
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.536719] 0 pages in swap cache
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.540267] Free swap  = 0kB
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.543481] Total swap = 0kB
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.546420] 131072 pages RAM
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.549281] 0 pages HighMem/MovableOnly
Sat Mar  2 23:38:05 2024 kern.warn kernel: [10942.552153] 27202 pages reserved
Sat Mar  2 23:38:05 2024 kern.info kernel: [10942.555706] Tasks state (memory values in pages):
Sat Mar  2 23:38:05 2024 kern.info kernel: [10942.559181] [  pid  ]   uid  tgid total_vm      rss pgtables_bytes swapents oom_score_adj name
Sat Mar  2 23:38:05 2024 kern.info kernel: [10942.563826] [    907]    81   907      372      101    32768        0             0 ubusd
Sat Mar  2 23:38:05 2024 kern.info kernel: [10942.572324] [    908]     0   908      227        9    32768        0             0 askfirst
Sat Mar  2 23:38:05 2024 kern.info kernel: [10942.580553] [    943]     0   943      266       16    32768        0             0 urngd
Sat Mar  2 23:38:05 2024 kern.info kernel: [10942.589066] [   1949]   514  1949      494      140    28672        0             0 logd
Sat Mar  2 23:38:05 2024 kern.info kernel: [10942.597143] [   2003]     0  2003      965      184    40960        0             0 rpcd
Sat Mar  2 23:38:05 2024 kern.info kernel: [10942.605450] [   2267]     0  2267      277       16    32768        0             0 dropbear
Sat Mar  2 23:38:05 2024 kern.info kernel: [10942.613492] [   2382]     0  2382      707       24    40960        0             0 hostapd
Sat Mar  2 23:38:05 2024 kern.info kernel: [10942.621793] [   2383]     0  2383      707       24    36864        0             0 wpa_supplicant
Sat Mar  2 23:38:05 2024 kern.info kernel: [10942.629865] [   2394]   101  2394     1878      264    45056        0             0 hostapd
Sat Mar  2 23:38:06 2024 kern.info kernel: [10942.638897] [   2395]   101  2395     1760      134    49152        0             0 wpa_supplicant
Sat Mar  2 23:38:06 2024 kern.info kernel: [10942.647310] [   2447]     0  2447      663      208    32768        0             0 netifd
Sat Mar  2 23:38:06 2024 kern.info kernel: [10942.656505] [   2646]     0  2646      430      100    32768        0             0 odhcpd
Sat Mar  2 23:38:06 2024 kern.info kernel: [10942.664403] [   2764]     0  2764      724       62    32768        0             0 uhttpd
Sat Mar  2 23:38:06 2024 kern.info kernel: [10942.672868] [   3366]     0  3366      707       28    40960        0             0 ntpd
Sat Mar  2 23:38:06 2024 kern.info kernel: [10942.681225] [   3386]   123  3386      329       14    32768        0             0 ntpd
Sat Mar  2 23:38:06 2024 kern.info kernel: [10942.689164] [   3836]     0  3836      269       37    32768        0             0 odhcp6c
Sat Mar  2 23:38:06 2024 kern.info kernel: [10942.697451] [   4742]     0  4742      707       28    32768        0             0 dnsmasq
Sat Mar  2 23:38:06 2024 kern.info kernel: [10942.705541] [   4748]   453  4748     1211      188    45056        0             0 dnsmasq
Sat Mar  2 23:38:06 2024 kern.info kernel: [10942.713633] [   5434]     0  5434      283       23    28672        0             0 dropbear
Sat Mar  2 23:38:06 2024 kern.info kernel: [10942.721967] [   5435]     0  5435      332      116    32768        0             0 ash
Sat Mar  2 23:38:06 2024 kern.info kernel: [10942.730685] [  10943]     0 10943      354      106    36864        0             0 pppd
Sat Mar  2 23:38:06 2024 kern.info kernel: [10942.738633] [  11179]     0 11179      300      161    28672        0             0 modprobe
Sat Mar  2 23:38:06 2024 kern.info kernel: [10942.746703] [  11180]     0 11180      364      154    32768        0             0 hotplug-call
Sat Mar  2 23:38:06 2024 kern.info kernel: [10942.755126] [  11190]     0 11190      365      136    32768        0             0 hotplug-call
Sat Mar  2 23:38:06 2024 kern.info kernel: [10942.764092] [  11221]     0 11221      335      125    32768        0             0 fw4
Sat Mar  2 23:38:06 2024 kern.info kernel: [10942.772659] [  11222]     0 11222      269      105    32768        0             0 odhcp6c
Sat Mar  2 23:38:06 2024 kern.info kernel: [10942.780373] [  11225]     0 11225      743      299    36864        0             0 utpl
Sat Mar  2 23:38:06 2024 kern.info kernel: [10942.788709] [  11227]     0 11227      609      138    36864        0             0 nft
Sat Mar  2 23:38:06 2024 kern.info kernel: [10942.797050] [  11232]     0 11232      357      202    32768        0             0 sysntpd
Sat Mar  2 23:38:06 2024 kern.info kernel: [10942.804773] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/,task=utpl,pid=11225,uid=0
Sat Mar  2 23:38:06 2024 kern.err kernel: [10942.813123] Out of memory: Killed process 11225 (utpl) total-vm:2972kB, anon-rss:736kB, file-rss:460kB, shmem-rss:0kB, UID:0 pgtables:36kB oom_score_adj:0
Sat Mar  2 23:38:07 2024 user.notice firewall: Reloading firewall due to ifupdate of wan (pppoe-wan)

I think you are right. WIth bitthief NSS build I had /etc/config/ecm file with below settings in order to mitigate the SSL errors. This was broadly discussed several months ago.

I am still receiving SSL errors when accessing the LAN using the latest builds from @qosmio.
I'm unsure if anyone else is experiencing this issue.

What do you do and how do you notice the SSL errors in your LAN?
In my case I couldn't open one specific website that used an encrypted communication.
Performing a bufferbloat test especially via WiFi couldn't complete upload test because of the numerous SSL errors.
Additionally I had an upload cap of only 30 Mbps on all speedtests performed on WiFi clients.
I mentioned all of them in my older posts when I started using earliest implementation of NSS for ipq807x from @bitthief.
I'm glad that I no longer see any of them now.
@anom3 was the first one that started to investigate those SSL errors.

I did not encounter this issue when using devices connected via WLAN. However, when downloading through https using wget/curl on a LAN device, I frequently received the following error.

2024-03-03 21:03:19 (1.81 MB/s) - Read error at byte 327339/5173995520 (error:1408F119:SSL routines:ssl3_get_record:decryption failed or bad record mac). Retrying.

After poking around I found that the error will disappear immediately with

ethtool -K lan tx-checksum-ip-generic off

My device has two ports for LAN/WAN respectively.

ethtool -i lan
driver: nss-dp
version: 6.1.79
firmware-version:
expansion-rom-version:
bus-info: 3a007000.dp6-syn
supports-statistics: yes
supports-test: no
supports-eeprom-access: no
supports-register-dump: no
supports-priv-flags: no
root@OpenWrt:~# ethtool -i wan
driver: nss-dp
version: 6.1.79
firmware-version:
expansion-rom-version:
bus-info: 3a003000.dp5-syn
supports-statistics: yes
supports-test: no
supports-eeprom-access: no
supports-register-dump: no
supports-priv-flags: no
1 Like