Radios go offline

Hi, I have this router:

Hostname	ArcherC7
Model	TP-Link Archer C7 v2
Architecture	Qualcomm Atheros QCA9558 ver 1 rev 0
Target Platform	ath79/generic
Firmware Version	OpenWrt 23.05.5 r24106-10cc5fcd00 / LuCI openwrt-23.05 branch git-24.264.56413-c7a3562
Kernel Version	5.15.167

After 10 days of work all radios went down, here is the log:

Thu Oct 10 03:46:34 2024 kern.err kernel: [1010256.949090] irq 23: nobody cared (try booting with the "irqpoll" option)
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010256.956081] CPU: 0 PID: 317 Comm: irq/23-keys Not tainted 5.15.167 #0
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010256.962792] Stack : 00000000 00000004 00000000 00000000 00000000 00000000 00000000 00000000
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010256.971468]         00000000 00000000 00000000 00000000 00000000 00000001 80c0b8d0 20bd37ee
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010256.980144]         80c0b968 00000000 00000000 80c0b770 00000038 80331144 00000000 ffffffea
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010256.988821]         00000148 80c0b77c 00000148 8072a078 80668940 80c0b8b0 00000017 8078e6e0
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010256.997498]         0000001f 8079b788 8078e480 fffffc00 00000001 8039cd80 00000000 808e0000
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.006175]         ...
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.008833] Call Trace:
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.008844] [<80331144>] 0x80331144
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.015216] [<8039cd80>] 0x8039cd80
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.018971] [<80066544>] 0x80066544
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.022685] [<8006654c>] 0x8006654c
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.026398] [<800c521c>] 0x800c521c
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.030113] [<800c5738>] 0x800c5738
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.033828] [<800c29d4>] 0x800c29d4
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.037540] [<800c5e18>] 0x800c5e18
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.041253] [<8006c0b0>] 0x8006c0b0
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.044966] [<800c2098>] 0x800c2098
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.048679] [<800c2794>] 0x800c2794
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.052392] [<8034ab54>] 0x8034ab54
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.056107] [<800b5f14>] 0x800b5f14
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.059822] [<800c2098>] 0x800c2098
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.063533] [<800c2098>] 0x800c2098
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.067248] [<80331774>] 0x80331774
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.070962] [<800c7210>] 0x800c7210
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.074676] [<800c2054>] 0x800c2054
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.078388] [<800c2098>] 0x800c2098
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.082102] [<80654278>] 0x80654278
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.085815] [<80331774>] 0x80331774
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.089528] [<80331418>] 0x80331418
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.093254] [<80062198>] 0x80062198
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.096965] [<80654278>] 0x80654278
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.100683] [<819e9994>] 0x819e9994 [ath9k@ccad4ea0+0x198e0]
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.106622] [<802f82bc>] 0x802f82bc
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.110348] [<819eb7f8>] 0x819eb7f8 [ath9k@ccad4ea0+0x198e0]
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.116273] [<819e9a60>] 0x819e9a60 [ath9k@ccad4ea0+0x198e0]
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.122202] [<802f82bc>] 0x802f82bc
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.125916] [<80302044>] 0x80302044
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.129636] [<8210920c>] 0x8210920c [mac80211@050388ee+0x8d0c0]
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.135830] [<819eb7f8>] 0x819eb7f8 [ath9k@ccad4ea0+0x198e0]
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.141760] [<8210920c>] 0x8210920c [mac80211@050388ee+0x8d0c0]
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.147966] [<821319d4>] 0x821319d4 [mac80211@050388ee+0x8d0c0]
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.154157] [<82134790>] 0x82134790 [mac80211@050388ee+0x8d0c0]
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.160344] [<80331774>] 0x80331774
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.164056] [<80331418>] 0x80331418
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.167785] [<80062198>] 0x80062198
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.171503] [<800c2098>] 0x800c2098
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.175224] [<82135170>] 0x82135170 [mac80211@050388ee+0x8d0c0]
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.181434] [<82136638>] 0x82136638 [mac80211@050388ee+0x8d0c0]
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.187626] [<80062198>] 0x80062198
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.191355] [<819e1d1c>] 0x819e1d1c [ath9k@ccad4ea0+0x198e0]
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.197304] [<82136918>] 0x82136918 [mac80211@050388ee+0x8d0c0]
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.203513] [<819e7c30>] 0x819e7c30 [ath9k@ccad4ea0+0x198e0]
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.209445] [<819e7700>] 0x819e7700 [ath9k@ccad4ea0+0x198e0]
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.215379] [<819e4c98>] 0x819e4c98 [ath9k@ccad4ea0+0x198e0]
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.221303] [<80087b18>] 0x80087b18
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.225015] [<80087f50>] 0x80087f50
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.228727] [<800c7210>] 0x800c7210
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.232444] [<80331418>] 0x80331418
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.236178] [<80062198>] 0x80062198
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.239899]
Thu Oct 10 03:46:34 2024 kern.err kernel: [1010257.241584] handlers:
Thu Oct 10 03:46:34 2024 kern.err kernel: [1010257.244057] [<93e8f932>] 0x800c2a04 threaded [<c68cdd07>] 0x80ffe0b8 [gpio_button_hotplug@e7b49d1e+0x1a00]
Thu Oct 10 03:46:34 2024 kern.emerg kernel: [1010257.254044] Disabling IRQ #23
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.262441] ath10k_pci 0000:00:00.0: SWBA overrun on vdev 0, skipped old beacon
Thu Oct 10 03:46:34 2024 kern.warn kernel: [1010257.270144] ath10k_pci 0000:00:00.0: SWBA overrun on vdev 0, skipped old beacon
Thu Oct 10 03:46:36 2024 daemon.notice hostapd: Set new config for phy phy0:
Thu Oct 10 03:46:36 2024 daemon.notice hostapd: Remove interface 'phy0'
Thu Oct 10 03:46:36 2024 daemon.notice hostapd: phy0-ap0: interface state ENABLED->DISABLED
Thu Oct 10 03:46:36 2024 daemon.notice hostapd: phy0-ap0: AP-STA-DISCONNECTED 84:a9:3e:bb:69:13
Thu Oct 10 03:46:36 2024 daemon.notice hostapd: phy0-ap0: AP-DISABLED
Thu Oct 10 03:46:36 2024 daemon.notice hostapd: phy0-ap0: CTRL-EVENT-TERMINATING
Thu Oct 10 03:46:36 2024 daemon.err hostapd: rmdir[ctrl_interface=/var/run/hostapd]: Permission denied
Thu Oct 10 03:46:36 2024 daemon.notice hostapd: nl80211: deinit ifname=phy0-ap0 disabled_11b_rates=0
Thu Oct 10 03:46:36 2024 kern.info kernel: [1010259.076909] ath10k_pci 0000:00:00.0: mac flush vdev 0 drop 0 queues 0x1 ar->paused: 0x0  arvif->paused: 0x0
Thu Oct 10 03:46:36 2024 kern.info kernel: [1010259.087198] br-home: port 2(phy0-ap0) entered disabled state
Thu Oct 10 03:46:36 2024 daemon.notice netifd: Network device 'phy0-ap0' link is down
Thu Oct 10 03:46:36 2024 kern.info kernel: [1010259.104811] ath10k_pci 0000:00:00.0: mac flush null vif, drop 0 queues 0xffff
Thu Oct 10 03:46:36 2024 kern.info kernel: [1010259.256161] br-home: port 2(phy0-ap0) entered disabled state
Thu Oct 10 03:46:36 2024 kern.info kernel: [1010259.262629] device phy0-ap0 left promiscuous mode
Thu Oct 10 03:46:36 2024 kern.info kernel: [1010259.267663] br-home: port 2(phy0-ap0) entered disabled state
Thu Oct 10 03:46:36 2024 daemon.notice hostapd: Set new config for phy phy1:
Thu Oct 10 03:46:36 2024 daemon.notice hostapd: Remove interface 'phy1'
Thu Oct 10 03:46:36 2024 daemon.notice hostapd: phy1-ap0: interface state ENABLED->DISABLED
Thu Oct 10 03:46:36 2024 daemon.notice hostapd: phy1-ap1: AP-DISABLED
Thu Oct 10 03:46:36 2024 daemon.notice hostapd: phy1-ap1: CTRL-EVENT-TERMINATING
Thu Oct 10 03:46:36 2024 daemon.err hostapd: rmdir[ctrl_interface=/var/run/hostapd]: Permission denied
Thu Oct 10 03:46:36 2024 kern.info kernel: [1010259.303459] br-iot: port 2(phy1-ap1) entered disabled state
Thu Oct 10 03:46:36 2024 daemon.notice wpa_supplicant[1665]: Set new config for phy phy0
Thu Oct 10 03:46:36 2024 kern.info kernel: [1010259.331812] device phy1-ap1 left promiscuous mode
Thu Oct 10 03:46:36 2024 kern.info kernel: [1010259.336780] br-iot: port 2(phy1-ap1) entered disabled state
Thu Oct 10 03:46:36 2024 daemon.notice netifd: Network device 'phy1-ap1' link is down
Thu Oct 10 03:46:36 2024 daemon.notice hostapd: nl80211: Failed to remove interface phy1-ap1 from bridge br-iot: No such device
Thu Oct 10 03:46:36 2024 daemon.notice hostapd: phy1-ap0: AP-STA-DISCONNECTED 90:3f:ea:ab:d1:40
Thu Oct 10 03:46:36 2024 daemon.notice hostapd: phy1-ap0: AP-DISABLED
Thu Oct 10 03:46:36 2024 daemon.notice hostapd: phy1-ap0: CTRL-EVENT-TERMINATING
Thu Oct 10 03:46:36 2024 daemon.err hostapd: rmdir[ctrl_interface=/var/run/hostapd]: Permission denied
Thu Oct 10 03:46:36 2024 daemon.notice hostapd: nl80211: deinit ifname=phy1-ap0 disabled_11b_rates=0
Thu Oct 10 03:46:36 2024 kern.info kernel: [1010259.492635] br-solar: port 2(phy1-ap0) entered disabled state
Thu Oct 10 03:46:36 2024 kern.info kernel: [1010259.499103] device phy1-ap0 left promiscuous mode
Thu Oct 10 03:46:36 2024 kern.info kernel: [1010259.504185] br-solar: port 2(phy1-ap0) entered disabled state
Thu Oct 10 03:46:36 2024 daemon.notice netifd: Network device 'phy1-ap0' link is down
Thu Oct 10 03:46:36 2024 daemon.notice wpa_supplicant[1665]: Set new config for phy phy1
Thu Oct 10 03:46:36 2024 daemon.notice netifd: Wireless device 'radio0' is now down
Thu Oct 10 03:46:36 2024 daemon.notice netifd: Wireless device 'radio1' is now down

The router is parametrized as dumb AP and normally serves two WiFi devices and one rj45 (that was not connected at the time of failure).

I think, but I cannot grant, that this did not happen in 23.05.4 and earlier. What can be the problem ?

Likely changing ath10k kmod and firmware to -ct or vice versa can help.

Please connect to your OpenWrt device using ssh and copy the output of the following commands and post it here using the "Preformatted text </> " button:
grafik
Remember to redact passwords, MAC addresses and any public IP addresses you may have:

ubus call system board
cat /etc/config/network
cat /etc/config/wireless
cat /etc/config/dhcp
cat /etc/config/firewall

As requested:

root@ArcherC7:~# ubus call system board
{
        "kernel": "5.15.167",
        "hostname": "ArcherC7",
        "system": "Qualcomm Atheros QCA9558 ver 1 rev 0",
        "model": "TP-Link Archer C7 v2",
        "board_name": "tplink,archer-c7-v2",
        "rootfs_type": "squashfs",
        "release": {
                "distribution": "OpenWrt",
                "version": "23.05.5",
                "revision": "r24106-10cc5fcd00",
                "target": "ath79/generic",
                "description": "OpenWrt 23.05.5 r24106-10cc5fcd00"
        }
}
root@ArcherC7:~# cat /etc/config/network

config interface 'loopback'
        option device 'lo'
        option proto 'static'
        option ipaddr '127.0.0.1'
        option netmask '255.0.0.0'

config globals 'globals'
        option ula_prefix 'fd3b:dc7d:04a8::/48'

config device
        option name 'br-lan'
        option type 'bridge'
        list ports 'eth1.4000'

config interface 'lan'
        option device 'br-lan'
        option proto 'dhcp'

config switch
        option name 'switch0'
        option reset '1'
        option enable_vlan '1'

config switch_vlan
        option device 'switch0'
        option vlan '3'
        option ports '0t 1t 6t'
        option vid '2500'
        option description 'Solar'

config switch_vlan
        option device 'switch0'
        option vlan '4'
        option vid '3000'
        option description 'Domotic'
        option ports '0t 1t 6t'

config device
        option type 'bridge'
        option name 'br-iot'
        list ports 'eth1.3000'
        option ipv6 '0'

config device
        option type 'bridge'
        option name 'br-solar'
        list ports 'eth1.2500'
        option ipv6 '0'

config interface 'iot'
        option proto 'none'
        option device 'br-iot'

config interface 'solar'
        option proto 'none'
        option device 'br-solar'

config switch_vlan
        option device 'switch0'
        option vlan '5'
        option vid '2000'
        option description 'Home'
        option ports '0t 1t 2 3 4 5 6t'

config device
        option type 'bridge'
        option name 'br-home'
        list ports 'eth1.2000'

config interface 'home'
        option proto 'none'
        option device 'br-home'

config switch_vlan
        option device 'switch0'
        option vlan '6'
        option vid '4000'
        option description 'Network'
        option ports '0t 1 6t'

config switch_vlan
        option device 'switch0'
        option vlan '7'
        option ports '0t 1t 6t'
        option vid '1000'
        option description 'Guest'

config device
        option type 'bridge'
        option name 'br-guest'
        list ports 'eth1.1000'

config interface 'guest'
        option proto 'none'
        option device 'br-guest'

root@ArcherC7:~# cat /etc/config/wireless

config wifi-device 'radio0'
        option type 'mac80211'
        option path 'pci0000:00/0000:00:00.0'
        option channel '36'
        option band '5g'
        option htmode 'VHT40'
        option cell_density '0'
        option country 'PT'

config wifi-device 'radio1'
        option type 'mac80211'
        option path 'platform/ahb/18100000.wmac'
        option band '2g'
        option htmode 'HT20'
        option cell_density '0'
        option channel '6'
        option country 'PT'

config wifi-iface 'wifinet1'
        option device 'radio1'
        option mode 'ap'
        option ssid 'Aveiro-Solar'
        option encryption 'psk2'
        option key '*****'
        option network 'solar'

config wifi-iface 'wifinet2'
        option device 'radio0'
        option mode 'ap'
        option ssid 'Aveiro-Home'
        option encryption 'psk2'
        option key '**********'
        option network 'home'
        option macfilter 'deny'
        list maclist '*******'
        list maclist '*******'
        list maclist '*******'

config wifi-iface 'wifinet3'
        option device 'radio1'
        option mode 'ap'
        option ssid 'Aveiro-Domotic'
        option encryption 'psk2'
        option key '************'
        option hidden '1'
        option network 'iot'

config wifi-iface 'wifinet4'
        option device 'radio0'
        option mode 'ap'
        option ssid 'Cardaes-Admin'
        option encryption 'psk2'
        option key '*************'
        option network 'guest'
        option disabled '1'

root@ArcherC7:~# cat /etc/config/dhcp

config dnsmasq
        option domainneeded '1'
        option boguspriv '1'
        option filterwin2k '0'
        option localise_queries '1'
        option rebind_protection '1'
        option rebind_localhost '1'
        option local '/lan/'
        option domain 'lan'
        option expandhosts '1'
        option nonegcache '0'
        option cachesize '1000'
        option authoritative '1'
        option readethers '1'
        option leasefile '/tmp/dhcp.leases'
        option resolvfile '/tmp/resolv.conf.d/resolv.conf.auto'
        option nonwildcard '1'
        option localservice '1'
        option ednspacket_max '1232'
        option filter_aaaa '0'
        option filter_a '0'
        option confdir '/tmp/dnsmasq.d'

config dhcp 'lan'
        option interface 'lan'
        option start '100'
        option limit '150'
        option leasetime '12h'
        option dhcpv4 'server'
        option ignore '1'

config odhcpd 'odhcpd'
        option maindhcp '0'
        option leasefile '/tmp/hosts/odhcpd'
        option leasetrigger '/usr/sbin/odhcpd-update'
        option loglevel '4'

root@ArcherC7:~# cat /etc/config/firewall

config defaults
        option syn_flood '1'
        option input 'REJECT'
        option output 'ACCEPT'
        option forward 'REJECT'

config zone
        option name 'lan'
        option input 'ACCEPT'
        option output 'ACCEPT'
        option forward 'ACCEPT'
        list network 'lan'

config zone
        option name 'wan'
        option input 'REJECT'
        option output 'ACCEPT'
        option forward 'REJECT'
        option masq '1'
        option mtu_fix '1'

config forwarding
        option src 'lan'
        option dest 'wan'

config rule
        option name 'Allow-DHCP-Renew'
        option src 'wan'
        option proto 'udp'
        option dest_port '68'
        option target 'ACCEPT'
        option family 'ipv4'

config rule
        option name 'Allow-Ping'
        option src 'wan'
        option proto 'icmp'
        option icmp_type 'echo-request'
        option family 'ipv4'
        option target 'ACCEPT'

config rule
        option name 'Allow-IGMP'
        option src 'wan'
        option proto 'igmp'
        option family 'ipv4'
        option target 'ACCEPT'

config rule
        option name 'Allow-DHCPv6'
        option src 'wan'
        option proto 'udp'
        option dest_port '546'
        option family 'ipv6'
        option target 'ACCEPT'

config rule
        option name 'Allow-MLD'
        option src 'wan'
        option proto 'icmp'
        option src_ip 'fe80::/10'
        list icmp_type '130/0'
        list icmp_type '131/0'
        list icmp_type '132/0'
        list icmp_type '143/0'
        option family 'ipv6'
        option target 'ACCEPT'

config rule
        option name 'Allow-ICMPv6-Input'
        option src 'wan'
        option proto 'icmp'
        list icmp_type 'echo-request'
        list icmp_type 'echo-reply'
        list icmp_type 'destination-unreachable'
        list icmp_type 'packet-too-big'
        list icmp_type 'time-exceeded'
        list icmp_type 'bad-header'
        list icmp_type 'unknown-header-type'
        list icmp_type 'router-solicitation'
        list icmp_type 'neighbour-solicitation'
        list icmp_type 'router-advertisement'
        list icmp_type 'neighbour-advertisement'
        option limit '1000/sec'
        option family 'ipv6'
        option target 'ACCEPT'

config rule
        option name 'Allow-ICMPv6-Forward'
        option src 'wan'
        option dest '*'
        option proto 'icmp'
        list icmp_type 'echo-request'
        list icmp_type 'echo-reply'
        list icmp_type 'destination-unreachable'
        list icmp_type 'packet-too-big'
        list icmp_type 'time-exceeded'
        list icmp_type 'bad-header'
        list icmp_type 'unknown-header-type'
        option limit '1000/sec'
        option family 'ipv6'
        option target 'ACCEPT'

config rule
        option name 'Allow-IPSec-ESP'
        option src 'wan'
        option dest 'lan'
        option proto 'esp'
        option target 'ACCEPT'

config rule
        option name 'Allow-ISAKMP'
        option src 'wan'
        option dest 'lan'
        option dest_port '500'
        option proto 'udp'
        option target 'ACCEPT'

Many thanks

No problem in your config. Lets try to change wifi driver.
Please post

opkg list-installed | grep ath10k

Here it is:

root@ArcherC7:~# opkg list-installed | grep ath10k
ath10k-board-qca988x - 20230804-1
ath10k-firmware-qca988x-ct - 2020-11-08-1
kmod-ath10k-ct - 5.15.167+2022-05-13-f808496f-5
opkg update
opkg remove ath10k-firmware-qca988x-ct kmod-ath10k-ct
opkg install ath10k-firmware-qca988x kmod-ath10k
1 Like

Done. Hope that this is the solution. I will mark as a solution after 2 weeks without problem.

Many many thanks.

Worked for me kindof, radio was crashing at dozen clients with -ct
You can safely use vht80.

This topic was automatically closed 10 days after the last reply. New replies are no longer allowed.