Belkin RT3200/Linksys E8450 WiFi AX discussion

root@OpenWrt:~# cat /sys/fs/pstore/*
Oops#1 Part1
<14>[    7.166415] procd: - watchdog -
<14>[    7.713412] procd: - watchdog -
<14>[    7.717576] procd: - ubus -
<14>[    7.772493] procd: - init -
<14>[    8.001323] urngd: v1.0.2 started.
<14>[    8.109644] kmodloader: loading kernel modules from /etc/modules.d/*
<6>[    8.132441] GACT probability on
<6>[    8.136612] Mirror/redirect action on
<6>[    8.146658] u32 classifier
<6>[    8.149369]     input device check on
<6>[    8.153021]     Actions configured
<6>[    8.163906] Loading modules backported from Linux version v5.15-rc6-0-g519d81956ee2
<6>[    8.171616] Backport generated by backports.git v5.15-rc6-1-0-gd44432d6
<6>[    8.199778] xt_time: kernel timezone is -0000
<7>[    8.262814] ieee80211 phy0: Selected rate control algorithm 'minstrel_ht'
<7>[    8.273804] mt7915e 0000:01:00.0: assign IRQ: got 143
<7>[    8.278978] pci 0000:00:00.0: enabling bus mastering
<6>[    8.283959] mt7915e 0000:01:00.0: enabling device (0000 -> 0002)
<7>[    8.290089] mt7915e 0000:01:00.0: enabling bus mastering
<6>[    8.319516] mt7622-wmac 18000000.wmac: HW/SW Version: 0x8a108a10, Build Time: 20190801210006a
<6>[    8.319516]
<6>[    8.368485] mt7915e 0000:01:00.0: HW/SW Version: 0x8a108a10, Build Time: 20201105222230a
<6>[    8.368485]
<6>[    8.415760] mt7622-wmac 18000000.wmac: N9 Firmware Version: 2.0, Build Time: 20200131180931
<6>[    8.528942] mt7915e 0000:01:00.0: WM Firmware Version: ____000000, Build Time: 20201105222304
<6>[    8.586680] mt7915e 0000:01:00.0: WA Firmware Version: DEV_000000, Build Time: 20201105222323
<6>[    8.712478] PPP generic driver version 2.4.2
<6>[    8.718297] NET: Registered protocol family 24
<14>[    8.735304] kmodloader: done loading kernel modules from /etc/modules.d/*
<6>[   10.927954] mtk_soc_eth 1b100000.ethernet eth0: Link is Down
<6>[   10.939037] mtk_soc_eth 1b100000.ethernet eth0: configuring for fixed/2500base-x link mode
<6>[   10.947466] mtk_soc_eth 1b100000.ethernet eth0: Link is Up - 2.5Gbps/Full - flow control rx/tx
<6>[   10.949038] mt7530 mdio-bus:00 lan1: configuring for phy/gmii link mode
<6>[   10.963449] 8021q: adding VLAN 0 to HW filter on device lan1
<6>[   10.971691] br-lan: port 1(lan1) entered blocking state
<6>[   10.977000] br-lan: port 1(lan1) entered disabled state
<6>[   10.983021] device lan1 entered promiscuous mode
<6>[   10.987737] device eth0 entered promiscuous mode
<6>[   10.995419] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
<6>[   11.010630] mt7530 mdio-bus:00 lan2: configuring for phy/gmii link mode
<6>[   11.017852] 8021q: adding VLAN 0 to HW filter on device lan2
<6>[   11.022153] mt7530 mdio-bus:00 lan2: Link is Up - 1Gbps/Full - flow control rx/tx
<6>[   11.027281] br-lan: port 2(lan2) entered blocking state
<6>[   11.036314] br-lan: port 2(lan2) entered disabled state
<6>[   11.043621] device lan2 entered promiscuous mode
<6>[   11.053814] br-lan: port 2(lan2) entered blocking state
<6>[   11.059100] br-lan: port 2(lan2) entered forwarding state
<6>[   11.065585] IPv6: ADDRCONF(NETDEV_CHANGE): br-lan: link becomes ready
<6>[   11.077761] mt7530 mdio-bus:00 lan3: configuring for phy/gmii link mode
<6>[   11.084925] 8021q: adding VLAN 0 to HW filter on device lan3
<6>[   11.100346] br-lan: port 3(lan3) entered blocking state
<6>[   11.102137] mt7530 mdio-bus:00 lan3: Link is Up - 1Gbps/Full - flow control rx/tx
<6>[   11.105607] br-lan: port 3(lan3) entered disabled state
<6>[   11.119428] device lan3 entered promiscuous mode
<6>[   11.131431] br-lan: port 3(lan3) entered blocking state
<6>[   11.136706] br-lan: port 3(lan3) entered forwarding state
<6>[   11.147370] mt7530 mdio-bus:00 lan4: configuring for phy/gmii link mode
<6>[   11.154722] 8021q: adding VLAN 0 to HW filter on device lan4
<6>[   11.159221] mt7530 mdio-bus:00 lan4: Link is Up - 1Gbps/Full - flow control rx/tx
<6>[   11.166831] br-lan: port 4(lan4) entered blocking state
<6>[   11.173085] br-lan: port 4(lan4) entered disabled state
<6>[   11.186029] device lan4 entered promiscuous mode
<6>[   11.194691] br-lan: port 4(lan4) entered blocking state
<6>[   11.199950] br-lan: port 4(lan4) entered forwarding state
<6>[   11.226408] mt7530 mdio-bus:00 wan: configuring for phy/gmii link mode
<6>[   11.234887] 8021q: adding VLAN 0 to HW filter on device wan
<6>[   11.239244] mt7530 mdio-bus:00 wan: Link is Up - 1Gbps/Full - flow control rx/tx
<6>[   11.248247] IPv6: ADDRCONF(NETDEV_CHANGE): wan: link becomes ready
<6>[   12.437902] br-lan: port 5(wlan0) entered blocking state
<6>[   12.443223] br-lan: port 5(wlan0) entered disabled state
<6>[   12.448816] device wlan0 entered promiscuous mode
<6>[   12.453677] br-lan: port 5(wlan0) entered blocking state
<6>[   12.459035] br-lan: port 5(wlan0) entered forwarding state
<6>[   12.466652] br-lan: port 5(wlan0) entered disabled state
<6>[   14.465406] br-lan: port 6(wlan1) entered blocking state
<6>[   14.470742] br-lan: port 6(wlan1) entered disabled state
<6>[   14.476314] device wlan1 entered promiscuous mode
<6>[   14.481189] br-lan: port 6(wlan1) entered blocking state
<6>[   14.486636] br-lan: port 6(wlan1) entered forwarding state
<6>[   14.493089] br-lan: port 6(wlan1) entered disabled state
<6>[   14.608086] IPv6: ADDRCONF(NETDEV_CHANGE): wlan0: link becomes ready
<6>[   14.614608] br-lan: port 5(wlan0) entered blocking state
<6>[   14.619979] br-lan: port 5(wlan0) entered forwarding state
<6>[   80.591257] IPv6: ADDRCONF(NETDEV_CHANGE): wlan1: link becomes ready
<6>[   80.597785] br-lan: port 6(wlan1) entered blocking state
<6>[   80.603095] br-lan: port 6(wlan1) entered forwarding state
<1>[19823.428913] Unable to handle kernel paging request at virtual address dead000000000110
<1>[19823.436835] Mem abort info:
<1>[19823.439643]   ESR = 0x96000004
<1>[19823.442690]   EC = 0x25: DABT (current EL), IL = 32 bits
<1>[19823.447991]   SET = 0, FnV = 0
<1>[19823.451047]   EA = 0, S1PTW = 0
<1>[19823.454178] Data abort info:
<1>[19823.457048]   ISV = 0, ISS = 0x00000004
<1>[19823.460912]   CM = 0, WnR = 0
<1>[19823.463900] [dead000000000110] address between user and kernel address ranges
<0>[19823.471069] Internal error: Oops: 96000004 [#1] SMP
<7>[19823.475939] Modules linked in: xt_connlimit pppoe ppp_async nf_conncount iptable_nat xt_state xt_nat xt_helper xt_conntrack xt_connmark xt_connbytes xt_REDIRECT xt_MASQUERADE xt_FLOWOFFLOAD xt_CT pppox ppp_generic nf_nat nf_flow_table nf_conntrack mt7915e mt7615e mt7615_common mt76_connac_lib mt76 mac80211 ipt_REJECT cfg80211 xt_time xt_tcpudp xt_tcpmss xt_statistic xt_recent xt_multiport xt_mark xt_mac xt_limit xt_length xt_hl xt_ecn xt_dscp xt_comment xt_TCPMSS xt_LOG xt_HL xt_DSCP xt_CLASSIFY slhc sch_cake nf_reject_ipv4 nf_log_ipv4 nf_defrag_ipv6 nf_defrag_ipv4 iptable_raw iptable_mangle iptable_filter ipt_ECN ip_tables hwmon crc_ccitt compat sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 ifb seqiv leds_gpio xhci_plat_hcd gpio_button_hotplug
<7>[19823.559712] CPU: 1 PID: 6834 Comm: kworker/u4:5 Tainted: G S                5.10.79 #0
<7>[19823.567618] Hardware name: Linksys E8450 (UBI) (DT)
<7>[19823.572501] Workqueue: nf_ft_offload_stats nf_flow_table_offload_setup [nf_flow_table]
<7>[19823.580413] pstate: 20000005 (nzCv daif -PAN -UAO -TCO BTYPE=--)
<7>[19823.586412] pc : nf_flow_offload_ip_hook+0x778/0x1340 [nf_flow_table]
<7>[19823.592844] lr : nf_flow_offload_ip_hook+0x78c/0x1340 [nf_flow_table]
<7>[19823.599274] sp : ffffffc013c33c20
<7>[19823.602577] x29: ffffffc013c33c20 x28: 0000000000000000
<7>[19823.607881] x27: ffffff8002aab448 x26: 0000000000000000
<7>[19823.613185] x25: ffffff80012bcd00 x24: ffffffc008b79648
<7>[19823.618490] x23: ffffffc013c33d40 x22: 0000000000000002
<7>[19823.623794] x21: ffffffc008b79638 x20: 0000000000000000
<7>[19823.629098] x19: dead0000000000f0 x18: ffffff8001abf3c0
<7>[19823.634402] x17: 00000000ffffffff x16: 0000000000000000
<7>[19823.639707] x15: 00000000428e5800 x14: 0000000000000780
<7>[19823.645010] x13: ffffffc008b79540 x12: ffffffc010ba62d8
<7>[19823.650314] x11: 0000000000000000 x10: ffffff8000005100
<7>[19823.655617] x9 : ffffff800281b87c x8 : ffffffc013c33cd8
<7>[19823.660921] x7 : 0000000000000000 x6 : ffffffc013c33c98
<7>[19823.666225] x5 : 0000000000000002 x4 : 0000000000000000
<7>[19823.671529] x3 : ffffff8000196300 x2 : 0000000000000000
<7>[19823.676833] x1 : dead000000000100 x0 : 0000000000000001
<7>[19823.682137] Call trace:
<7>[19823.684580]  nf_flow_offload_ip_hook+0x778/0x1340 [nf_flow_table]
<7>[19823.690666]  nf_flow_table_offload_setup+0x468/0x660 [nf_flow_table]
<7>[19823.697012]  process_one_work+0x1d4/0x370
<7>[19823.701013]  worker_thread+0x178/0x4e0
<7>[19823.704754]  kthread+0x120/0x124
<7>[19823.707975]  ret_from_fork+0x10/0x18
<0>[19823.711545] Code: d1004013 eb0002bf 54000580 52800014 (f9401263)
<4>[19823.717630] ---[ end trace a8009286a8ab74bf ]---
Panic#2 Part1
<6>[    8.132441] GACT probability on
<6>[    8.136612] Mirror/redirect action on
<6>[    8.146658] u32 classifier
<6>[    8.149369]     input device check on
<6>[    8.153021]     Actions configured
<6>[    8.163906] Loading modules backported from Linux version v5.15-rc6-0-g519d81956ee2
<6>[    8.171616] Backport generated by backports.git v5.15-rc6-1-0-gd44432d6
<6>[    8.199778] xt_time: kernel timezone is -0000
<7>[    8.262814] ieee80211 phy0: Selected rate control algorithm 'minstrel_ht'
<7>[    8.273804] mt7915e 0000:01:00.0: assign IRQ: got 143
<7>[    8.278978] pci 0000:00:00.0: enabling bus mastering
<6>[    8.283959] mt7915e 0000:01:00.0: enabling device (0000 -> 0002)
<7>[    8.290089] mt7915e 0000:01:00.0: enabling bus mastering
<6>[    8.319516] mt7622-wmac 18000000.wmac: HW/SW Version: 0x8a108a10, Build Time: 20190801210006a
<6>[    8.319516]
<6>[    8.368485] mt7915e 0000:01:00.0: HW/SW Version: 0x8a108a10, Build Time: 20201105222230a
<6>[    8.368485]
<6>[    8.415760] mt7622-wmac 18000000.wmac: N9 Firmware Version: 2.0, Build Time: 20200131180931
<6>[    8.528942] mt7915e 0000:01:00.0: WM Firmware Version: ____000000, Build Time: 20201105222304
<6>[    8.586680] mt7915e 0000:01:00.0: WA Firmware Version: DEV_000000, Build Time: 20201105222323
<6>[    8.712478] PPP generic driver version 2.4.2
<6>[    8.718297] NET: Registered protocol family 24
<14>[    8.735304] kmodloader: done loading kernel modules from /etc/modules.d/*
<6>[   10.927954] mtk_soc_eth 1b100000.ethernet eth0: Link is Down
<6>[   10.939037] mtk_soc_eth 1b100000.ethernet eth0: configuring for fixed/2500base-x link mode
<6>[   10.947466] mtk_soc_eth 1b100000.ethernet eth0: Link is Up - 2.5Gbps/Full - flow control rx/tx
<6>[   10.949038] mt7530 mdio-bus:00 lan1: configuring for phy/gmii link mode
<6>[   10.963449] 8021q: adding VLAN 0 to HW filter on device lan1
<6>[   10.971691] br-lan: port 1(lan1) entered blocking state
<6>[   10.977000] br-lan: port 1(lan1) entered disabled state
<6>[   10.983021] device lan1 entered promiscuous mode
<6>[   10.987737] device eth0 entered promiscuous mode
<6>[   10.995419] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
<6>[   11.010630] mt7530 mdio-bus:00 lan2: configuring for phy/gmii link mode
<6>[   11.017852] 8021q: adding VLAN 0 to HW filter on device lan2
<6>[   11.022153] mt7530 mdio-bus:00 lan2: Link is Up - 1Gbps/Full - flow control rx/tx
<6>[   11.027281] br-lan: port 2(lan2) entered blocking state
<6>[   11.036314] br-lan: port 2(lan2) entered disabled state
<6>[   11.043621] device lan2 entered promiscuous mode
<6>[   11.053814] br-lan: port 2(lan2) entered blocking state
<6>[   11.059100] br-lan: port 2(lan2) entered forwarding state
<6>[   11.065585] IPv6: ADDRCONF(NETDEV_CHANGE): br-lan: link becomes ready
<6>[   11.077761] mt7530 mdio-bus:00 lan3: configuring for phy/gmii link mode
<6>[   11.084925] 8021q: adding VLAN 0 to HW filter on device lan3
<6>[   11.100346] br-lan: port 3(lan3) entered blocking state
<6>[   11.102137] mt7530 mdio-bus:00 lan3: Link is Up - 1Gbps/Full - flow control rx/tx
<6>[   11.105607] br-lan: port 3(lan3) entered disabled state
<6>[   11.119428] device lan3 entered promiscuous mode
<6>[   11.131431] br-lan: port 3(lan3) entered blocking state
<6>[   11.136706] br-lan: port 3(lan3) entered forwarding state
<6>[   11.147370] mt7530 mdio-bus:00 lan4: configuring for phy/gmii link mode
<6>[   11.154722] 8021q: adding VLAN 0 to HW filter on device lan4
<6>[   11.159221] mt7530 mdio-bus:00 lan4: Link is Up - 1Gbps/Full - flow control rx/tx
<6>[   11.166831] br-lan: port 4(lan4) entered blocking state
<6>[   11.173085] br-lan: port 4(lan4) entered disabled state
<6>[   11.186029] device lan4 entered promiscuous mode
<6>[   11.194691] br-lan: port 4(lan4) entered blocking state
<6>[   11.199950] br-lan: port 4(lan4) entered forwarding state
<6>[   11.226408] mt7530 mdio-bus:00 wan: configuring for phy/gmii link mode
<6>[   11.234887] 8021q: adding VLAN 0 to HW filter on device wan
<6>[   11.239244] mt7530 mdio-bus:00 wan: Link is Up - 1Gbps/Full - flow control rx/tx
<6>[   11.248247] IPv6: ADDRCONF(NETDEV_CHANGE): wan: link becomes ready
<6>[   12.437902] br-lan: port 5(wlan0) entered blocking state
<6>[   12.443223] br-lan: port 5(wlan0) entered disabled state
<6>[   12.448816] device wlan0 entered promiscuous mode
<6>[   12.453677] br-lan: port 5(wlan0) entered blocking state
<6>[   12.459035] br-lan: port 5(wlan0) entered forwarding state
<6>[   12.466652] br-lan: port 5(wlan0) entered disabled state
<6>[   14.465406] br-lan: port 6(wlan1) entered blocking state
<6>[   14.470742] br-lan: port 6(wlan1) entered disabled state
<6>[   14.476314] device wlan1 entered promiscuous mode
<6>[   14.481189] br-lan: port 6(wlan1) entered blocking state
<6>[   14.486636] br-lan: port 6(wlan1) entered forwarding state
<6>[   14.493089] br-lan: port 6(wlan1) entered disabled state
<6>[   14.608086] IPv6: ADDRCONF(NETDEV_CHANGE): wlan0: link becomes ready
<6>[   14.614608] br-lan: port 5(wlan0) entered blocking state
<6>[   14.619979] br-lan: port 5(wlan0) entered forwarding state
<6>[   80.591257] IPv6: ADDRCONF(NETDEV_CHANGE): wlan1: link becomes ready
<6>[   80.597785] br-lan: port 6(wlan1) entered blocking state
<6>[   80.603095] br-lan: port 6(wlan1) entered forwarding state
<1>[19823.428913] Unable to handle kernel paging request at virtual address dead000000000110
<1>[19823.436835] Mem abort info:
<1>[19823.439643]   ESR = 0x96000004
<1>[19823.442690]   EC = 0x25: DABT (current EL), IL = 32 bits
<1>[19823.447991]   SET = 0, FnV = 0
<1>[19823.451047]   EA = 0, S1PTW = 0
<1>[19823.454178] Data abort info:
<1>[19823.457048]   ISV = 0, ISS = 0x00000004
<1>[19823.460912]   CM = 0, WnR = 0
<1>[19823.463900] [dead000000000110] address between user and kernel address ranges
<0>[19823.471069] Internal error: Oops: 96000004 [#1] SMP
<7>[19823.475939] Modules linked in: xt_connlimit pppoe ppp_async nf_conncount iptable_nat xt_state xt_nat xt_helper xt_conntrack xt_connmark xt_connbytes xt_REDIRECT xt_MASQUERADE xt_FLOWOFFLOAD xt_CT pppox ppp_generic nf_nat nf_flow_table nf_conntrack mt7915e mt7615e mt7615_common mt76_connac_lib mt76 mac80211 ipt_REJECT cfg80211 xt_time xt_tcpudp xt_tcpmss xt_statistic xt_recent xt_multiport xt_mark xt_mac xt_limit xt_length xt_hl xt_ecn xt_dscp xt_comment xt_TCPMSS xt_LOG xt_HL xt_DSCP xt_CLASSIFY slhc sch_cake nf_reject_ipv4 nf_log_ipv4 nf_defrag_ipv6 nf_defrag_ipv4 iptable_raw iptable_mangle iptable_filter ipt_ECN ip_tables hwmon crc_ccitt compat sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 ifb seqiv leds_gpio xhci_plat_hcd gpio_button_hotplug
<7>[19823.559712] CPU: 1 PID: 6834 Comm: kworker/u4:5 Tainted: G S                5.10.79 #0
<7>[19823.567618] Hardware name: Linksys E8450 (UBI) (DT)
<7>[19823.572501] Workqueue: nf_ft_offload_stats nf_flow_table_offload_setup [nf_flow_table]
<7>[19823.580413] pstate: 20000005 (nzCv daif -PAN -UAO -TCO BTYPE=--)
<7>[19823.586412] pc : nf_flow_offload_ip_hook+0x778/0x1340 [nf_flow_table]
<7>[19823.592844] lr : nf_flow_offload_ip_hook+0x78c/0x1340 [nf_flow_table]
<7>[19823.599274] sp : ffffffc013c33c20
<7>[19823.602577] x29: ffffffc013c33c20 x28: 0000000000000000
<7>[19823.607881] x27: ffffff8002aab448 x26: 0000000000000000
<7>[19823.613185] x25: ffffff80012bcd00 x24: ffffffc008b79648
<7>[19823.618490] x23: ffffffc013c33d40 x22: 0000000000000002
<7>[19823.623794] x21: ffffffc008b79638 x20: 0000000000000000
<7>[19823.629098] x19: dead0000000000f0 x18: ffffff8001abf3c0
<7>[19823.634402] x17: 00000000ffffffff x16: 0000000000000000
<7>[19823.639707] x15: 00000000428e5800 x14: 0000000000000780
<7>[19823.645010] x13: ffffffc008b79540 x12: ffffffc010ba62d8
<7>[19823.650314] x11: 0000000000000000 x10: ffffff8000005100
<7>[19823.655617] x9 : ffffff800281b87c x8 : ffffffc013c33cd8
<7>[19823.660921] x7 : 0000000000000000 x6 : ffffffc013c33c98
<7>[19823.666225] x5 : 0000000000000002 x4 : 0000000000000000
<7>[19823.671529] x3 : ffffff8000196300 x2 : 0000000000000000
<7>[19823.676833] x1 : dead000000000100 x0 : 0000000000000001
<7>[19823.682137] Call trace:
<7>[19823.684580]  nf_flow_offload_ip_hook+0x778/0x1340 [nf_flow_table]
<7>[19823.690666]  nf_flow_table_offload_setup+0x468/0x660 [nf_flow_table]
<7>[19823.697012]  process_one_work+0x1d4/0x370
<7>[19823.701013]  worker_thread+0x178/0x4e0
<7>[19823.704754]  kthread+0x120/0x124
<7>[19823.707975]  ret_from_fork+0x10/0x18
<0>[19823.711545] Code: d1004013 eb0002bf 54000580 52800014 (f9401263)
<4>[19823.717630] ---[ end trace a8009286a8ab74bf ]---
<0>[19823.728315] Kernel panic - not syncing: Oops: Fatal exception
<2>[19823.734060] SMP: stopping secondary CPUs
<0>[19823.737978] Kernel Offset: disabled
<0>[19823.741458] CPU features: 0x0000002,04002004
<0>[19823.745718] Memory Limit: none

Here's my general setup:

-Country code is set to US
-I use wpad-mesh-wolfssl
-I use channel 100 since i live in a condo complex. For troubleshooting, i tried all available 80MHz channels
-Running at 80MHz, but for testing I tried 40 and 20 just to see if it would change anything
-I tried changing the standard from AX, to AC, or N and no resolution.
-All three are setup to be access points on the AX radio as well as mesh on that same radio. The router is the only one enabled on the 2.4G radio

I'm glad I tired BATMAN again, that really helped me diagnose the culprit node. It turns out the problem node was setup as my router and the likely reason for the system feeling like it was falling asleep. I moved that one to be a remote node for future testing.

1 Like

Definitely use the openssl library not wolfssl. I've had problems with wpad-wolfssl as an Enterprise client, switching to openssl solved it.

1 Like

Dear @smileys29

Very sorry to hear about your problem here. Absent it being a hardware issue, it seems prospects are very good for resolving this.

So I did have a serious problem with one of my mesh units in which often when I rebooted the problem node its 5Ghz WiFi would not come up. I identified this by plugging in my laptop and setting its LAN IP and subnet to a fixed value. Then read the router logs to see what was happening. Turned out to be a hardware fault or something to do with WiFi calibration data missing. It was always the same unit. And replacing the unit sorted the problem.

Can you not similarly log into the node that is not connecting properly and see what the logs show?

Another problem I had was when I upgraded to the new installer I had messed up a few of the basic configuration settings like disabling DHCP and setting the country code. Also needed the DNS forwarding set to the main router.

I think it is working now but I haven't tested properly as I am away from home. But tonight on my return I should know if it is working as it should be.

You have set the mesh node to use SAE encryption and with lan for the firewall zone? Presumably not relevant but I have my 2.4Ghz WiFi set to 40Mhz with force 40 enabled.

Looks like my stacktrace have different issue than @Psychedelic.

stacktrace
Sun Nov 14 21:35:07 2021 kern.warn kernel: [ 1014.119136] ------------[ cut here ]------------                                                                                                                                                                                                                                               
Sun Nov 14 21:35:07 2021 kern.info kernel: [ 1014.123778] NETDEV WATCHDOG: eth0 (mtk_soc_eth): transmit queue 0 timed out                                                                                                                                                                                                                    
Sun Nov 14 21:35:07 2021 kern.warn kernel: [ 1014.130830] WARNING: CPU: 0 PID: 5403 at dev_watchdog+0x2a8/0x2b0                                                                                                                                                                                                                              
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.136915] Modules linked in: pppoe ppp_async iptable_nat xt_state xt_nat xt_conntrack xt_REDIRECT xt_MASQUERADE xt_FLOWOFFLOAD xt_CT pppox ppp_generic nf_nat nf_flow_table nf_conntrack mt7915e mt7615e mt7615_common mt76_connac_lib mt76 mac80211 ipt_REJECT cfg80211 xt_time xt_tcpudp x
t_multiport xt_mark xt_mac xt_limit xt_comment xt_TCPMSS xt_LOG slhc nf_reject_ipv4 nf_log_ipv4 nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_filter ip_tables hwmon crc_ccitt compat nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 vfat fat autofs4 nls_utf8 nls_iso8859_1
 nls_cp437 seqiv uas usb_storage leds_gpio xhci_plat_hcd gpio_button_hotplug exfat                                                                                                                                                                                                                                                           
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.198337] CPU: 0 PID: 5403 Comm: sh Tainted: G S                5.10.79 #0                                                                                                                                                                                                                  
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.205375] Hardware name: Linksys E8450 (UBI) (DT)                                                                                                                                                                                                                                           
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.210244] pstate: 40000005 (nZcv daif -PAN -UAO -TCO BTYPE=--)                                                                                                                                                                                                                              
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.216244] pc : dev_watchdog+0x2a8/0x2b0                                                                                                                                                                                                                                                     
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.220246] lr : dev_watchdog+0x2a8/0x2b0                                                                                                                                                                                                                                                     
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.224245] sp : ffffffc010bcbd80                                                                                                                                                                                                                                                             
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.227550] x29: ffffffc010bcbd80 x28: ffffffc010a96980                                                                                                                                                                                                                                       
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.232855] x27: 0000000000000140 x26: 00000000ffffffff                                                                                                                                                                                                                                       
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.238160] x25: 0000000000000000 x24: 0000000000000000                                                                                                                                                                                                                                       
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.243464] x23: ffffff8000c45480 x22: 0000000000000001                                                                                                                                                                                                                                       
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.248768] x21: ffffffc010a96000 x20: ffffff8000c45000                                                                                                                                                                                                                                       
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.254073] x19: 0000000000000000 x18: 000000000000015a                                                                                                                                                                                                                                       
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.259376] x17: 0000000000000013 x16: 0000019b7c6906a4                                                                                                                                                                                                                                       
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.264680] x15: ffffffc010aa6a50 x14: 000000000000040e                                                                                                                                                                                                                                       
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.269984] x13: 000000000000015a x12: ffffffc010bcba58                                                                                                                                                                                                                                       
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.275288] x11: ffffffc010afea50 x10: 00000000fffff000                                                                                                                                                                                                                                       
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.280592] x9 : ffffffc010afea50 x8 : 0000000000000000                                                                                                                                                                                                                                       
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.285895] x7 : ffffffc010aa6a50 x6 : 0000000000000001                                                                                                                                                                                                                                       
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.291199] x5 : 0000000000000000 x4 : 0000000000000000                                                                                                                                                                                                                                       
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.296502] x3 : 0000000000000000 x2 : ffffff801feb9028                                                                                                                                                                                                                                       
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.301806] x1 : ffffffc00f435000 x0 : 000000000000003f                                                                
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.307109] Call trace:           
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.309549]  dev_watchdog+0x2a8/0x2b0
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.313206]  call_timer_fn.constprop.0+0x20/0x80
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.317815]  __run_timers.part.0+0x210/0x280
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.322075]  run_timer_softirq+0x38/0x70
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.325989]  _stext+0x124/0x28c
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.329123]  irq_exit+0xd8/0xf4    
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.332257]  __handle_domain_irq+0x7c/0xdc
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.336346]  gic_handle_irq+0x68/0x8c
Sun Nov 14 21:35:07 2021 kern.debug kernel: [ 1014.339999]  el0_irq_naked+0x4c/0x54          
Sun Nov 14 21:35:07 2021 kern.warn kernel: [ 1014.343564] ---[ end trace 40989abbef8e9b35 ]---
Sun Nov 14 21:35:07 2021 kern.err kernel: [ 1014.348255] mtk_soc_eth 1b100000.ethernet eth0: transmit timed out                                                       
Sun Nov 14 21:35:07 2021 kern.info kernel: [ 1014.354545] mtk_soc_eth 1b100000.ethernet eth0: Link is Down
Sun Nov 14 21:35:07 2021 kern.info kernel: [ 1014.385758] mtk_soc_eth 1b100000.ethernet eth0: configuring for fixed/2500base-x link mode
Sun Nov 14 21:35:07 2021 kern.info kernel: [ 1014.394114] mtk_soc_eth 1b100000.ethernet eth0: Link is Up - 2.5Gbps/Full - flow control rx/tx                          
Sun Nov 14 21:35:07 2021 user.info adblock-4.1.3[5403]: adblock instance started ::: action: start, priority: 0, pid: 5403
Sun Nov 14 21:35:08 2021 daemon.notice pppd[2423]: Connection terminated.                                                                                             

I tried to reproduce this error but can't. The change what I did from last crash is clone WAN MAC address from old router, as I supposed that ISP close session from their side because new device is connected.
Anyway it shouldn't crash.

Edit: I just notice that this crash happened in adblock process [pid 5403]. What is weird that PPPoE session can't be restored after this crash.

This morning i've tried building a f/w based on OpenSSL as recommended above using my 802.11s configuration. This works for a few minutes and then the mesh connection fades with extremely high ping times or destination unreachable.

I have been getting this dump for a long time, but was never an issue with the performance of the mesh. I don't get the dump when i use BATMAN:

Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.586480] ------------[ cut here ]------------
Wed Nov 17 10:40:36 2021 kern.warn kernel: [  142.591114] WARNING: CPU: 1 PID: 1108 at __skb_flow_dissect+0x1a0/0x13dc
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.597805] Modules linked in: pppoe ppp_async iptable_nat batman_adv xt_state xt_nat xt_conntrack xt_REDIRECT xt_MASQUERADE xt_FLOWOFFLOAD xt_CT wireguard pppox ppp_generic nf_nat nf_flow_table nf_conntrack mt7915e mt7615e mt7615_common mt76_connac_lib mt76 mac80211 libchacha20poly1305 libblake2s ipt_REJECT chacha_neon cfg80211 xt_time xt_tcpudp xt_multiport xt_mark xt_mac xt_limit xt_comment xt_TCPMSS xt_LOG slhc poly1305_neon nf_reject_ipv4 nf_log_ipv4 nf_defrag_ipv6 nf_defrag_ipv4 libcurve25519_generic libcrc32c libchacha libblake2s_generic iptable_mangle iptable_filter ip_tables hwmon crc_ccitt compat nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 ip6_udp_tunnel udp_tunnel seqiv leds_gpio xhci_plat_hcd gpio_button_hotplug
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.667303] CPU: 1 PID: 1108 Comm: napi/phy1-7 Tainted: G S                5.10.79 #0
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.675122] Hardware name: Linksys E8450 (UBI) (DT)
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.679992] pstate: 00000005 (nzcv daif -PAN -UAO -TCO BTYPE=--)
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.685990] pc : __skb_flow_dissect+0x1a0/0x13dc
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.690599] lr : __skb_get_hash+0x6c/0x130
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.694684] sp : ffffffc010dcb9a0
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.697989] x29: ffffffc010dcb9a0 x28: 0000000000000000
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.703294] x27: 0000000000000000 x26: 0000000000000008
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.708598] x25: 0000000000000000 x24: ffffff8002b45c18
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.713902] x23: 000000000000005f x22: ffffffc010dcbb10
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.719206] x21: 000000000000ffba x20: ffffffc010a99580
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.724510] x19: ffffff800277ea00 x18: 00001d0fe6472a00
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.729814] x17: 0000000000000011 x16: ffffffc0107f83e0
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.735118] x15: 0000000000000001 x14: 0000000000000070
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.740422] x13: 0000000000000080 x12: ffffffc010878040
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.745726] x11: 0000000000000000 x10: 0000000000000001
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.751030] x9 : 0000000000000002 x8 : ffffff8000831600
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.756334] x7 : 0000000000000000 x6 : 0000000000000000
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.761637] x5 : 0000000000000000 x4 : 0000000000000000
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.766941] x3 : ffffffc010dcbb10 x2 : 0000000000000000
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.772244] x1 : 0000000000000000 x0 : 0000000000000000
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.777549] Call trace:
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.779988]  __skb_flow_dissect+0x1a0/0x13dc
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.784249]  __skb_get_hash+0x6c/0x130
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.788016]  ieee80211_schedule_txq+0x784/0x9dc [mac80211]
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.793502]  ieee80211_schedule_txq+0x974/0x9dc [mac80211]
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.798988]  ieee80211_tx_pending+0xe0/0x24c [mac80211]
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.804206]  tasklet_action_common.constprop.0+0x134/0x17c
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.809683]  tasklet_action+0x24/0x30
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.813336]  _stext+0x124/0x28c
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.816469]  do_softirq+0x74/0x80
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.819776]  __local_bh_enable_ip+0x88/0x90
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.823952]  napi_threaded_poll+0x94/0xf0
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.827955]  kthread+0x120/0x124
Wed Nov 17 10:40:36 2021 kern.debug kernel: [  142.831174]  ret_from_fork+0x10/0x18
Wed Nov 17 10:40:36 2021 kern.warn kernel: [  142.834739] ---[ end trace 47c4e65a92614880 ]---

I don't have VLAN's setup, all traffic on the 'lan' so no special firewall rules in place. SAE encryption is what I'm setup for, but tempted to use no encryption to see what that does.

Thanks!

I believe the crash report is normal for all users of mesh. It's nothing to do with strength of connection between nodes? Mine are less than -60dB. My extension nodes are either side of my main router which sits in the middle. Is that what you have too?

Update: OK yes my mesh is definitely broken. :frowning:

What happens is that after a while I can no longer access one of my extension nodes. The main router reports both extension nodes as still connected. Mesh can only support two nodes not three.

What should I do to diagnose?

@smileys29 so we are in same boat now. I also have 3x in mesh and it all worked perfectly before.

@danitool we can rule out upgrade with new installer messing about with WiFi calibration data or something like that?

So this is related to snapshot changes?

How can I go back to an old snapshot easily? Can I use auc to make build with custom packages with old snapshot?

@smileys29 any progress?

@danitool could this be because we upgraded installer and somehow this messed up WiFi calibration or the like?

Unfortunately not able to figure out what's going on. Logs from the good and bad device show no issues with the mesh. I would expect some sort of failure or mesh disconnect, but those aren't present. I'm hoping there's a way to setup a debug mode, but not sure how to do that.

Today, i reverted just the culprit node back to my older firmware with the other two on new. That completely messed things up. So, i'm just running the two nodes to see if there's any stability issues. If someone has recommendations on how to setup a debug mode, let me know.

I am wondering if this could be because we both upgraded from the old v0.5.3 installer to the new v0.6 installer? And this resulted in some 5Ghz WiFi instability which rendered mesh unstable?

If iw list shows the 5 GHz / HE PHY only if the calibration data was read correctly from flash. And this is a binary value, ie. it's either true or false, there is (almost) nothing in between (because calibration data comes with a checksum which either matches or doesn't).

However, there have been some massive updates to mt76 in between the v0.5.3 and v0.6.0 release of the installer and probably the latest mt76 feature update (which also deals with flow offloading) broke things for mesh. Hence, please check if this crash (including all logs and detailed version info) has already been reported at https://github.com/openwrt/mt76 and if not, please do so.

1 Like

Sorry to be dense, but is this enough to show correct reading from flash?

root@OpenWrt:~# iw list |grep -i 5Ghz
                                HE40/HE80/5GHz
                                HE160/5GHz
                                HE160/HE80+80/5GHz
                                242 tone RUs/5GHz
                                HE40/HE80/5GHz
                                HE160/5GHz
                                HE160/HE80+80/5GHz
                                HE40/HE80/5GHz
                                HE160/5GHz
                                HE160/HE80+80/5GHz

If so, I will verify all three of my nodes show this.

Basically yes, that shows that MT7915E has probed which it wouldn't if getting the EEPROM data would have caused read errors. To be really sure just check if kernel log (dmesg) looks clean, ie. no mtd read errors what so ever.

1 Like

Thank you @daniel. Does this look OK:

BusyBox v1.34.1 (2021-11-16 09:48:45 UTC) built-in shell (ash)

  _______                     ________        __
 |       |.-----.-----.-----.|  |  |  |.----.|  |_
 |   -   ||  _  |  -__|     ||  |  |  ||   _||   _|
 |_______||   __|_____|__|__||________||__|  |____|
          |__| W I R E L E S S   F R E E D O M
 -----------------------------------------------------
 OpenWrt SNAPSHOT, r18107-db34b93331
 -----------------------------------------------------
root@OpenWrt:~# dmesg
[    0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd034]
[    0.000000] Linux version 5.10.79 (builder@buildhost) (aarch64-openwrt-linux-musl-gcc (OpenWrt GCC 11.2.0 r18107-db34b93331) 11.2.0, GNU ld (GNU Binutils) 2.37) #0 SMP Tue Nov 16 21:02:45 2021
[    0.000000] Machine model: Linksys E8450 (UBI)
[    0.000000] earlycon: uart8250 at MMIO32 0x0000000011002000 (options '')
[    0.000000] printk: bootconsole [uart8250] enabled
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000040000000-0x000000005fffffff]
[    0.000000]   DMA32    empty
[    0.000000]   Normal   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000040000000-0x0000000042ffffff]
[    0.000000]   node   0: [mem 0x0000000043000000-0x000000004302ffff]
[    0.000000]   node   0: [mem 0x0000000043030000-0x000000005fffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000005fffffff]
[    0.000000] On node 0 totalpages: 131072
[    0.000000]   DMA zone: 2048 pages used for memmap
[    0.000000]   DMA zone: 0 pages reserved
[    0.000000]   DMA zone: 131072 pages, LIFO batch:31
[    0.000000] psci: probing for conduit method from DT.
[    0.000000] psci: PSCIv1.1 detected in firmware.
[    0.000000] psci: Using standard PSCI v0.2 function IDs
[    0.000000] psci: MIGRATE_INFO_TYPE not supported.
[    0.000000] psci: SMC Calling Convention v1.2
[    0.000000] percpu: Embedded 20 pages/cpu s43864 r8192 d29864 u81920
[    0.000000] pcpu-alloc: s43864 r8192 d29864 u81920 alloc=20*4096
[    0.000000] pcpu-alloc: [0] 0 [0] 1
[    0.000000] Detected VIPT I-cache on CPU0
[    0.000000] CPU features: detected: ARM erratum 845719
[    0.000000] CPU features: kernel page table isolation disabled by kernel configuration
[    0.000000] CPU features: detected: ARM erratum 843419
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 129024
[    0.000000] Kernel command line: earlycon=uart8250,mmio32,0x11002000 console=ttyS0,115200n1 swiotlb=512
[    0.000000] Dentry cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.000000] Inode-cache hash table entries: 32768 (order: 6, 262144 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] Memory: 493488K/524288K available (8126K kernel code, 876K rwdata, 2220K rodata, 448K init, 302K bss, 30800K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
[    0.000000] rcu: Hierarchical RCU implementation.
[    0.000000]  Tracing variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 10 jiffies.
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] GIC: GICv2 detected, but range too small and irqchip.gicv2_force_probe not set
[    0.000000] random: get_random_bytes called from start_kernel+0x340/0x484 with crng_init=0
[    0.000000] arch_timer: cp15 timer(s) running at 12.50MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x2e2049cda, max_idle_ns: 440795202628 ns
[    0.000003] sched_clock: 56 bits at 12MHz, resolution 80ns, wraps every 4398046511080ns
[    0.008492] Calibrating delay loop (skipped), value calculated using timer frequency.. 25.00 BogoMIPS (lpj=125000)
[    0.019222] pid_max: default: 32768 minimum: 301
[    0.024078] Mount-cache hash table entries: 1024 (order: 1, 8192 bytes, linear)
[    0.031656] Mountpoint-cache hash table entries: 1024 (order: 1, 8192 bytes, linear)
[    0.040653] rcu: Hierarchical SRCU implementation.
[    0.045742] dyndbg: Ignore empty _ddebug table in a CONFIG_DYNAMIC_DEBUG_CORE build
[    0.053968] smp: Bringing up secondary CPUs ...
[    0.058984] Detected VIPT I-cache on CPU1
[    0.058991] CPU features: SANITY CHECK: Unexpected variation in SYS_CNTFRQ_EL0. Boot CPU: 0x00000000bebc20, CPU1: 0x00000000000000
[    0.059006] CPU features: Unsupported CPU feature variation detected.
[    0.059037] CPU1: Booted secondary processor 0x0000000001 [0x410fd034]
[    0.059106] smp: Brought up 1 node, 2 CPUs
[    0.093091] SMP: Total of 2 processors activated.
[    0.097959] CPU features: detected: 32-bit EL0 Support
[    0.103281] CPU features: detected: CRC32 instructions
[    0.108705] CPU: All CPU(s) started at EL2
[    0.112948] alternatives: patching kernel code
[    0.120913] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.131132] futex hash table entries: 512 (order: 3, 32768 bytes, linear)
[    0.138249] pinctrl core: initialized pinctrl subsystem
[    0.144760] NET: Registered protocol family 16
[    0.149778] DMA: preallocated 128 KiB GFP_KERNEL pool for atomic allocations
[    0.157131] DMA: preallocated 128 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    0.165167] DMA: preallocated 128 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    0.173731] thermal_sys: Registered thermal governor 'fair_share'
[    0.173736] thermal_sys: Registered thermal governor 'bang_bang'
[    0.180049] thermal_sys: Registered thermal governor 'step_wise'
[    0.186299] thermal_sys: Registered thermal governor 'user_space'
[    0.192798] ASID allocator initialised with 65536 entries
[    0.205235] pstore: Registered ramoops as persistent store backend
[    0.211672] ramoops: using 0x10000@0x42ff0000, ecc: 0
[    0.248329] SCSI subsystem initialized
[    0.252521] libata version 3.00 loaded.
[    0.256647] usbcore: registered new interface driver usbfs
[    0.262447] usbcore: registered new interface driver hub
[    0.267991] usbcore: registered new device driver usb
[    0.275430] clocksource: Switched to clocksource arch_sys_counter
[    0.282406] NET: Registered protocol family 2
[    0.287075] IP idents hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.295003] tcp_listen_portaddr_hash hash table entries: 256 (order: 0, 4096 bytes, linear)
[    0.303698] TCP established hash table entries: 4096 (order: 3, 32768 bytes, linear)
[    0.311767] TCP bind hash table entries: 4096 (order: 4, 65536 bytes, linear)
[    0.319208] TCP: Hash tables configured (established 4096 bind 4096)
[    0.325876] UDP hash table entries: 256 (order: 1, 8192 bytes, linear)
[    0.332648] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes, linear)
[    0.339979] NET: Registered protocol family 1
[    0.344505] PCI: CLS 0 bytes, default 64
[    0.349704] workingset: timestamp_bits=46 max_order=17 bucket_order=0
[    0.359011] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.365058] jffs2: version 2.2 (NAND) (SUMMARY) (LZMA) (RTIME) (CMODE_PRIORITY) (c) 2001-2006 Red Hat, Inc.
[    0.408125] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250)[    0.416328] mtk-tphy 1a0c4000.usb-phy: failed to get ref_clk(id-1)
[    0.428262] mt-pmic-pwrap 10001000.pwrap: unexpected interrupt int=0x1
[    0.443158] Serial: 8250/16550 driver, 16 ports, IRQ sharing enabled
[    0.451825] printk: console [ttyS0] disabled
[    0.456347] 11002000.serial: ttyS0 at MMIO 0x11002000 (irq = 22, base_baud = 1562500) is a 16550A
[    0.465573] printk: console [ttyS0] enabled
[    0.473937] printk: bootconsole [uart8250] disabled
[    0.484359] 11004000.serial: ttyS1 at MMIO 0x11004000 (irq = 23, base_baud = 1562500) is a 16550A
[    0.494094] 1100c000.serial: ttyS2 at MMIO 0x1100c000 (irq = 27, base_baud = 17499995) is a MediaTek BTIF
[    0.503818] serial serial0: tty port ttyS2 registered
[    0.509586] mtk_rng 1020f000.rng: registered RNG driver
[    0.509598] hwrng: no data available
[    0.518563] cacheinfo: Unable to detect cache hierarchy for CPU 0
[    0.527783] loop: module loaded
[    0.530929] Loading iSCSI transport class v2.0-870.
[    0.537593] mtk-snand 1100d000.snfi: chip is FM35Q1GA, size 128MB, page size 2048, oob size 64
[    0.546436] 4 fixed-partitions partitions found on MTD device 1100d000.snfi
[    0.553395] Creating 4 MTD partitions on "1100d000.snfi":
[    0.558838] 0x000000000000-0x000000080000 : "bl2"
[    0.564461] 0x000000080000-0x0000001c0000 : "fip"
[    0.570818] 0x0000001c0000-0x0000002c0000 : "factory"
[    0.577308] 0x000000300000-0x000008000000 : "ubi"
[    0.610809] random: fast init done
[    0.717891] libphy: Fixed MDIO Bus: probed
[    0.745960] libphy: mdio: probed
[    0.750484] mtk_soc_eth 1b100000.ethernet eth0: mediatek frame engine at 0xffffffc011b60000, irq 35
[    0.761116] i2c /dev entries driver
[    0.765871] mtk-wdt 10212000.watchdog: Watchdog enabled (timeout=31 sec, nowayout=0)
[    0.777321] NET: Registered protocol family 10
[    0.782574] Segment Routing with IPv6
[    0.786314] NET: Registered protocol family 17
[    0.790806] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[    0.803903] 8021q: 802.1Q VLAN Support v1.8
[    0.809256] pstore: Using crash dump compression: deflate
[    0.824575] mtk-pcie 1a143000.pcie: host bridge /pcie@1a143000 ranges:
[    0.831140] mtk-pcie 1a143000.pcie: Parsing ranges property...
[    0.836988] mtk-pcie 1a143000.pcie:      MEM 0x0020000000..0x0027ffffff -> 0x0020000000
[    0.861550] mtk-pcie 1a143000.pcie: PCI host bridge to bus 0000:00
[    0.867756] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.873235] pci_bus 0000:00: root bus resource [mem 0x20000000-0x27ffffff]
[    0.880107] pci_bus 0000:00: scanning bus
[    0.884153] pci 0000:00:00.0: [14c3:3258] type 01 class 0x060400
[    0.890183] pci 0000:00:00.0: reg 0x10: [mem 0x00000000-0x1ffffffff 64bit pref]
[    0.899119] pci_bus 0000:00: fixups for bus
[    0.903309] pci 0000:00:00.0: scanning [bus 00-00] behind bridge, pass 0
[    0.910015] pci 0000:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    0.918032] pci 0000:00:00.0: scanning [bus 00-00] behind bridge, pass 1
[    0.924861] pci_bus 0000:01: scanning bus
[    0.929093] pci 0000:01:00.0: [14c3:7915] type 00 class 0x000280
[    0.935273] pci 0000:01:00.0: reg 0x10: [mem 0x00000000-0x000fffff 64bit pref]
[    0.942597] pci 0000:01:00.0: reg 0x18: [mem 0x00000000-0x00003fff 64bit pref]
[    0.949920] pci 0000:01:00.0: reg 0x20: [mem 0x00000000-0x00000fff 64bit pref]
[    0.957884] pci 0000:01:00.0: supports D1 D2
[    0.962146] pci 0000:01:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.968779] pci 0000:01:00.0: PME# disabled
[    0.973259] pci 0000:01:00.0: 2.000 Gb/s available PCIe bandwidth, limited by 2.5 GT/s PCIe x1 link at 0000:00:00.0 (capable of 4.000 Gb/s with 5.0 GT/s PCIe x1 link)
[    1.016795] pci_bus 0000:01: fixups for bus
[    1.020982] pci_bus 0000:01: bus scan returning with max=01
[    1.026569] pci_bus 0000:01: busn_res: [bus 01-ff] end is updated to 01
[    1.033180] pci_bus 0000:00: bus scan returning with max=01
[    1.038767] pci 0000:00:00.0: BAR 0: no space for [mem size 0x200000000 64bit pref]
[    1.046419] pci 0000:00:00.0: BAR 0: failed to assign [mem size 0x200000000 64bit pref]
[    1.054415] pci 0000:00:00.0: BAR 8: assigned [mem 0x20000000-0x201fffff]
[    1.061201] pci 0000:01:00.0: BAR 0: assigned [mem 0x20000000-0x200fffff 64bit pref]
[    1.069025] pci 0000:01:00.0: BAR 2: assigned [mem 0x20100000-0x20103fff 64bit pref]
[    1.076851] pci 0000:01:00.0: BAR 4: assigned [mem 0x20104000-0x20104fff 64bit pref]
[    1.084667] pci 0000:00:00.0: PCI bridge to [bus 01]
[    1.089632] pci 0000:00:00.0:   bridge window [mem 0x20000000-0x201fffff]
[    1.096516] pcieport 0000:00:00.0: of_irq_parse_pci: failed with rc=-22
[    1.103121] pcieport 0000:00:00.0: assign IRQ: got 0
[    1.108094] pcieport 0000:00:00.0: enabling device (0000 -> 0002)
[    1.114198] pcieport 0000:00:00.0: enabling bus mastering
[    1.120118] mtk-pcie 1a145000.pcie: host bridge /pcie@1a145000 ranges:
[    1.126668] mtk-pcie 1a145000.pcie: Parsing ranges property...
[    1.132501] mtk-pcie 1a145000.pcie:      MEM 0x0028000000..0x002fffffff -> 0x0028000000
[    1.240711] mtk-pcie 1a145000.pcie: Port1 link down
[    1.245728] mtk-pcie 1a145000.pcie: PCI host bridge to bus 0001:00
[    1.251906] pci_bus 0001:00: root bus resource [bus 00-ff]
[    1.257399] pci_bus 0001:00: root bus resource [mem 0x28000000-0x2fffffff]
[    1.264265] pci_bus 0001:00: scanning bus
[    1.269470] pci_bus 0001:00: fixups for bus
[    1.273647] pci_bus 0001:00: bus scan returning with max=00
[    1.279562] mtk_hsdma 1b007000.dma-controller: Using 3 as missing dma-requests property
[    1.287837] mtk_hsdma 1b007000.dma-controller: MediaTek HSDMA driver registered
[    1.332390] libphy: dsa slave smi: probed
[    1.337346] mt7530 mdio-bus:00 lan1 (uninitialized): PHY [dsa-0.0:00] driver [Generic PHY] (irq=POLL)
[    1.347999] mt7530 mdio-bus:00 lan2 (uninitialized): PHY [dsa-0.0:01] driver [Generic PHY] (irq=POLL)
[    1.358651] mt7530 mdio-bus:00 lan3 (uninitialized): PHY [dsa-0.0:02] driver [Generic PHY] (irq=POLL)
[    1.369288] mt7530 mdio-bus:00 lan4 (uninitialized): PHY [dsa-0.0:03] driver [Generic PHY] (irq=POLL)
[    1.380107] mt7530 mdio-bus:00 wan (uninitialized): PHY [dsa-0.0:04] driver [Generic PHY] (irq=POLL)
[    1.391009] mt7530 mdio-bus:00: configuring for fixed/2500base-x link mode
[    1.398145] DSA: tree 0 setup
[    1.398276] mt7530 mdio-bus:00: Link is Up - 2.5Gbps/Full - flow control rx/tx
[    1.401905] xhci-mtk 1a0c0000.usb: xHCI Host Controller
[    1.413607] xhci-mtk 1a0c0000.usb: new USB bus registered, assigned bus number 1[    1.422707] xhci-mtk 1a0c0000.usb: hcc params 0x01403198 hci version 0x96 quirks 0x0000000000210010
[    1.431801] xhci-mtk 1a0c0000.usb: irq 31, io mem 0x1a0c0000
[    1.437938] hub 1-0:1.0: USB hub found
[    1.441710] hub 1-0:1.0: 2 ports detected
[    1.446016] xhci-mtk 1a0c0000.usb: xHCI Host Controller
[    1.451247] xhci-mtk 1a0c0000.usb: new USB bus registered, assigned bus number 2[    1.458659] xhci-mtk 1a0c0000.usb: Host supports USB 3.0 SuperSpeed
[    1.464969] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
[    1.473376] hub 2-0:1.0: USB hub found
[    1.477167] hub 2-0:1.0: 1 port detected
[    1.482167] UBI: auto-attach mtd3
[    1.485522] ubi0: attaching mtd3
[    1.872109] ubi0: scanning is finished
[    1.880063] ubi0: attached mtd3 (name "ubi", size 125 MiB)
[    1.885579] ubi0: PEB size: 131072 bytes (128 KiB), LEB size: 126976 bytes
[    1.892448] ubi0: min./max. I/O unit sizes: 2048/2048, sub-page size 2048
[    1.899232] ubi0: VID header offset: 2048 (aligned 2048), data offset: 4096
[    1.906188] ubi0: good PEBs: 1000, bad PEBs: 0, corrupted PEBs: 0
[    1.912271] ubi0: user volume: 6, internal volumes: 1, max. volumes count: 128
[    1.919487] ubi0: max/mean erase counter: 4/2, WL threshold: 4096, image sequence number: 2093620861
[    1.928612] ubi0: available PEBs: 0, total reserved PEBs: 1000, PEBs reserved for bad PEB handling: 20
[    1.937925] ubi0: background thread "ubi_bgt0d" started, PID 797
[    1.938955] FIT: Default configuration: "config-1" (OpenWrt linksys_e8450-ubi)
[    1.951171] FIT:           kernel sub-image 0x00001000..0x0050df5e "kernel-1" (ARM64 OpenWrt Linux-5.10.79)
[    1.961008] FIT:          flat_dt sub-image 0x0050e000..0x00515328 "fdt-1" (ARM64 OpenWrt linksys_e8450-ubi device tree blob)
[    1.972403] FIT:       filesystem sub-image 0x00516000..0x00acefff "rootfs-1" (ARM64 OpenWrt linksys_e8450-ubi rootfs)
[    1.983181] FIT: selecting configured loadable "rootfs-1" to be root filesystem
[    1.990486]  ubiblock0_4: p1(rootfs-1)
[    1.990782] block ubiblock0_4: created from ubi0:4(fit)
[    2.003681] VFS: Mounted root (squashfs filesystem) readonly on device 259:1.
[    2.011025] Freeing unused kernel memory: 448K
[    2.055479] Run /sbin/init as init process
[    2.059568]   with arguments:
[    2.062525]     /sbin/init
[    2.065221]   with environment:
[    2.068365]     HOME=/
[    2.070715]     TERM=linux
[    2.248158] init: Console is alive
[    2.251711] init: - watchdog -
[    2.558852] kmodloader: loading kernel modules from /etc/modules-boot.d/*
[    2.580824] usbcore: registered new interface driver usb-storage
[    2.587800] usbcore: registered new interface driver uas
[    2.593330] kmodloader: done loading kernel modules from /etc/modules-boot.d/*
[    2.608029] init: - preinit -
[    2.869898] mtk_soc_eth 1b100000.ethernet eth0: configuring for fixed/2500base-x link mode
[    2.878276] mtk_soc_eth 1b100000.ethernet eth0: Link is Up - 2.5Gbps/Full - flow control rx/tx
[    2.893844] mt7530 mdio-bus:00 lan1: configuring for phy/gmii link mode
[    2.901148] 8021q: adding VLAN 0 to HW filter on device lan1
[    2.914693] random: procd: uninitialized urandom read (4 bytes read)
[    6.977512] mount_root: loading kmods from internal overlay
[    6.989786] kmodloader: loading kernel modules from //etc/modules-boot.d/*
[    6.997554] kmodloader: done loading kernel modules from //etc/modules-boot.d/*
[    7.164425] UBIFS (ubi0:5): Mounting in unauthenticated mode
[    7.170244] UBIFS (ubi0:5): background thread "ubifs_bgt0_5" started, PID 889
[    7.193607] UBIFS (ubi0:5): recovery needed
[    7.243356] UBIFS (ubi0:5): recovery completed
[    7.247898] UBIFS (ubi0:5): UBIFS: mounted UBI device 0, volume 5, name "rootfs_data"
[    7.255732] UBIFS (ubi0:5): LEB size: 126976 bytes (124 KiB), min./max. I/O unit sizes: 2048 bytes/2048 bytes
[    7.265648] UBIFS (ubi0:5): FS size: 91168768 bytes (86 MiB, 718 LEBs), journal size 4571136 bytes (4 MiB, 36 LEBs)
[    7.276078] UBIFS (ubi0:5): reserved for root: 4306125 bytes (4205 KiB)
[    7.282685] UBIFS (ubi0:5): media format: w5/r0 (latest is w5/r0), UUID D1EC4C7A-F87C-414E-BE66-E55D618D6712, small LPT model
[    7.294864] block: attempting to load /tmp/ubifs_cfg/upper/etc/config/fstab
[    7.304555] block: extroot: not configured
[    7.308816] UBIFS (ubi0:5): un-mount UBI device 0
[    7.313526] UBIFS (ubi0:5): background thread "ubifs_bgt0_5" stops
[    7.322223] UBIFS (ubi0:5): Mounting in unauthenticated mode
[    7.328005] UBIFS (ubi0:5): background thread "ubifs_bgt0_5" started, PID 892
[    7.365810] UBIFS (ubi0:5): UBIFS: mounted UBI device 0, volume 5, name "rootfs_data"
[    7.373642] UBIFS (ubi0:5): LEB size: 126976 bytes (124 KiB), min./max. I/O unit sizes: 2048 bytes/2048 bytes
[    7.383570] UBIFS (ubi0:5): FS size: 91168768 bytes (86 MiB, 718 LEBs), journal size 4571136 bytes (4 MiB, 36 LEBs)
[    7.394000] UBIFS (ubi0:5): reserved for root: 4306125 bytes (4205 KiB)
[    7.400612] UBIFS (ubi0:5): media format: w5/r0 (latest is w5/r0), UUID D1EC4C7A-F87C-414E-BE66-E55D618D6712, small LPT model
[    7.524525] block: attempting to load /tmp/ubifs_cfg/upper/etc/config/fstab
[    7.533867] block: extroot: not configured
[    7.539342] mount_root: switching to ubifs overlay
[    7.547138] overlayfs: "xino" feature enabled using 2 upper inode bits.
[    7.556470] urandom-seed: Seeding with /etc/urandom.seed
[    7.606543] procd: - early -
[    7.609504] procd: - watchdog -
[    8.153919] procd: - watchdog -
[    8.158247] procd: - ubus -
[    8.186817] random: ubusd: uninitialized urandom read (4 bytes read)
[    8.211092] random: ubusd: uninitialized urandom read (4 bytes read)
[    8.217676] random: ubusd: uninitialized urandom read (4 bytes read)
[    8.225290] procd: - init -
[    8.512341] urngd: v1.0.2 started.
[    8.544364] random: crng init done
[    8.547823] random: 6 urandom warning(s) missed due to ratelimiting
[    8.570420] kmodloader: loading kernel modules from /etc/modules.d/*
[    8.615137] Loading modules backported from Linux version v5.15-rc6-0-g519d81956ee2
[    8.622838] Backport generated by backports.git v5.15-rc6-1-0-gd44432d6
[    8.653806] xt_time: kernel timezone is -0000
[    8.717736] ieee80211 phy0: Selected rate control algorithm 'minstrel_ht'
[    8.730898] mt7915e 0000:01:00.0: assign IRQ: got 143
[    8.736078] pci 0000:00:00.0: enabling bus mastering
[    8.741069] mt7915e 0000:01:00.0: enabling device (0000 -> 0002)
[    8.747187] mt7915e 0000:01:00.0: enabling bus mastering
[    8.781893] mt7622-wmac 18000000.wmac: HW/SW Version: 0x8a108a10, Build Time: 20190801210006a
[    8.781893]
[    8.812319] mt7915e 0000:01:00.0: HW/SW Version: 0x8a108a10, Build Time: 20201105222230a
[    8.812319]
[    8.875121] mt7622-wmac 18000000.wmac: N9 Firmware Version: 2.0, Build Time: 20200131180931
[    8.946401] mt7915e 0000:01:00.0: WM Firmware Version: ____000000, Build Time: 20201105222304
[    8.970744] mt7915e 0000:01:00.0: WA Firmware Version: DEV_000000, Build Time: 20201105222323
[    9.094344] PPP generic driver version 2.4.2
[    9.099742] NET: Registered protocol family 24
[    9.111748] kmodloader: done loading kernel modules from /etc/modules.d/*
[   11.830067] mtk_soc_eth 1b100000.ethernet eth0: Link is Down
[   11.842116] mtk_soc_eth 1b100000.ethernet eth0: configuring for fixed/2500base-x link mode
[   11.850746] mtk_soc_eth 1b100000.ethernet eth0: Link is Up - 2.5Gbps/Full - flow control rx/tx
[   11.856047] mt7530 mdio-bus:00 lan1: configuring for phy/gmii link mode
[   11.872975] 8021q: adding VLAN 0 to HW filter on device lan1
[   11.886175] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   11.892720] br-lan: port 1(lan1) entered blocking state
[   11.898033] br-lan: port 1(lan1) entered disabled state
[   11.908032] device lan1 entered promiscuous mode
[   11.912661] device eth0 entered promiscuous mode
[   11.928508] mt7530 mdio-bus:00 lan2: configuring for phy/gmii link mode
[   11.936166] 8021q: adding VLAN 0 to HW filter on device lan2
[   11.949126] br-lan: port 2(lan2) entered blocking state
[   11.954358] br-lan: port 2(lan2) entered disabled state
[   11.967273] device lan2 entered promiscuous mode
[   11.979843] mt7530 mdio-bus:00 lan3: configuring for phy/gmii link mode
[   11.989048] 8021q: adding VLAN 0 to HW filter on device lan3
[   11.999354] br-lan: port 3(lan3) entered blocking state
[   12.004591] br-lan: port 3(lan3) entered disabled state
[   12.011600] device lan3 entered promiscuous mode
[   12.022597] mt7530 mdio-bus:00 lan4: configuring for phy/gmii link mode
[   12.030416] 8021q: adding VLAN 0 to HW filter on device lan4
[   12.043146] br-lan: port 4(lan4) entered blocking state
[   12.048458] br-lan: port 4(lan4) entered disabled state
[   12.054673] device lan4 entered promiscuous mode
[   12.066398] mt7530 mdio-bus:00 wan: configuring for phy/gmii link mode
[   12.073583] 8021q: adding VLAN 0 to HW filter on device wan
[   14.748638] br-lan: port 5(wlan1-1) entered blocking state
[   14.754167] br-lan: port 5(wlan1-1) entered disabled state
[   14.759882] device wlan1-1 entered promiscuous mode
[   15.027441] IPv6: ADDRCONF(NETDEV_CHANGE): wlan1-1: link becomes ready
[   15.034139] br-lan: port 5(wlan1-1) entered blocking state
[   15.039716] br-lan: port 5(wlan1-1) entered forwarding state
[   15.045660] IPv6: ADDRCONF(NETDEV_CHANGE): br-lan: link becomes ready
[   15.144559] br-lan: port 6(wlan0) entered blocking state
[   15.149938] br-lan: port 6(wlan0) entered disabled state
[   15.155543] device wlan0 entered promiscuous mode
[   15.160393] br-lan: port 6(wlan0) entered blocking state
[   15.165753] br-lan: port 6(wlan0) entered forwarding state
[   15.193262] IPv6: ADDRCONF(NETDEV_CHANGE): wlan0: link becomes ready
[   16.513625] br-lan: port 7(wlan1) entered blocking state
[   16.518965] br-lan: port 7(wlan1) entered disabled state
[   16.524466] device wlan1 entered promiscuous mode
[   17.245519] br-lan: port 5(wlan1-1) entered disabled state
[   19.912652] IPv6: ADDRCONF(NETDEV_CHANGE): wlan1: link becomes ready
[   19.919165] br-lan: port 7(wlan1) entered blocking state
[   19.924476] br-lan: port 7(wlan1) entered forwarding state
[   20.036977] br-lan: port 5(wlan1-1) entered blocking state
[   20.042469] br-lan: port 5(wlan1-1) entered forwarding state
[   20.132656] ------------[ cut here ]------------
[   20.137290] WARNING: CPU: 0 PID: 1154 at __skb_flow_dissect+0x1a0/0x13dc
[   20.143980] Modules linked in: pppoe ppp_async iptable_nat xt_state xt_nat xt_conntrack xt_REDIRECT xt_MASQUERADE xt_FLOWOFFLOAD xt_CT pppox ppp_generic nf_nat nf_flow_table nf_conntrack mt7915e mt7615e mt7615_common mt76_connac_lib mt76 mac80211 ipt_REJECT cfg80211 xt_time xt_tcpudp xt_multiport xt_mark xt_mac xt_limit xt_comment xt_TCPMSS xt_LOG slhc nf_reject_ipv4 nf_log_ipv4 nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_filter ip_tables hwmon crc_ccitt compat nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 vfat fat autofs4 nls_utf8 nls_iso8859_1 nls_cp437 seqiv uas usb_storage leds_gpio xhci_plat_hcd gpio_button_hotplug exfat
[   20.205400] CPU: 0 PID: 1154 Comm: napi/phy1-7 Tainted: G S                5.10.79 #0
[   20.213219] Hardware name: Linksys E8450 (UBI) (DT)
[   20.218089] pstate: 00000005 (nzcv daif -PAN -UAO -TCO BTYPE=--)
[   20.224086] pc : __skb_flow_dissect+0x1a0/0x13dc
[   20.228695] lr : __skb_get_hash+0x6c/0x130
[   20.232780] sp : ffffffc010e8b9a0
[   20.236085] x29: ffffffc010e8b9a0 x28: 0000000000000000
[   20.241389] x27: 0000000000000000 x26: 0000000000000008
[   20.246693] x25: 0000000000000000 x24: ffffff80019d3418
[   20.251997] x23: 000000000000004a x22: ffffffc010e8bb10
[   20.257302] x21: 000000000000ffba x20: ffffffc010a99580
[   20.262605] x19: ffffff800286a200 x18: 0000000000290000
[   20.267909] x17: 0000000000d20000 x16: 000000000000037e
[   20.273213] x15: 0000000000000001 x14: 0000000000000070
[   20.278517] x13: 0000000000000080 x12: ffffffc010878040
[   20.283821] x11: 0000000000000001 x10: 0000000000000001
[   20.289124] x9 : ffffffc010e8b5f8 x8 : ffffff8000863700
[   20.294428] x7 : 0000000000000000 x6 : 0000000000000000
[   20.299731] x5 : 0000000000000000 x4 : 0000000000000000
[   20.305034] x3 : ffffffc010e8bb10 x2 : 0000000000000000
[   20.310339] x1 : 0000000000000000 x0 : 0000000000000000
[   20.315642] Call trace:
[   20.318083]  __skb_flow_dissect+0x1a0/0x13dc
[   20.322345]  __skb_get_hash+0x6c/0x130
[   20.326110]  ieee80211_schedule_txq+0x784/0x9dc [mac80211]
[   20.331597]  ieee80211_schedule_txq+0x974/0x9dc [mac80211]
[   20.337083]  ieee80211_tx_pending+0xe0/0x24c [mac80211]
[   20.342301]  tasklet_action_common.constprop.0+0x134/0x17c
[   20.347777]  tasklet_action+0x24/0x30
[   20.351430]  _stext+0x124/0x28c
[   20.354563]  do_softirq+0x74/0x80
[   20.357869]  __local_bh_enable_ip+0x88/0x90
[   20.362045]  napi_threaded_poll+0x94/0xf0
[   20.366048]  kthread+0x120/0x124
[   20.369267]  ret_from_fork+0x10/0x18
[   20.372833] ---[ end trace d98c09f8ca4ebf83 ]---
root@OpenWrt:~#

I created an issue here:

Ok, so I found where is exact problem with 5GHz wifi in my case.
Whenever it is set to 160MHz channel width it will stop working as soon as I connect third device with 160MHz channel width (2402Mbps).
If I set channel width 80MHz there is no problem with 5GHz wifi.
What gives? @daniel Does this info give some clues?

Sounds more like mt76 wifi driver limitation, so @nbd might know most about the possible culprits.

Argh, I was celebrating too soon. Now after 4th device is connected after 10-15 minutes everything dies. Router is not reachable even via ethernet ports, so power cycle is required.
I have ordered another router just to make sure there isnt some hardware problem.
Any "correct" way to flash it more proper? For this one I just flashed Daniels recovery image, and then there flashed snapshoot itb image.

I saw this error, when both devices had different settings in there wifi mesh configuration. make sure, theyre configs did not differ, even minor feature setting and (probable) unrelated settings

I think I made some progress with the current mesh brokenness. In my 3x mesh setup, so long as I keep the nodes active, all three remain accessible. When one of the two extension nodes (i.e. node that connects to gateway) has a period of inactivity, it becomes inaccessible. It still shows connected with mesh station dump from other nodes, but 'tx bytes' on the affected node increases very slowly:

root@OpenWrt:~# iw dev wlan1 station dump |grep -i bytes
        rx bytes:       24222245
        tx bytes:       147301
        rx bytes:       626904121
        tx bytes:       372754833
root@OpenWrt:~# iw dev wlan1 station dump |grep -i bytes
        rx bytes:       24224452
        tx bytes:       147301
        rx bytes:       626906328
        tx bytes:       372754833
root@OpenWrt:~# iw dev wlan1 station dump |grep -i bytes
        rx bytes:       24225989
        tx bytes:       147301
        rx bytes:       626908137
        tx bytes:       372754919
root@OpenWrt:~# iw dev wlan1 station dump |grep -i bytes
        rx bytes:       24372908
        tx bytes:       147479
        rx bytes:       627143495
        tx bytes:       372823476
root@OpenWrt:~# iw dev wlan1 station dump |grep -i bytes
        rx bytes:       24379516
        tx bytes:       147538
        rx bytes:       627150666
        tx bytes:       372823844

how do you adjust your 2.4ghz in N auto and 20mhz or 40mhz? thank you