Yup, I was before too but only the recent builds have been crashing
Good to know, so did @vochong and I. On his suggestion, I changed NSS fq_codel to something else last night:
config queue 'eth1'
option debug_logging '1'
option verbosity '8'
option linklayer 'ethernet'
option qdisc 'fq_codel'
option interface 'eth0'
option download '425000'
option upload '425000'
option overhead '18'
option qdisc_advanced '1'
option squash_dscp '1'
option squash_ingress '1'
option ingress_ecn 'ECN'
option egress_ecn 'ECN'
option linklayer_advanced '1'
option tcMTU '2047'
option tcTSIZE '128'
option tcMPU '64'
option linklayer_adaptation_mechanism 'default'
option enabled '1'
option script 'simple.qos'
Unfortunately I can see I had another spontaneous reboot during the night... Although I have enabled ramoops and pstore, there's nothing in /sys/fs/pstore...:
lsmod| grep ramoops
pstore 24576 2 ramoops
ramoops 24576 0
reed_solomon 20480 1 ramoops
I had two Teams-meetings this morning with different people. During the entirety of both sessions I experienced stutter with audio and video, which I didn't have before. I'd like to blame this on my current SQM setup I've shared here. But then again, I don't really know if enabling SQM outside of the NSS cores actually makes sense.
-- EDIT --
I looked again and I'm confused. I've disabled SQM for a moment in luci (option enabled '0'). But there are still quite some qdiscs actively used:
tc output
root@OpenWrt:~# tc -s qdisc
qdisc noqueue 0: dev lo root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc fq_codel 0: dev eth0 root refcnt 2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 1147539677 bytes 1069971 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 138 drop_overlimit 0 new_flow_count 1 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth1 root refcnt 2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 6364642804 bytes 7886663 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 5325 drop_overlimit 0 new_flow_count 4723 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc noqueue 0: dev br-guest root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth1.3 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev br-iot root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth1.5 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev br-lan root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth1.1 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth0.4 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev wlan1 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev wlan0 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev wlan1-1 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth0.6 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc fq_codel 0: dev pppoe-wan root refcnt 2 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 4819984315 bytes 5163128 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 50728 drop_overlimit 0 new_flow_count 56256 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc noqueue 0: dev wlan0-1 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
These qdiscs I see above are not what I expect when I disable SQM in luci. I do notice when I run a test on waveform's buffer bloat tool the CPU usage goes to 100% on one core and specifically on softirq's.
Do I understand this right? So you always have a set of qdiscs enabled on any recent OpenWRT build, whether you enable SQM in luci or not? What's the point of having SQM config in luci if there's probably a default set of qdiscs active? How do we know they're not interfering to each other? For NSS capable builds, I can only understand one specific advantage for NSS capable fq_codel, and that is that traffic shaping is pushed to the NSS cores to offload the "main" CPU cores. But how would that fare when there are already other qdiscs used?
@ACwifidude I'm currently using the master build although custom compiled with some additional packages. If I understand correctly the recent move to remove all traces of iptables also removed sqm capabilities. I was only using it on the upload side but still.
I tried building with sqm included but currently my compilation of master fails because of the package coova-chilli (that I'm not using).
I tried to build yesterday with sqm added back in and ran in to that too. Iām going to puruse through the build log (hopefully today?) and see where the hiccup is. Hopefully it is an issue with that package that just needs a fix pushed.
Okay great. Yeah hopefully.
With these NSS-accelerated images, you should not enable any of the regular (non-NSS) SQM algorithm in the device. It would just make things worse since they're not compatible with each other, and thus may introduce lots of latency since your traffic flows may be subject to processing by both the NSS cores and the CPU. @quarky please enlighten us as to their interaction.
Since 22.03 RC5-based private images kept crashing on me almost everyday when NSS fq_codel was enabled (using tc to configure it, as ACwifidude mentioned at the beginning of this thread), I simply disabled it altogether and my R7800 has no longer crashed. It's been up 5 days.
1 Like
Currently there is no tc on the master image. That's all I wanted to use. Good to know though if that's causing crashes.
would it be worth setting the sqm to 0?
According to quarky, a spontaneous reboot without ramoops dump may be caused by a NSS firmware lockup event and the reboot was triggered by watchdog for the sake of recovery. Such reboot will leave no core dump.
So from what I can piece together, when we configure the NSS qdisc for the NSS aware interfaces, any packets sent to the NSS firmware will be processed by the NSS qdisc. So this will include those TCP/UDP streams that are accelerated by the NSS firmware.
For those not accelerated, e.g. the interfaces that NSS is not aware of (e.g. OpenVPN TUN/TAP, Wireguard etc), if a network packet comes in thru the ethernet interface (e.g. eth0.2) and goes out via the Wireguard interface for example, the NSS firmware will process it (e.g. if a qdisc is applied to eth0.2) until it sees the output to an interface it is not managing, where the NSS firmware will shoot the network packet back up the Linux stack. The same applies for the other direction.
So in theory, NSS and Linux qdisc can co-exists. The Linux kernel will handle those streams not handled by NSS. Only one qdisc can be applied to one interface at any one time though.
HTH.
3 Likes
I have the tc -s qdisc output on a dumb AP I have running with this same NSS accelerated build. I have never enabled SQM on that dumb AP:
default SQM config in luci on dumb AP
root@ap-R7800:~# cat /etc/config/sqm
config queue 'eth1'
option enabled '0'
option interface 'eth1'
option download '85000'
option upload '10000'
option qdisc 'cake'
option script 'piece_of_cake.qos'
option qdisc_advanced '0'
option ingress_ecn 'ECN'
option egress_ecn 'ECN'
option qdisc_really_really_advanced '0'
option itarget 'auto'
option etarget 'auto'
option linklayer 'none'
But there is at least one fq_codel queue active on eth1. Since this is an R7800, eth1 is the internal network (switch). So there is always a default qdisc active on a build for the internal network. From what I see in my previous post where I shared the tc -s qdisc output on my router, there is another fq_codel qdisc active for my WAN connection, which is the pppoe-wan connection. This apparently starts automatically. I can't seem to influence that in /etc/config/sqm?
qdiscs on dumb AP without SQM enabled in luci
root@ap-R7800:~# tc -s qdisc
qdisc noqueue 0: dev lo root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc fq_codel 0: dev eth1 root refcnt 2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 843690794 bytes 3927171 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 2206 drop_overlimit 0 new_flow_count 2534 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc noqueue 0: dev br-guest root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth1.3 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev br-iot root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth1.5 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev br-lan root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth1.1 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev wlan0 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev wlan0-1 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
I have disabled SQM in luci, it seemed to last longer without a crash but I kept having stutter in Teams calls.
At the moment I have my previous build running again, with NSS fq_codel enabled again. There are a lot more qdiscs active, but when I look at it, I get the idea that I've got:
- one
fq_codelqdisc active foreth1, which is the internal network and is fine. - two
nssfq_codelqdiscs active, one foreth0(which is the WAN side) and one fornssifb. I don't know why there are two, perhaps they are for input and output from the Linux kernel to the NSS cores? - I still see one
fq_codelqdisc active forpppoe-wan.
Here's my tc -s qdisc output of my router (with NSS fq_codel enabled):
qdiscs on router with NSS fq_codel enabled in SQM
root@OpenWrt:~# tc -s qdisc
qdisc noqueue 0: dev lo root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc nsstbl 1: dev eth0 root refcnt 2 buffer/maxburst 53125b rate 425Mbit mtu 1514b accel_mode 0
Sent 1055815764 bytes 1887688 pkt (dropped 0, overlimits 220 requeues 0)
backlog 0b 0p requeues 0
qdisc nssfq_codel 10: dev eth0 parent 1: target 5ms limit 1001p interval 100ms flows 1024 quantum 1514 set_default accel_mode 0
Sent 1055818181 bytes 1887710 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 1518 drop_overlimit 0 new_flow_count 942007 ecn_mark 0
new_flows_len 0 old_flows_len 1
qdisc fq_codel 0: dev eth1 root refcnt 2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 20251196605 bytes 16595292 pkt (dropped 0, overlimits 0 requeues 5)
backlog 0b 0p requeues 5
maxpacket 7385 drop_overlimit 0 new_flow_count 6613 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc noqueue 0: dev br-guest root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth1.3 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev br-iot root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth1.5 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev br-lan root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth1.1 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth0.4 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth0.6 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc fq_codel 0: dev pppoe-wan root refcnt 2 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 1007669069 bytes 1879965 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 17008 drop_overlimit 0 new_flow_count 5787 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc noqueue 0: dev wlan1 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev wlan0 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev wlan1-1 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev wlan0-1 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc nsstbl 1: dev nssifb root refcnt 2 buffer/maxburst 53125b rate 425Mbit mtu 1514b accel_mode 0
Sent 23051088395 bytes 17352692 pkt (dropped 0, overlimits 9163 requeues 0)
backlog 0b 0p requeues 0
qdisc nssfq_codel 10: dev nssifb parent 1: target 5ms limit 1001p interval 100ms flows 1024 quantum 1514 set_default accel_mode 0
Sent 23051088395 bytes 17352692 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 1518 drop_overlimit 0 new_flow_count 8195612 ecn_mark 0
new_flows_len 0 old_flows_len 0
My SQM config on my router is:
SQM config on my NSS enabled router
config queue 'eth1'
option debug_logging '1'
option verbosity '8'
option linklayer 'ethernet'
option qdisc 'fq_codel'
option interface 'eth0'
option download '425000'
option upload '425000'
option overhead '18'
option qdisc_advanced '1'
option squash_dscp '1'
option squash_ingress '1'
option ingress_ecn 'ECN'
option egress_ecn 'ECN'
option linklayer_advanced '1'
option tcMTU '2047'
option tcTSIZE '128'
option tcMPU '64'
option linklayer_adaptation_mechanism 'default'
option script 'nss.qos'
option enabled '1'
I'm confused because I don't know how these different qdiscs interact with each other, the kernel and the NSS cores.
I'm going to try something, don't know if I'll succeed because my NAS isn't the fastest in compiling. I've still kept my build tree from the end of April this year, the build that's stable, but doesn't include the latest WiFi fixes. Is it just a matter of adding the new patches that Felix committed to the 22.03 branch in ~/build/openwrt/package/kernel/mac80211/patches/subsys and build as usual? I can simply drop Felix' patches in that directory and run a make? Or do I need to include these patch files in a .config or Makefile by myself?
I've just finished building a new image based on the latest 22.03 branch (which includes the new Linux kernel 5.10.131 commit). I enable NSS fq_codel again and hope for the best. So far so good.
1 Like
Unfortunately, it has crashed again with the same virtual address as reported previously. I'm very sure that it is caused by the enabling of the NSS fq_codel because the crash has been consistently triggered by it.
I think we need @quarky's involvement in fixing this problem.
It's quite funny that ACwifidude (in his attempt to completely eliminate all traces of iptables) recently removed the SQM-related packages, which in turn prevented "make defconfig" from including the tc-tiny package. The lack of the tc tool made it impossible to configure NSS fq_codel at all. This helps forestall this annoying crash for all, except for people trying to add tc back to the build. @Acwifidude the dazzling prophet! 
<1>[ 58.030805] 8<--- cut here ---
<1>[ 58.030833] Unable to handle kernel NULL pointer dereference at virtual address 00000138
<6>[ 58.031304] Nexthop successfully set for [eth0] to [nssifb]
<1>[ 58.032762] pgd = 6aa5ce7a
<1>[ 58.041082] [00000138] *pgd=00000000
<0>[ 58.043548] Internal error: Oops: 5 [#1] SMP ARM
<4>[ 58.047250] Modules linked in: nss_ifb ecm nft_fib_inet nf_flow_table_ipv6 nf_flow_table_ipv4 nf_flow_table_inet ath10k_pci ath10k_core ath wireguard pl2303 nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject nft_redir nft_quota nft_objref nft_numgen nft_nat nft_masq nft_log nft_limit nft_hash nft_flow_offload nft_fib_ipv6 nft_fib_ipv4 nft_fib nft_ct nft_counter nft_chain_nat nf_tables nf_conntrack_netlink mac80211 libchacha20poly1305 ipt_REJECT ftdi_sio curve25519_neon cp210x ch341 cfg80211 belkin_sa xt_time xt_tcpudp xt_tcpmss xt_statistic xt_state xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length xt_hl xt_ecn xt_dscp xt_conntrack xt_comment xt_TCPMSS xt_REDIRECT xt_MASQUERADE xt_LOG xt_HL xt_DSCP xt_CT xt_CLASSIFY usbserial sch_cake ppp_async poly1305_arm nfnetlink nf_reject_ipv4 nf_log_ipv6 nf_log_ipv4 nf_log_common nf_flow_table libcurve25519_generic libcrc32c iptable_nat iptable_mangle iptable_filter ipt_ECN ip_tables crc_ccitt compat chacha_neon fuse sch_tbf sch_ingress
<4>[ 58.047778] sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact qca_nss_qdisc qca_nss_pppoe pppoe pppox ppp_generic slhc ledtrig_usbport cryptodev ip6table_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ip6t_NPT ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsv4 nfsv3 nfs nfs_ssc msdos bonding ifb ip6_udp_tunnel udp_tunnel sit qca_nss_drv qca_nss_gmac oid_registry tunnel4 ip_tunnel tun xfrm_user xfrm_ipcomp af_key xfrm_algo vfat fat lockd sunrpc grace hfsplus hfs cdrom dns_resolver nls_utf8 nls_iso8859_15 nls_iso8859_1 nls_cp850 nls_cp437 nls_cp1250 wp512 twofish_generic twofish_common tgr192 tea serpent_generic khazad cast6_generic cast5_generic cast_common camellia_generic blowfish_generic blowfish_common anubis xts crypto_user algif_skcipher algif_rng algif_hash algif_aead af_alg sha1_generic seqiv md5 kpp echainiv ecb des_generic libdes cmac authenc uas usb_storage
<4>[ 58.117348] leds_gpio xhci_plat_hcd xhci_pci xhci_hcd dwc3 dwc3_qcom ohci_platform ohci_hcd phy_qcom_ipq806x_usb ahci fsl_mph_dr_of ehci_platform ehci_fsl sd_mod ahci_platform libahci_platform libahci libata scsi_mod ehci_hcd ramoops reed_solomon pstore gpio_button_hotplug f2fs ext4 mbcache jbd2 exfat dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax crc32c_generic crc32_generic cbc encrypted_keys trusted tpm
<4>[ 58.240122] CPU: 0 PID: 1427 Comm: odhcpd Not tainted 5.10.131 #0
<4>[ 58.262350] Hardware name: Generic DT based system
<4>[ 58.268610] PC is at eth_type_trans+0x20/0x20c
<4>[ 58.273292] LR is at nss_ifb_data_cb+0x20/0x54 [nss_ifb]
<4>[ 58.277714] pc : [<c08771e4>] lr : [<bf92e2e8>] psr: 80000113
<4>[ 58.283183] sp : c5d37de8 ip : bf5700a8 fp : 00000002
<4>[ 58.289172] r10: 00000028 r9 : c50b4800 r8 : bf566040
<4>[ 58.294381] r7 : 00000000 r6 : bf566388 r5 : 00000000 r4 : c73ae780
<4>[ 58.299591] r3 : 00000001 r2 : bf566690 r1 : 00000000 r0 : c73ae780
<4>[ 58.306190] Flags: Nzcv IRQs on FIQs on Mode SVC_32 ISA ARM Segment none
<4>[ 58.312701] Control: 10c5787d Table: 47be006a DAC: 00000051
<0>[ 58.319905] Process odhcpd (pid: 1427, stack limit = 0x09a28429)
<0>[ 58.325633] Stack: (0xc5d37de8 to 0xc5d38000)
<0>[ 58.331719] 7de0: c30d9540 00000028 c73ae780 bf566690 bf566388 00000000
<0>[ 58.335980] 7e00: bf566040 bf92e2e8 c73ae780 bf92e2c8 bf566388 bf51eb18 00000000 c5002e00
<0>[ 58.344141] 7e20: bf566690 c30d9040 bf566058 0000007f 0000001e 00000008 00000001 000000f0
<0>[ 58.352301] 7e40: c273f400 bf566680 00000002 00000001 c273f404 00000001 c5385840 bf566690
<0>[ 58.360460] 7e60: 00000040 bf566040 bf573000 00000000 bf548c20 bf566680 00000002 bf51fe20
<0>[ 58.368620] 7e80: c5385900 00000040 c5ef8d80 00000002 c5d37ec4 00000001 bf566690 00000040
<0>[ 58.376781] 7ea0: c5d37edf c5d37ee0 c0d03d00 1cd49000 c5d37ee8 c082d078 bf566690 dd991700
<0>[ 58.384940] 7ec0: 0000012c c0c48700 c5d37ee0 c082d394 c5d37ed0 ffffa17d 00000000 00385900
<0>[ 58.393099] 7ee0: c5d37ee0 c5d37ee0 c5d37ee8 c5d37ee8 c5d36000 00000000 00000003 c0d0308c
<0>[ 58.401259] 7f00: c0d03080 40000003 c5d36000 00000100 c5d37f18 c0301378 c5d37f28 000f423e
<0>[ 58.409420] 7f20: c5d37f34 c0d03080 c0c41220 0000000a c0c411ac c0c47940 c0c47940 ffffa17c
<0>[ 58.417578] 7f40: c0d03d00 00400100 c5d37f90 ffffe000 00000000 00000000 00000001 c1410000
<0>[ 58.425738] 7f60: de80200c c5d37f90 beec4e04 c032311c c0c46cb8 c0371848 c0d05334 c5d37fb0
<0>[ 58.433897] 7f80: c0d7e664 de802000 c0c46cc4 c064c0dc b6ea6b74 80000010 ffffffff 10c5787d
<0>[ 58.442058] 7fa0: 10c5387d b6efed10 beec4e0c c0300f10 018414c0 00000024 00000086 000004ff
<0>[ 58.450218] 7fc0: 03f0c19f 03f0c19f 00000000 b6efed10 beec4e08 b6efed10 beec4e0c beec4e04
<0>[ 58.458376] 7fe0: b6ee721c beec4d90 b6ea7ba8 b6ea6b74 80000010 ffffffff 00000000 00000000
<0>[ 58.466533] [<c08771e4>] (eth_type_trans) from [<bf92e2e8>] (nss_ifb_data_cb+0x20/0x54 [nss_ifb])
<0>[ 58.474905] [<bf92e2e8>] (nss_ifb_data_cb [nss_ifb]) from [<bf51eb18>] (nss_core_send_buffer+0x1b18/0x1fd8 [qca_nss_drv])
<0>[ 58.483723] [<bf51eb18>] (nss_core_send_buffer [qca_nss_drv]) from [<bf51fe20>] (nss_core_handle_napi+0x194/0x238 [qca_nss_drv])
<0>[ 58.494577] [<bf51fe20>] (nss_core_handle_napi [qca_nss_drv]) from [<c082d078>] (__napi_poll+0x34/0x150)
<0>[ 58.506112] [<c082d078>] (__napi_poll) from [<c082d394>] (net_rx_action+0xdc/0x270)
<0>[ 58.515574] [<c082d394>] (net_rx_action) from [<c0301378>] (__do_softirq+0x110/0x2b8)
<0>[ 58.522952] [<c0301378>] (__do_softirq) from [<c032311c>] (irq_exit+0xb8/0x118)
<0>[ 58.530936] [<c032311c>] (irq_exit) from [<c0371848>] (__handle_domain_irq+0x94/0xf4)
<0>[ 58.538057] [<c0371848>] (__handle_domain_irq) from [<c064c0dc>] (gic_handle_irq+0x90/0xb8)
<0>[ 58.546040] [<c064c0dc>] (gic_handle_irq) from [<c0300f10>] (__irq_usr+0x50/0x80)
<0>[ 58.554193] Exception stack(0xc5d37fb0 to 0xc5d37ff8)
<0>[ 58.561839] 7fa0: 018414c0 00000024 00000086 000004ff
<0>[ 58.566883] 7fc0: 03f0c19f 03f0c19f 00000000 b6efed10 beec4e08 b6efed10 beec4e0c beec4e04
<0>[ 58.575040] 7fe0: b6ee721c beec4d90 b6ea7ba8 b6ea6b74 80000010 ffffffff
<0>[ 58.583195] Code: e58d8010 e58de014 e24dd008 e5801008 (e5913138)
<4>[ 58.589842] ---[ end trace 409a7d1df4a9ab0a ]---
NAME="OpenWrt"
VERSION="22.03-SNAPSHOT"
ID="openwrt"
ID_LIKE="lede openwrt"
PRETTY_NAME="OpenWrt 22.03-SNAPSHOT"
VERSION_ID="22.03-snapshot"
HOME_URL="https://openwrt.org/"
BUG_URL="https://bugs.openwrt.org/"
SUPPORT_URL="https://forum.openwrt.org/"
BUILD_ID="r19540+56-945b13e369"
OPENWRT_BOARD="ipq806x/generic"
OPENWRT_ARCH="arm_cortex-a15_neon-vfpv4"
OPENWRT_TAINTS="busybox"
OPENWRT_DEVICE_MANUFACTURER="OpenWrt"
OPENWRT_DEVICE_MANUFACTURER_URL="https://openwrt.org/"
OPENWRT_DEVICE_PRODUCT="Generic"
OPENWRT_DEVICE_REVISION="v0"
OPENWRT_RELEASE="OpenWrt 22.03-SNAPSHOT r19540+56-945b13e369"
Linux xxx 5.10.131 #0 SMP Fri Jul 22 00:11:21 2022 armv7l GNU/Linux
Only took 58 seconds to kernel panic.
The panic took place in the nss_ifb_data_cb() method, which seems like it is passing a non-existing source device pointer to the eth_type_trans() kernel API. This source device pointer is stored in the nssifb device data structure. Something must have happened within the 58s that overwrote the source device pointer in nssifb.
Was traffic flowing before the panic occurred?
If you don't mind, can you post the entire dmesg output when your router boots up?
Edit:
[ 58.031304] Nexthop successfully set for [eth0] to [nssifb]
This is rather suspicious as well. Why is the nssifb being setup at the 58th second?
1 Like
dmesg-ramoops-0
cat dmesg-ramoops-0
Oops#1 Part1
<7>[ 0.679727] pcieport 0001:00:00.0: saving config space at offset 0x20 (reading 0x2e102e00)
<7>[ 0.679741] pcieport 0001:00:00.0: saving config space at offset 0x24 (reading 0x1fff1)
<7>[ 0.679754] pcieport 0001:00:00.0: saving config space at offset 0x28 (reading 0x0)
<7>[ 0.679768] pcieport 0001:00:00.0: saving config space at offset 0x2c (reading 0x0)
<7>[ 0.679781] pcieport 0001:00:00.0: saving config space at offset 0x30 (reading 0x0)
<7>[ 0.679795] pcieport 0001:00:00.0: saving config space at offset 0x34 (reading 0x40)
<7>[ 0.679809] pcieport 0001:00:00.0: saving config space at offset 0x38 (reading 0x0)
<7>[ 0.679823] pcieport 0001:00:00.0: saving config space at offset 0x3c (reading 0x30131)
<6>[ 0.682812] L2 @ QSB rate. Forcing new rate.
<6>[ 0.683041] L2 @ 384000 KHz
<6>[ 0.683242] CPU0 @ 800000 KHz
<6>[ 0.683261] CPU1 @ QSB rate. Forcing new rate.
<6>[ 0.683395] CPU1 @ 384000 KHz
<6>[ 0.687776] gsbi 16300000.gsbi: GSBI port protocol: 6 crci: 0
<6>[ 0.690712] Serial: 8250/16550 driver, 16 ports, IRQ sharing enabled
<6>[ 0.693292] msm_serial 16340000.serial: msm_serial: detected port #0
<6>[ 0.693351] msm_serial 16340000.serial: uartclk = 7372800
<6>[ 0.693437] 16340000.serial: ttyMSM0 at MMIO 0x16340000 (irq = 51, base_baud = 460800) is a MSM
<6>[ 0.693480] msm_serial: console setup on port #0
<6>[ 1.527122] printk: console [ttyMSM0] enabled
<6>[ 1.532408] msm_serial: driver initialized
<6>[ 1.541798] loop: module loaded
<6>[ 1.543497] nand: device found, Manufacturer ID: 0x2c, Chip ID: 0xa1
<6>[ 1.543757] nand: Micron MT29F1G08ABBEAH4
<6>[ 1.550461] nand: 128 MiB, SLC, erase size: 128 KiB, page size: 2048, OOB size: 64
<5>[ 1.554371] 8 fixed-partitions partitions found on MTD device qcom_nand.0
<5>[ 1.561820] Creating 8 MTD partitions on "qcom_nand.0":
<5>[ 1.568686] 0x000000000000-0x000000c80000 : "qcadata"
<5>[ 1.595136] 0x000000c80000-0x000001180000 : "APPSBL"
<5>[ 1.604203] 0x000001180000-0x000001200000 : "APPSBLENV"
<5>[ 1.605605] 0x000001200000-0x000001340000 : "art"
<5>[ 1.611005] 0x000001340000-0x000001480000 : "artbak"
<5>[ 1.615724] 0x000001480000-0x000001880000 : "kernel"
<5>[ 1.625401] 0x000001880000-0x000007900000 : "ubi"
<5>[ 1.786873] 0x000007900000-0x000008000000 : "reserve"
<6>[ 1.829588] switch0: Atheros AR8337 rev. 2 switch registered on 37000000.mdio-mii
<3>[ 2.612060] ar8327: qca,phy-rgmii-en is not specified
<6>[ 2.613616] i2c /dev entries driver
<6>[ 2.623559] sdhci: Secure Digital Host Controller Interface driver
<6>[ 2.623611] sdhci: Copyright(c) Pierre Ossman
<6>[ 2.628779] sdhci-pltfm: SDHCI platform and OF driver helper
<6>[ 2.637113] NET: Registered protocol family 10
<6>[ 2.641069] Segment Routing with IPv6
<6>[ 2.643151] NET: Registered protocol family 17
<5>[ 2.646908] Bridge firewalling registered
<6>[ 2.651453] 8021q: 802.1Q VLAN Support v1.8
<5>[ 2.655262] Registering SWP/SWPB emulation handler
<6>[ 2.687146] qcom_rpm 108000.rpm: RPM firmware 3.0.16777364
<6>[ 2.703002] s1a: Bringing 0uV into 1050000-1050000uV
<6>[ 2.703293] s1a: supplied by regulator-dummy
<6>[ 2.707185] s1b: Bringing 0uV into 1050000-1050000uV
<6>[ 2.711576] s1b: supplied by regulator-dummy
<6>[ 2.716391] s2a: Bringing 0uV into 775000-775000uV
<6>[ 2.720804] s2a: supplied by regulator-dummy
<6>[ 2.725232] s2b: Bringing 0uV into 775000-775000uV
<6>[ 2.729812] s2b: supplied by regulator-dummy
<4>[ 2.738243] thermal thermal_zone0: failed to read out thermal zone (-110)
<5>[ 2.754350] UBI: auto-attach mtd6
<5>[ 2.754386] ubi0: attaching mtd6
<5>[ 2.877170] random: crng init done
<5>[ 3.623514] ubi0: scanning is finished
<5>[ 3.635865] ubi0: attached mtd6 (name "ubi", size 96 MiB)
<5>[ 3.635897] ubi0: PEB size: 131072 bytes (128 KiB), LEB size: 126976 bytes
<5>[ 3.640317] ubi0: min./max. I/O unit sizes: 2048/2048, sub-page size 2048
<5>[ 3.647013] ubi0: VID header offset: 2048 (aligned 2048), data offset: 4096
<5>[ 3.653960] ubi0: good PEBs: 772, bad PEBs: 0, corrupted PEBs: 0
<5>[ 3.660718] ubi0: user volume: 2, internal volumes: 1, max. volumes count: 128
<5>[ 3.666895] ubi0: max/mean erase counter: 15/10, WL threshold: 4096, image sequence number: 1635066095
<5>[ 3.674014] ubi0: available PEBs: 0, total reserved PEBs: 772, PEBs reserved for bad PEB handling: 20
<5>[ 3.683965] ubi0: background thread "ubi_bgt0d" started, PID 83
<6>[ 3.693714] block ubiblock0_0: created from ubi0:0(rootfs)
<5>[ 3.698388] ubiblock: device ubiblock0_0 (rootfs) set to be root filesystem
<6>[ 3.711394] VFS: Mounted root (squashfs filesystem) readonly on device 254:0.
<6>[ 3.713296] Freeing unused kernel memory: 1024K
<6>[ 3.738577] Run /sbin/init as init process
<7>[ 3.738601] with arguments:
<7>[ 3.738606] /sbin/init
<7>[ 3.738611] with environment:
<7>[ 3.738618] HOME=/
<7>[ 3.738623] TERM=linux
<14>[ 4.094544] init: Console is alive
<14>[ 4.094822] init: - watchdog -
<14>[ 4.096994] init: Watchdog has previously reset the system
<14>[ 6.472708] kmodloader: loading kernel modules from /etc/modules-boot.d/*
<5>[ 6.607459] Key type encrypted registered
<6>[ 6.624422] device-mapper: ioctl: 4.43.0-ioctl (2020-10-01) initialised: dm-devel@redhat.com
<4>[ 6.672637] genirq: irq_chip msmgpio did not update eff. affinity mask of irq 52
<6>[ 6.675468] pstore: Using crash dump compression: deflate
<6>[ 6.679179] pstore: Registered ramoops as persistent store backend
<6>[ 6.684450] ramoops: using 0x40000@0x42100000, ecc: 0
<6>[ 6.692723] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
<5>[ 6.700295] SCSI subsystem initialized
<7>[ 6.708117] libata version 3.00 loaded.
<4>[ 6.714647] ahci 29000000.sata: supply ahci not found, using dummy regulator
<4>[ 6.714809] ahci 29000000.sata: supply phy not found, using dummy regulator
<4>[ 6.720932] ahci 29000000.sata: supply target not found, using dummy regulator
<6>[ 6.727840] ahci 29000000.sata: forcing port_map 0x0 -> 0x1
<6>[ 6.734831] ahci 29000000.sata: AHCI 0001.0300 32 slots 1 ports 6 Gbps 0x1 impl platform mode
<6>[ 6.740286] ahci 29000000.sata: flags: ncq sntf pm led clo only pmp pio slum part ccc apst
<6>[ 6.749492] scsi host0: ahci
<6>[ 6.757343] ata1: SATA max UDMA/133 mmio [mem 0x29000000-0x2900017f] port 0x100 irq 34
<6>[ 7.090641] ata1: SATA link down (SStatus 0 SControl 300)
<6>[ 7.097690] ehci-fsl: Freescale EHCI Host controller driver
<6>[ 7.100195] ehci-platform: EHCI generic platform driver
<6>[ 7.116890] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
<6>[ 7.117424] ohci-platform: OHCI generic platform driver
<3>[ 7.124198] dwc3-qcom 100f8800.usb3: IRQ hs_phy_irq not found
<3>[ 7.127081] dwc3-qcom 100f8800.usb3: IRQ dp_hs_phy_irq not found
<3>[ 7.133085] dwc3-qcom 100f8800.usb3: IRQ dm_hs_phy_irq not found
<3>[ 7.139118] dwc3-qcom 100f8800.usb3: IRQ ss_phy_irq not found
<3>[ 7.154781] dwc3-qcom 110f8800.usb3: IRQ hs_phy_irq not found
<3>[ 7.154833] dwc3-qcom 110f8800.usb3: IRQ dp_hs_phy_irq not found
<3>[ 7.159626] dwc3-qcom 110f8800.usb3: IRQ dm_hs_phy_irq not found
<3>[ 7.165619] dwc3-qcom 110f8800.usb3: IRQ ss_phy_irq not found
<6>[ 7.314588] xhci-hcd xhci-hcd.0.auto: xHCI Host Controller
<6>[ 7.314641] xhci-hcd xhci-hcd.0.auto: new USB bus registered, assigned bus number 1
<6>[ 7.319198] xhci-hcd xhci-hcd.0.auto: hcc params 0x0228f065 hci version 0x100 quirks 0x0000000002010010
<6>[ 7.326635] xhci-hcd xhci-hcd.0.auto: irq 55, io mem 0x10000000
<6>[ 7.336591] hub 1-0:1.0: USB hub found
<6>[ 7.341894] hub 1-0:1.0: 1 port detected
<6>[ 7.345811] xhci-hcd xhci-hcd.0.auto: xHCI Host Controller
<6>[ 7.349760] xhci-hcd xhci-hcd.0.auto: new USB bus registered, assigned bus number 2
<6>[ 7.354997] xhci-hcd xhci-hcd.0.auto: Host supports USB 3.0 SuperSpeed
<6>[ 7.369507] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
<6>[ 7.370515] hub 2-0:1.0: USB hub found
<6>[ 7.377634] hub 2-0:1.0: 1 port detected
<6>[ 7.381951] xhci-hcd xhci-hcd.1.auto: xHCI Host Controller
<6>[ 7.385073] xhci-hcd xhci-hcd.1.auto: new USB bus registered, assigned bus number 3
<6>[ 7.390691] xhci-hcd xhci-hcd.1.auto: hcc params 0x0228f065 hci version 0x100 quirks 0x0000000002010010
<6>[ 7.397970] xhci-hcd xhci-hcd.1.auto: irq 56, io mem 0x11000000
<6>[ 7.409137] hub 3-0:1.0: USB hub found
<6>[ 7.413297] hub 3-0:1.0: 1 port detected
<6>[ 7.417440] xhci-hcd xhci-hcd.1.auto: xHCI Host Controller
<6>[ 7.421156] xhci-hcd xhci-hcd.1.auto: new USB bus registered, assigned bus number 4
<6>[ 7.426356] xhci-hcd xhci-hcd.1.auto: Host supports USB 3.0 SuperSpeed
<6>[ 7.434112] usb usb4: We don't know the algorithms for LPM for this host, disabling LPM.
<6>[ 7.441217] hub 4-0:1.0: USB hub found
<6>[ 7.448870] hub 4-0:1.0: 1 port detected
<6>[ 7.458574] usbcore: registered new interface driver usb-storage
<6>[ 7.460102] usbcore: registered new interface driver uas
<14>[ 7.463915] kmodloader: done loading kernel modules from /etc/modules-boot.d/*
<14>[ 7.472395] init: - preinit -
<12>[ 19.950900] Starting lvm2 during preinit
<14>[ 21.288306] mount_root: loading kmods from internal overlay
<14>[ 21.333111] kmodloader: loading kernel modules from //etc/modules-boot.d/*
<14>[ 21.391986] kmodloader: done loading kernel modules from //etc/modules-boot.d/*
<5>[ 21.484350] UBIFS (ubi0:1): Mounting in unauthenticated mode
<5>[ 21.484562] UBIFS (ubi0:1): background thread "ubifs_bgt0_1" started, PID 188
<5>[ 21.552347] UBIFS (ubi0:1): recovery needed
<5>[ 21.672110] UBIFS (ubi0:1): recovery completed
<5>[ 21.672204] UBIFS (ubi0:1): UBIFS: mounted UBI device 0, volume 1, name "rootfs_data"
<5>[ 21.675440] UBIFS (ubi0:1): LEB size: 126976 bytes (124 KiB), min./max. I/O unit sizes: 2048 bytes/2048 bytes
<5>[ 21.683417] UBIFS (ubi0:1): FS size: 73392128 bytes (69 MiB, 578 LEBs), journal size 3682304 bytes (3 MiB, 29 LEBs)
<5>[ 21.693304] UBIFS (ubi0:1): reserved for root: 3466491 bytes (3385 KiB)
<5>[ 21.703554] UBIFS (ubi0:1): media format: w5/r0 (latest is w5/r0), UUID 53AB7BD4-A5CD-4815-9982-84C735C95622, small LPT model
<14>[ 21.712107] block: attempting to load /tmp/ubifs_cfg/upper/etc/config/fstab
<14>[ 21.771592] block: extroot: not configured
<5>[ 21.771932] UBIFS (ubi0:1): un-mount UBI device 0
<5>[ 21.774719] UBIFS (ubi0:1): background thread "ubifs_bgt0_1" stops
<5>[ 21.782968] UBIFS (ubi0:1): Mounting in unauthenticated mode
<5>[ 21.785556] UBIFS (ubi0:1): background thread "ubifs_bgt0_1" started, PID 189
<5>[ 21.910098] UBIFS (ubi0:1): UBIFS: mounted UBI device 0, volume 1, name "rootfs_data"
<5>[ 21.910140] UBIFS (ubi0:1): LEB size: 126976 bytes (124 KiB), min./max. I/O unit sizes: 2048 bytes/2048 bytes
<5>[ 21.916941] UBIFS (ubi0:1): FS size: 73392128 bytes (69 MiB, 578 LEBs), journal size 3682304 bytes (3 MiB, 29 LEBs)
<5>[ 21.926893] UBIFS (ubi0:1): reserved for root: 3466491 bytes (3385 KiB)
<5>[ 21.937153] UBIFS (ubi0:1): media format: w5/r0 (latest is w5/r0), UUID 53AB7BD4-A5CD-4815-9982-84C735C95622, small LPT model
<14>[ 21.980603] block: attempting to load /tmp/ubifs_cfg/upper/etc/config/fstab
<14>[ 21.986965] block: extroot: not configured
<14>[ 21.988902] mount_root: switching to ubifs overlay
<12>[ 22.007848] urandom-seed: Seed file not found (/etc/urandom.seed)
<14>[ 22.177383] procd: - early -
<14>[ 22.177526] procd: - watchdog -
<14>[ 22.179536] procd: Watchdog has previously reset the system
<14>[ 22.769114] procd: - watchdog -
<14>[ 22.769313] procd: Watchdog has previously reset the system
<14>[ 22.775608] procd: - ubus -
<14>[ 22.852289] procd: - init -
<14>[ 23.435559] urngd: v1.0.2 started.
<14>[ 23.500104] kmodloader: loading kernel modules from /etc/modules.d/*
<6>[ 23.559487] NET: Registered protocol family 38
<5>[ 23.582830] Key type dns_resolver registered
<6>[ 23.599154] RPC: Registered named UNIX socket transport module.
<6>[ 23.599194] RPC: Registered udp transport module.
<6>[ 23.603886] RPC: Registered tcp transport module.
<6>[ 23.608824] RPC: Registered tcp NFSv4.1 backchannel transport module.
<6>[ 23.620769] NET: Registered protocol family 15
<6>[ 23.623394] Initializing XFRM netlink socket
<6>[ 23.626912] tun: Universal TUN/TAP device driver, 1.6
<6>[ 23.635596] **********************************************************
<6>[ 23.635636] * Driver :NSS GMAC Driver - RTL v(3.72a)
<6>[ 23.641120] * Version :1.0
<6>[ 23.646149] * Copyright :Copyright (c) 2013-2018 The Linux Foundation. All rights reserved.
<6>[ 23.649433] **********************************************************
<1>[ 24.300112] nss_driver - fw of size 536324 bytes copied to load addr: 40000000, nss_id : 0
<1>[ 24.300826] nss_driver - Turbo Support 1
<1>[ 24.307269] Supported Frequencies -
<1>[ 24.307274] 800Mhz
<1>[ 24.311507] 800Mhz
<1>[ 24.314985] 800Mhz
<1>[ 24.316805]
<1>[ 24.321189] 9cbb12a9: meminfo init succeed
<1>[ 24.351095] node size 1 # items 2
<1>[ 24.351128] memory: 0 0 (avl 496484352) items 2 active_cores 2
<1>[ 24.353404] 9cbb12a9: nss core 0 booted successfully
<1>[ 24.369911] nss_driver - fw of size 218224 bytes copied to load addr: 40800000, nss_id : 1
<1>[ 24.370451] 6e2a1e1a: meminfo init succeed
<3>[ 24.377986] debugfs: File 'n2h' in directory 'stats' already present!
<3>[ 24.381367] debugfs: File 'qrfs' in directory 'stats' already present!
<3>[ 24.387754] debugfs: File 'c2c_tx' in directory 'stats' already present!
<3>[ 24.394260] debugfs: File 'c2c_rx' in directory 'stats' already present!
<3>[ 24.401102] debugfs: File 'unaligned' in directory 'stats' already present!
<1>[ 24.410565] node size 1 # items 2
<1>[ 24.414396] memory: 0 0 (avl 496484352) items 2 active_cores 2
<1>[ 24.417883] 6e2a1e1a: nss core 1 booted successfully
<6>[ 24.429061] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver
<5>[ 24.463705] NFS: Registering the id_resolver key type
<5>[ 24.463780] Key type id_resolver registered
<5>[ 24.467778] Key type id_legacy registered
<6>[ 24.493773] cryptodev: driver 1.12 loaded.
<6>[ 24.497534] PPP generic driver version 2.4.2
<6>[ 24.498908] NET: Registered protocol family 24
<6>[ 24.506587] GACT probability on
<6>[ 24.507397] Mirror/redirect action on
<6>[ 24.519565] u32 classifier
<6>[ 24.519596] input device check on
<6>[ 24.521206] Actions configured
<6>[ 24.538067] fuse: init (API version 7.32)
<6>[ 24.547758] Loading modules backported from Linux version v5.15.33-0-g06f50ca83ace
<6>[ 24.547796] Backport generated by backports.git v5.15.33-1-0-g183c4ab2
<6>[ 24.597349] usbcore: registered new interface driver usbserial_generic
<6>[ 24.597403] usbserial: USB Serial support registered for generic
<6>[ 24.621009] xt_time: kernel timezone is -0000
<6>[ 24.621747] usbcore: registered new interface driver belkin_sa
<6>[ 24.624460] usbserial: USB Serial support registered for Belkin / Peracom / GoHubs USB Serial Adapter
<6>[ 24.657083] usbcore: registered new interface driver ch341
<6>[ 24.657142] usbserial: USB Serial support registered for ch341-uart
<6>[ 24.662168] usbcore: registered new interface driver cp210x
<6>[ 24.667700] usbserial: USB Serial support registered for cp210x
<6>[ 24.675300] usbcore: registered new interface driver ftdi_sio
<6>[ 24.679193] usbserial: USB Serial support registered for FTDI USB Serial Device
<6>[ 24.762525] usbcore: registered new interface driver pl2303
<6>[ 24.762586] usbserial: USB Serial support registered for pl2303
<6>[ 24.769328] wireguard: WireGuard 1.0.0 loaded. See www.wireguard.com for information.
<6>[ 24.772806] wireguard: Copyright (C) 2015-2019 Jason A. Donenfeld <Jason@zx2c4.com>. All Rights Reserved.
<7>[ 24.797499] ath10k_pci 0000:01:00.0: assign IRQ: got 47
<6>[ 24.797967] ath10k_pci 0000:01:00.0: enabling device (0140 -> 0142)
<7>[ 24.798059] ath10k_pci 0000:01:00.0: enabling bus mastering
<6>[ 24.798723] ath10k_pci 0000:01:00.0: pci irq msi oper_irq_mode 2 irq_mode 0 reset_mode 0
<6>[ 28.885296] ath10k_pci 0000:01:00.0: qca9984/qca9994 hw1.0 target 0x01000000 chip_id 0x00000000 sub 168c:cafe
<6>[ 28.885366] ath10k_pci 0000:01:00.0: kconfig debug 0 debugfs 1 tracing 0 dfs 1 testmode 0
<6>[ 28.900719] ath10k_pci 0000:01:00.0: firmware ver 10.4-3.9.0.2-00157 api 5 features no-p2p,mfp,peer-flow-ctrl,btcoex-param,allows-mesh-bcast,no-ps,peer-fixed-rate,iram-recovery crc32 6cdc6ff9
<6>[ 31.177335] ath10k_pci 0000:01:00.0: board_file api 2 bmi_id 0:1 crc32 826c8c57
<6>[ 35.115907] ath10k_pci 0000:01:00.0: htt-ver 2.2 wmi-op 6 htt-op 4 cal pre-cal-nvmem max-sta 512 raw 0 hwcrypto 1
<7>[ 35.210714] ath: EEPROM regdomain: 0x0
<7>[ 35.210737] ath: EEPROM indicates default country code should be used
<7>[ 35.210752] ath: doing EEPROM country->regdmn map search
<7>[ 35.210776] ath: country maps to regdmn code: 0x3a
<7>[ 35.210794] ath: Country alpha2 being used: US
<7>[ 35.210810] ath: Regpair used: 0x3a
<7>[ 35.215991] ath10k_pci 0001:01:00.0: assign IRQ: got 49
<6>[ 35.217503] ath10k_pci 0001:01:00.0: enabling device (0140 -> 0142)
<7>[ 35.217657] ath10k_pci 0001:01:00.0: enabling bus mastering
<6>[ 35.218682] ath10k_pci 0001:01:00.0: pci irq msi oper_irq_mode 2 irq_mode 0 reset_mode 0
<6>[ 35.897530] ath10k_pci 0001:01:00.0: qca9984/qca9994 hw1.0 target 0x01000000 chip_id 0x00000000 sub 168c:cafe
<6>[ 35.897578] ath10k_pci 0001:01:00.0: kconfig debug 0 debugfs 1 tracing 0 dfs 1 testmode 0
<6>[ 35.908935] ath10k_pci 0001:01:00.0: firmware ver 10.4-3.9.0.2-00157 api 5 features no-p2p,mfp,peer-flow-ctrl,btcoex-param,allows-mesh-bcast,no-ps,peer-fixed-rate,iram-recovery crc32 6cdc6ff9
<6>[ 38.191561] ath10k_pci 0001:01:00.0: board_file api 2 bmi_id 0:2 crc32 826c8c57
<6>[ 42.109289] ath10k_pci 0001:01:00.0: htt-ver 2.2 wmi-op 6 htt-op 4 cal pre-cal-nvmem max-sta 512 raw 0 hwcrypto 1
<7>[ 42.200277] ath: EEPROM regdomain: 0x0
<7>[ 42.200298] ath: EEPROM indicates default country code should be used
<7>[ 42.200314] ath: doing EEPROM country->regdmn map search
<7>[ 42.200338] ath: country maps to regdmn code: 0x3a
<7>[ 42.200356] ath: Country alpha2 being used: US
<7>[ 42.200371] ath: Regpair used: 0x3a
<14>[ 42.212909] kmodloader: done loading kernel modules from /etc/modules.d/*
<6>[ 45.741558] ECM init
<6>[ 45.741597] ECM database jhash random seed: 0xf7a4e310
<6>[ 45.742633] ECM init complete
<6>[ 48.321013] ipq8064-mdio 37000000.mdio eth1: 1000 Mbps Full Duplex
<6>[ 49.444889] br-lan: port 1(eth1.1) entered blocking state
<6>[ 49.444915] br-lan: port 1(eth1.1) entered disabled state
<6>[ 49.445476] device eth1.1 entered promiscuous mode
<6>[ 49.445487] device eth1 entered promiscuous mode
<6>[ 49.446289] IPv6: ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
<6>[ 49.450282] br-lan: port 1(eth1.1) entered blocking state
<6>[ 49.450301] br-lan: port 1(eth1.1) entered forwarding state
<6>[ 49.468422] ipq8064-mdio 37000000.mdio eth0: 1000 Mbps Full Duplex
<6>[ 50.562381] IPv6: ADDRCONF(NETDEV_CHANGE): br-lan: link becomes ready
<6>[ 50.562624] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
<4>[ 57.985574] ath10k_pci 0001:01:00.0: Unknown eventid: 36933
<6>[ 57.989159] wlan1: Created a NSS virtual interface
<6>[ 57.991727] br-lan: port 2(wlan1) entered blocking state
<6>[ 57.991745] br-lan: port 2(wlan1) entered disabled state
<6>[ 57.992047] device wlan1 entered promiscuous mode
<6>[ 57.992205] br-lan: port 2(wlan1) entered blocking state
<6>[ 57.992225] br-lan: port 2(wlan1) entered forwarding state
<3>[ 57.998716] debugfs: File 'virt_if' in directory 'stats' already present!
<6>[ 57.999026] Created a NSS virtual interface for dev [nssifb]
<6>[ 57.999035] NSS IFB data callback registered
<6>[ 57.999042] NSS IFB transmit callback registered
<6>[ 57.999784] NSS IFB module loaded.
<6>[ 58.004807] br-lan: port 2(wlan1) entered disabled state
<6>[ 58.030319] 9cbb12a9: Found net device [eth0]
<6>[ 58.030333] 9cbb12a9: Net device [eth0] has NSS intf_num [1]
<1>[ 58.030805] 8<--- cut here ---
<1>[ 58.030833] Unable to handle kernel NULL pointer dereference at virtual address 00000138
<6>[ 58.031304] Nexthop successfully set for [eth0] to [nssifb]
<1>[ 58.032762] pgd = 6aa5ce7a
<1>[ 58.041082] [00000138] *pgd=00000000
<0>[ 58.043548] Internal error: Oops: 5 [#1] SMP ARM
<4>[ 58.047250] Modules linked in: nss_ifb ecm nft_fib_inet nf_flow_table_ipv6 nf_flow_table_ipv4 nf_flow_table_inet ath10k_pci ath10k_core ath wireguard pl2303 nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject nft_redir nft_quota nft_objref nft_numgen nft_nat nft_masq nft_log nft_limit nft_hash nft_flow_offload nft_fib_ipv6 nft_fib_ipv4 nft_fib nft_ct nft_counter nft_chain_nat nf_tables nf_conntrack_netlink mac80211 libchacha20poly1305 ipt_REJECT ftdi_sio curve25519_neon cp210x ch341 cfg80211 belkin_sa xt_time xt_tcpudp xt_tcpmss xt_statistic xt_state xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length xt_hl xt_ecn xt_dscp xt_conntrack xt_comment xt_TCPMSS xt_REDIRECT xt_MASQUERADE xt_LOG xt_HL xt_DSCP xt_CT xt_CLASSIFY usbserial sch_cake ppp_async poly1305_arm nfnetlink nf_reject_ipv4 nf_log_ipv6 nf_log_ipv4 nf_log_common nf_flow_table libcurve25519_generic libcrc32c iptable_nat iptable_mangle iptable_filter ipt_ECN ip_tables crc_ccitt compat chacha_neon fuse sch_tbf sch_ingress
<4>[ 58.047778] sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact qca_nss_qdisc qca_nss_pppoe pppoe pppox ppp_generic slhc ledtrig_usbport cryptodev ip6table_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ip6t_NPT ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsv4 nfsv3 nfs nfs_ssc msdos bonding ifb ip6_udp_tunnel udp_tunnel sit qca_nss_drv qca_nss_gmac oid_registry tunnel4 ip_tunnel tun xfrm_user xfrm_ipcomp af_key xfrm_algo vfat fat lockd sunrpc grace hfsplus hfs cdrom dns_resolver nls_utf8 nls_iso8859_15 nls_iso8859_1 nls_cp850 nls_cp437 nls_cp1250 wp512 twofish_generic twofish_common tgr192 tea serpent_generic khazad cast6_generic cast5_generic cast_common camellia_generic blowfish_generic blowfish_common anubis xts crypto_user algif_skcipher algif_rng algif_hash algif_aead af_alg sha1_generic seqiv md5 kpp echainiv ecb des_generic libdes cmac authenc uas usb_storage
<4>[ 58.117348] leds_gpio xhci_plat_hcd xhci_pci xhci_hcd dwc3 dwc3_qcom ohci_platform ohci_hcd phy_qcom_ipq806x_usb ahci fsl_mph_dr_of ehci_platform ehci_fsl sd_mod ahci_platform libahci_platform libahci libata scsi_mod ehci_hcd ramoops reed_solomon pstore gpio_button_hotplug f2fs ext4 mbcache jbd2 exfat dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax crc32c_generic crc32_generic cbc encrypted_keys trusted tpm
<4>[ 58.240122] CPU: 0 PID: 1427 Comm: odhcpd Not tainted 5.10.131 #0
<4>[ 58.262350] Hardware name: Generic DT based system
<4>[ 58.268610] PC is at eth_type_trans+0x20/0x20c
<4>[ 58.273292] LR is at nss_ifb_data_cb+0x20/0x54 [nss_ifb]
<4>[ 58.277714] pc : [<c08771e4>] lr : [<bf92e2e8>] psr: 80000113
<4>[ 58.283183] sp : c5d37de8 ip : bf5700a8 fp : 00000002
<4>[ 58.289172] r10: 00000028 r9 : c50b4800 r8 : bf566040
<4>[ 58.294381] r7 : 00000000 r6 : bf566388 r5 : 00000000 r4 : c73ae780
<4>[ 58.299591] r3 : 00000001 r2 : bf566690 r1 : 00000000 r0 : c73ae780
<4>[ 58.306190] Flags: Nzcv IRQs on FIQs on Mode SVC_32 ISA ARM Segment none
<4>[ 58.312701] Control: 10c5787d Table: 47be006a DAC: 00000051
<0>[ 58.319905] Process odhcpd (pid: 1427, stack limit = 0x09a28429)
<0>[ 58.325633] Stack: (0xc5d37de8 to 0xc5d38000)
<0>[ 58.331719] 7de0: c30d9540 00000028 c73ae780 bf566690 bf566388 00000000
<0>[ 58.335980] 7e00: bf566040 bf92e2e8 c73ae780 bf92e2c8 bf566388 bf51eb18 00000000 c5002e00
<0>[ 58.344141] 7e20: bf566690 c30d9040 bf566058 0000007f 0000001e 00000008 00000001 000000f0
<0>[ 58.352301] 7e40: c273f400 bf566680 00000002 00000001 c273f404 00000001 c5385840 bf566690
<0>[ 58.360460] 7e60: 00000040 bf566040 bf573000 00000000 bf548c20 bf566680 00000002 bf51fe20
<0>[ 58.368620] 7e80: c5385900 00000040 c5ef8d80 00000002 c5d37ec4 00000001 bf566690 00000040
<0>[ 58.376781] 7ea0: c5d37edf c5d37ee0 c0d03d00 1cd49000 c5d37ee8 c082d078 bf566690 dd991700
<0>[ 58.384940] 7ec0: 0000012c c0c48700 c5d37ee0 c082d394 c5d37ed0 ffffa17d 00000000 00385900
<0>[ 58.393099] 7ee0: c5d37ee0 c5d37ee0 c5d37ee8 c5d37ee8 c5d36000 00000000 00000003 c0d0308c
<0>[ 58.401259] 7f00: c0d03080 40000003 c5d36000 00000100 c5d37f18 c0301378 c5d37f28 000f423e
<0>[ 58.409420] 7f20: c5d37f34 c0d03080 c0c41220 0000000a c0c411ac c0c47940 c0c47940 ffffa17c
<0>[ 58.417578] 7f40: c0d03d00 00400100 c5d37f90 ffffe000 00000000 00000000 00000001 c1410000
<0>[ 58.425738] 7f60: de80200c c5d37f90 beec4e04 c032311c c0c46cb8 c0371848 c0d05334 c5d37fb0
<0>[ 58.433897] 7f80: c0d7e664 de802000 c0c46cc4 c064c0dc b6ea6b74 80000010 ffffffff 10c5787d
<0>[ 58.442058] 7fa0: 10c5387d b6efed10 beec4e0c c0300f10 018414c0 00000024 00000086 000004ff
<0>[ 58.450218] 7fc0: 03f0c19f 03f0c19f 00000000 b6efed10 beec4e08 b6efed10 beec4e0c beec4e04
<0>[ 58.458376] 7fe0: b6ee721c beec4d90 b6ea7ba8 b6ea6b74 80000010 ffffffff 00000000 00000000
<0>[ 58.466533] [<c08771e4>] (eth_type_trans) from [<bf92e2e8>] (nss_ifb_data_cb+0x20/0x54 [nss_ifb])
<0>[ 58.474905] [<bf92e2e8>] (nss_ifb_data_cb [nss_ifb]) from [<bf51eb18>] (nss_core_send_buffer+0x1b18/0x1fd8 [qca_nss_drv])
<0>[ 58.483723] [<bf51eb18>] (nss_core_send_buffer [qca_nss_drv]) from [<bf51fe20>] (nss_core_handle_napi+0x194/0x238 [qca_nss_drv])
<0>[ 58.494577] [<bf51fe20>] (nss_core_handle_napi [qca_nss_drv]) from [<c082d078>] (__napi_poll+0x34/0x150)
<0>[ 58.506112] [<c082d078>] (__napi_poll) from [<c082d394>] (net_rx_action+0xdc/0x270)
<0>[ 58.515574] [<c082d394>] (net_rx_action) from [<c0301378>] (__do_softirq+0x110/0x2b8)
<0>[ 58.522952] [<c0301378>] (__do_softirq) from [<c032311c>] (irq_exit+0xb8/0x118)
<0>[ 58.530936] [<c032311c>] (irq_exit) from [<c0371848>] (__handle_domain_irq+0x94/0xf4)
<0>[ 58.538057] [<c0371848>] (__handle_domain_irq) from [<c064c0dc>] (gic_handle_irq+0x90/0xb8)
<0>[ 58.546040] [<c064c0dc>] (gic_handle_irq) from [<c0300f10>] (__irq_usr+0x50/0x80)
<0>[ 58.554193] Exception stack(0xc5d37fb0 to 0xc5d37ff8)
<0>[ 58.561839] 7fa0: 018414c0 00000024 00000086 000004ff
<0>[ 58.566883] 7fc0: 03f0c19f 03f0c19f 00000000 b6efed10 beec4e08 b6efed10 beec4e0c beec4e04
<0>[ 58.575040] 7fe0: b6ee721c beec4d90 b6ea7ba8 b6ea6b74 80000010 ffffffff
<0>[ 58.583195] Code: e58d8010 e58de014 e24dd008 e5801008 (e5913138)
<4>[ 58.589842] ---[ end trace 409a7d1df4a9ab0a ]---
dmesg-ramoops-1
Panic#2 Part1
<6>[ 2.613616] i2c /dev entries driver
<6>[ 2.623559] sdhci: Secure Digital Host Controller Interface driver
<6>[ 2.623611] sdhci: Copyright(c) Pierre Ossman
<6>[ 2.628779] sdhci-pltfm: SDHCI platform and OF driver helper
<6>[ 2.637113] NET: Registered protocol family 10
<6>[ 2.641069] Segment Routing with IPv6
<6>[ 2.643151] NET: Registered protocol family 17
<5>[ 2.646908] Bridge firewalling registered
<6>[ 2.651453] 8021q: 802.1Q VLAN Support v1.8
<5>[ 2.655262] Registering SWP/SWPB emulation handler
<6>[ 2.687146] qcom_rpm 108000.rpm: RPM firmware 3.0.16777364
<6>[ 2.703002] s1a: Bringing 0uV into 1050000-1050000uV
<6>[ 2.703293] s1a: supplied by regulator-dummy
<6>[ 2.707185] s1b: Bringing 0uV into 1050000-1050000uV
<6>[ 2.711576] s1b: supplied by regulator-dummy
<6>[ 2.716391] s2a: Bringing 0uV into 775000-775000uV
<6>[ 2.720804] s2a: supplied by regulator-dummy
<6>[ 2.725232] s2b: Bringing 0uV into 775000-775000uV
<6>[ 2.729812] s2b: supplied by regulator-dummy
<4>[ 2.738243] thermal thermal_zone0: failed to read out thermal zone (-110)
<5>[ 2.754350] UBI: auto-attach mtd6
<5>[ 2.754386] ubi0: attaching mtd6
<5>[ 2.877170] random: crng init done
<5>[ 3.623514] ubi0: scanning is finished
<5>[ 3.635865] ubi0: attached mtd6 (name "ubi", size 96 MiB)
<5>[ 3.635897] ubi0: PEB size: 131072 bytes (128 KiB), LEB size: 126976 bytes
<5>[ 3.640317] ubi0: min./max. I/O unit sizes: 2048/2048, sub-page size 2048
<5>[ 3.647013] ubi0: VID header offset: 2048 (aligned 2048), data offset: 4096
<5>[ 3.653960] ubi0: good PEBs: 772, bad PEBs: 0, corrupted PEBs: 0
<5>[ 3.660718] ubi0: user volume: 2, internal volumes: 1, max. volumes count: 128
<5>[ 3.666895] ubi0: max/mean erase counter: 15/10, WL threshold: 4096, image sequence number: 1635066095
<5>[ 3.674014] ubi0: available PEBs: 0, total reserved PEBs: 772, PEBs reserved for bad PEB handling: 20
<5>[ 3.683965] ubi0: background thread "ubi_bgt0d" started, PID 83
<6>[ 3.693714] block ubiblock0_0: created from ubi0:0(rootfs)
<5>[ 3.698388] ubiblock: device ubiblock0_0 (rootfs) set to be root filesystem
<6>[ 3.711394] VFS: Mounted root (squashfs filesystem) readonly on device 254:0.
<6>[ 3.713296] Freeing unused kernel memory: 1024K
<6>[ 3.738577] Run /sbin/init as init process
<7>[ 3.738601] with arguments:
<7>[ 3.738606] /sbin/init
<7>[ 3.738611] with environment:
<7>[ 3.738618] HOME=/
<7>[ 3.738623] TERM=linux
<14>[ 4.094544] init: Console is alive
<14>[ 4.094822] init: - watchdog -
<14>[ 4.096994] init: Watchdog has previously reset the system
<14>[ 6.472708] kmodloader: loading kernel modules from /etc/modules-boot.d/*
<5>[ 6.607459] Key type encrypted registered
<6>[ 6.624422] device-mapper: ioctl: 4.43.0-ioctl (2020-10-01) initialised: dm-devel@redhat.com
<4>[ 6.672637] genirq: irq_chip msmgpio did not update eff. affinity mask of irq 52
<6>[ 6.675468] pstore: Using crash dump compression: deflate
<6>[ 6.679179] pstore: Registered ramoops as persistent store backend
<6>[ 6.684450] ramoops: using 0x40000@0x42100000, ecc: 0
<6>[ 6.692723] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
<5>[ 6.700295] SCSI subsystem initialized
<7>[ 6.708117] libata version 3.00 loaded.
<4>[ 6.714647] ahci 29000000.sata: supply ahci not found, using dummy regulator
<4>[ 6.714809] ahci 29000000.sata: supply phy not found, using dummy regulator
<4>[ 6.720932] ahci 29000000.sata: supply target not found, using dummy regulator
<6>[ 6.727840] ahci 29000000.sata: forcing port_map 0x0 -> 0x1
<6>[ 6.734831] ahci 29000000.sata: AHCI 0001.0300 32 slots 1 ports 6 Gbps 0x1 impl platform mode
<6>[ 6.740286] ahci 29000000.sata: flags: ncq sntf pm led clo only pmp pio slum part ccc apst
<6>[ 6.749492] scsi host0: ahci
<6>[ 6.757343] ata1: SATA max UDMA/133 mmio [mem 0x29000000-0x2900017f] port 0x100 irq 34
<6>[ 7.090641] ata1: SATA link down (SStatus 0 SControl 300)
<6>[ 7.097690] ehci-fsl: Freescale EHCI Host controller driver
<6>[ 7.100195] ehci-platform: EHCI generic platform driver
<6>[ 7.116890] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
<6>[ 7.117424] ohci-platform: OHCI generic platform driver
<3>[ 7.124198] dwc3-qcom 100f8800.usb3: IRQ hs_phy_irq not found
<3>[ 7.127081] dwc3-qcom 100f8800.usb3: IRQ dp_hs_phy_irq not found
<3>[ 7.133085] dwc3-qcom 100f8800.usb3: IRQ dm_hs_phy_irq not found
<3>[ 7.139118] dwc3-qcom 100f8800.usb3: IRQ ss_phy_irq not found
<3>[ 7.154781] dwc3-qcom 110f8800.usb3: IRQ hs_phy_irq not found
<3>[ 7.154833] dwc3-qcom 110f8800.usb3: IRQ dp_hs_phy_irq not found
<3>[ 7.159626] dwc3-qcom 110f8800.usb3: IRQ dm_hs_phy_irq not found
<3>[ 7.165619] dwc3-qcom 110f8800.usb3: IRQ ss_phy_irq not found
<6>[ 7.314588] xhci-hcd xhci-hcd.0.auto: xHCI Host Controller
<6>[ 7.314641] xhci-hcd xhci-hcd.0.auto: new USB bus registered, assigned bus number 1
<6>[ 7.319198] xhci-hcd xhci-hcd.0.auto: hcc params 0x0228f065 hci version 0x100 quirks 0x0000000002010010
<6>[ 7.326635] xhci-hcd xhci-hcd.0.auto: irq 55, io mem 0x10000000
<6>[ 7.336591] hub 1-0:1.0: USB hub found
<6>[ 7.341894] hub 1-0:1.0: 1 port detected
<6>[ 7.345811] xhci-hcd xhci-hcd.0.auto: xHCI Host Controller
<6>[ 7.349760] xhci-hcd xhci-hcd.0.auto: new USB bus registered, assigned bus number 2
<6>[ 7.354997] xhci-hcd xhci-hcd.0.auto: Host supports USB 3.0 SuperSpeed
<6>[ 7.369507] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
<6>[ 7.370515] hub 2-0:1.0: USB hub found
<6>[ 7.377634] hub 2-0:1.0: 1 port detected
<6>[ 7.381951] xhci-hcd xhci-hcd.1.auto: xHCI Host Controller
<6>[ 7.385073] xhci-hcd xhci-hcd.1.auto: new USB bus registered, assigned bus number 3
<6>[ 7.390691] xhci-hcd xhci-hcd.1.auto: hcc params 0x0228f065 hci version 0x100 quirks 0x0000000002010010
<6>[ 7.397970] xhci-hcd xhci-hcd.1.auto: irq 56, io mem 0x11000000
<6>[ 7.409137] hub 3-0:1.0: USB hub found
<6>[ 7.413297] hub 3-0:1.0: 1 port detected
<6>[ 7.417440] xhci-hcd xhci-hcd.1.auto: xHCI Host Controller
<6>[ 7.421156] xhci-hcd xhci-hcd.1.auto: new USB bus registered, assigned bus number 4
<6>[ 7.426356] xhci-hcd xhci-hcd.1.auto: Host supports USB 3.0 SuperSpeed
<6>[ 7.434112] usb usb4: We don't know the algorithms for LPM for this host, disabling LPM.
<6>[ 7.441217] hub 4-0:1.0: USB hub found
<6>[ 7.448870] hub 4-0:1.0: 1 port detected
<6>[ 7.458574] usbcore: registered new interface driver usb-storage
<6>[ 7.460102] usbcore: registered new interface driver uas
<14>[ 7.463915] kmodloader: done loading kernel modules from /etc/modules-boot.d/*
<14>[ 7.472395] init: - preinit -
<12>[ 19.950900] Starting lvm2 during preinit
<14>[ 21.288306] mount_root: loading kmods from internal overlay
<14>[ 21.333111] kmodloader: loading kernel modules from //etc/modules-boot.d/*
<14>[ 21.391986] kmodloader: done loading kernel modules from //etc/modules-boot.d/*
<5>[ 21.484350] UBIFS (ubi0:1): Mounting in unauthenticated mode
<5>[ 21.484562] UBIFS (ubi0:1): background thread "ubifs_bgt0_1" started, PID 188
<5>[ 21.552347] UBIFS (ubi0:1): recovery needed
<5>[ 21.672110] UBIFS (ubi0:1): recovery completed
<5>[ 21.672204] UBIFS (ubi0:1): UBIFS: mounted UBI device 0, volume 1, name "rootfs_data"
<5>[ 21.675440] UBIFS (ubi0:1): LEB size: 126976 bytes (124 KiB), min./max. I/O unit sizes: 2048 bytes/2048 bytes
<5>[ 21.683417] UBIFS (ubi0:1): FS size: 73392128 bytes (69 MiB, 578 LEBs), journal size 3682304 bytes (3 MiB, 29 LEBs)
<5>[ 21.693304] UBIFS (ubi0:1): reserved for root: 3466491 bytes (3385 KiB)
<5>[ 21.703554] UBIFS (ubi0:1): media format: w5/r0 (latest is w5/r0), UUID 53AB7BD4-A5CD-4815-9982-84C735C95622, small LPT model
<14>[ 21.712107] block: attempting to load /tmp/ubifs_cfg/upper/etc/config/fstab
<14>[ 21.771592] block: extroot: not configured
<5>[ 21.771932] UBIFS (ubi0:1): un-mount UBI device 0
<5>[ 21.774719] UBIFS (ubi0:1): background thread "ubifs_bgt0_1" stops
<5>[ 21.782968] UBIFS (ubi0:1): Mounting in unauthenticated mode
<5>[ 21.785556] UBIFS (ubi0:1): background thread "ubifs_bgt0_1" started, PID 189
<5>[ 21.910098] UBIFS (ubi0:1): UBIFS: mounted UBI device 0, volume 1, name "rootfs_data"
<5>[ 21.910140] UBIFS (ubi0:1): LEB size: 126976 bytes (124 KiB), min./max. I/O unit sizes: 2048 bytes/2048 bytes
<5>[ 21.916941] UBIFS (ubi0:1): FS size: 73392128 bytes (69 MiB, 578 LEBs), journal size 3682304 bytes (3 MiB, 29 LEBs)
<5>[ 21.926893] UBIFS (ubi0:1): reserved for root: 3466491 bytes (3385 KiB)
<5>[ 21.937153] UBIFS (ubi0:1): media format: w5/r0 (latest is w5/r0), UUID 53AB7BD4-A5CD-4815-9982-84C735C95622, small LPT model
<14>[ 21.980603] block: attempting to load /tmp/ubifs_cfg/upper/etc/config/fstab
<14>[ 21.986965] block: extroot: not configured
<14>[ 21.988902] mount_root: switching to ubifs overlay
<12>[ 22.007848] urandom-seed: Seed file not found (/etc/urandom.seed)
<14>[ 22.177383] procd: - early -
<14>[ 22.177526] procd: - watchdog -
<14>[ 22.179536] procd: Watchdog has previously reset the system
<14>[ 22.769114] procd: - watchdog -
<14>[ 22.769313] procd: Watchdog has previously reset the system
<14>[ 22.775608] procd: - ubus -
<14>[ 22.852289] procd: - init -
<14>[ 23.435559] urngd: v1.0.2 started.
<14>[ 23.500104] kmodloader: loading kernel modules from /etc/modules.d/*
<6>[ 23.559487] NET: Registered protocol family 38
<5>[ 23.582830] Key type dns_resolver registered
<6>[ 23.599154] RPC: Registered named UNIX socket transport module.
<6>[ 23.599194] RPC: Registered udp transport module.
<6>[ 23.603886] RPC: Registered tcp transport module.
<6>[ 23.608824] RPC: Registered tcp NFSv4.1 backchannel transport module.
<6>[ 23.620769] NET: Registered protocol family 15
<6>[ 23.623394] Initializing XFRM netlink socket
<6>[ 23.626912] tun: Universal TUN/TAP device driver, 1.6
<6>[ 23.635596] **********************************************************
<6>[ 23.635636] * Driver :NSS GMAC Driver - RTL v(3.72a)
<6>[ 23.641120] * Version :1.0
<6>[ 23.646149] * Copyright :Copyright (c) 2013-2018 The Linux Foundation. All rights reserved.
<6>[ 23.649433] **********************************************************
<1>[ 24.300112] nss_driver - fw of size 536324 bytes copied to load addr: 40000000, nss_id : 0
<1>[ 24.300826] nss_driver - Turbo Support 1
<1>[ 24.307269] Supported Frequencies -
<1>[ 24.307274] 800Mhz
<1>[ 24.311507] 800Mhz
<1>[ 24.314985] 800Mhz
<1>[ 24.316805]
<1>[ 24.321189] 9cbb12a9: meminfo init succeed
<1>[ 24.351095] node size 1 # items 2
<1>[ 24.351128] memory: 0 0 (avl 496484352) items 2 active_cores 2
<1>[ 24.353404] 9cbb12a9: nss core 0 booted successfully
<1>[ 24.369911] nss_driver - fw of size 218224 bytes copied to load addr: 40800000, nss_id : 1
<1>[ 24.370451] 6e2a1e1a: meminfo init succeed
<3>[ 24.377986] debugfs: File 'n2h' in directory 'stats' already present!
<3>[ 24.381367] debugfs: File 'qrfs' in directory 'stats' already present!
<3>[ 24.387754] debugfs: File 'c2c_tx' in directory 'stats' already present!
<3>[ 24.394260] debugfs: File 'c2c_rx' in directory 'stats' already present!
<3>[ 24.401102] debugfs: File 'unaligned' in directory 'stats' already present!
<1>[ 24.410565] node size 1 # items 2
<1>[ 24.414396] memory: 0 0 (avl 496484352) items 2 active_cores 2
<1>[ 24.417883] 6e2a1e1a: nss core 1 booted successfully
<6>[ 24.429061] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver
<5>[ 24.463705] NFS: Registering the id_resolver key type
<5>[ 24.463780] Key type id_resolver registered
<5>[ 24.467778] Key type id_legacy registered
<6>[ 24.493773] cryptodev: driver 1.12 loaded.
<6>[ 24.497534] PPP generic driver version 2.4.2
<6>[ 24.498908] NET: Registered protocol family 24
<6>[ 24.506587] GACT probability on
<6>[ 24.507397] Mirror/redirect action on
<6>[ 24.519565] u32 classifier
<6>[ 24.519596] input device check on
<6>[ 24.521206] Actions configured
<6>[ 24.538067] fuse: init (API version 7.32)
<6>[ 24.547758] Loading modules backported from Linux version v5.15.33-0-g06f50ca83ace
<6>[ 24.547796] Backport generated by backports.git v5.15.33-1-0-g183c4ab2
<6>[ 24.597349] usbcore: registered new interface driver usbserial_generic
<6>[ 24.597403] usbserial: USB Serial support registered for generic
<6>[ 24.621009] xt_time: kernel timezone is -0000
<6>[ 24.621747] usbcore: registered new interface driver belkin_sa
<6>[ 24.624460] usbserial: USB Serial support registered for Belkin / Peracom / GoHubs USB Serial Adapter
<6>[ 24.657083] usbcore: registered new interface driver ch341
<6>[ 24.657142] usbserial: USB Serial support registered for ch341-uart
<6>[ 24.662168] usbcore: registered new interface driver cp210x
<6>[ 24.667700] usbserial: USB Serial support registered for cp210x
<6>[ 24.675300] usbcore: registered new interface driver ftdi_sio
<6>[ 24.679193] usbserial: USB Serial support registered for FTDI USB Serial Device
<6>[ 24.762525] usbcore: registered new interface driver pl2303
<6>[ 24.762586] usbserial: USB Serial support registered for pl2303
<6>[ 24.769328] wireguard: WireGuard 1.0.0 loaded. See www.wireguard.com for information.
<6>[ 24.772806] wireguard: Copyright (C) 2015-2019 Jason A. Donenfeld <Jason@zx2c4.com>. All Rights Reserved.
<7>[ 24.797499] ath10k_pci 0000:01:00.0: assign IRQ: got 47
<6>[ 24.797967] ath10k_pci 0000:01:00.0: enabling device (0140 -> 0142)
<7>[ 24.798059] ath10k_pci 0000:01:00.0: enabling bus mastering
<6>[ 24.798723] ath10k_pci 0000:01:00.0: pci irq msi oper_irq_mode 2 irq_mode 0 reset_mode 0
<6>[ 28.885296] ath10k_pci 0000:01:00.0: qca9984/qca9994 hw1.0 target 0x01000000 chip_id 0x00000000 sub 168c:cafe
<6>[ 28.885366] ath10k_pci 0000:01:00.0: kconfig debug 0 debugfs 1 tracing 0 dfs 1 testmode 0
<6>[ 28.900719] ath10k_pci 0000:01:00.0: firmware ver 10.4-3.9.0.2-00157 api 5 features no-p2p,mfp,peer-flow-ctrl,btcoex-param,allows-mesh-bcast,no-ps,peer-fixed-rate,iram-recovery crc32 6cdc6ff9
<6>[ 31.177335] ath10k_pci 0000:01:00.0: board_file api 2 bmi_id 0:1 crc32 826c8c57
<6>[ 35.115907] ath10k_pci 0000:01:00.0: htt-ver 2.2 wmi-op 6 htt-op 4 cal pre-cal-nvmem max-sta 512 raw 0 hwcrypto 1
<7>[ 35.210714] ath: EEPROM regdomain: 0x0
<7>[ 35.210737] ath: EEPROM indicates default country code should be used
<7>[ 35.210752] ath: doing EEPROM country->regdmn map search
<7>[ 35.210776] ath: country maps to regdmn code: 0x3a
<7>[ 35.210794] ath: Country alpha2 being used: US
<7>[ 35.210810] ath: Regpair used: 0x3a
<7>[ 35.215991] ath10k_pci 0001:01:00.0: assign IRQ: got 49
<6>[ 35.217503] ath10k_pci 0001:01:00.0: enabling device (0140 -> 0142)
<7>[ 35.217657] ath10k_pci 0001:01:00.0: enabling bus mastering
<6>[ 35.218682] ath10k_pci 0001:01:00.0: pci irq msi oper_irq_mode 2 irq_mode 0 reset_mode 0
<6>[ 35.897530] ath10k_pci 0001:01:00.0: qca9984/qca9994 hw1.0 target 0x01000000 chip_id 0x00000000 sub 168c:cafe
<6>[ 35.897578] ath10k_pci 0001:01:00.0: kconfig debug 0 debugfs 1 tracing 0 dfs 1 testmode 0
<6>[ 35.908935] ath10k_pci 0001:01:00.0: firmware ver 10.4-3.9.0.2-00157 api 5 features no-p2p,mfp,peer-flow-ctrl,btcoex-param,allows-mesh-bcast,no-ps,peer-fixed-rate,iram-recovery crc32 6cdc6ff9
<6>[ 38.191561] ath10k_pci 0001:01:00.0: board_file api 2 bmi_id 0:2 crc32 826c8c57
<6>[ 42.109289] ath10k_pci 0001:01:00.0: htt-ver 2.2 wmi-op 6 htt-op 4 cal pre-cal-nvmem max-sta 512 raw 0 hwcrypto 1
<7>[ 42.200277] ath: EEPROM regdomain: 0x0
<7>[ 42.200298] ath: EEPROM indicates default country code should be used
<7>[ 42.200314] ath: doing EEPROM country->regdmn map search
<7>[ 42.200338] ath: country maps to regdmn code: 0x3a
<7>[ 42.200356] ath: Country alpha2 being used: US
<7>[ 42.200371] ath: Regpair used: 0x3a
<14>[ 42.212909] kmodloader: done loading kernel modules from /etc/modules.d/*
<6>[ 45.741558] ECM init
<6>[ 45.741597] ECM database jhash random seed: 0xf7a4e310
<6>[ 45.742633] ECM init complete
<6>[ 48.321013] ipq8064-mdio 37000000.mdio eth1: 1000 Mbps Full Duplex
<6>[ 49.444889] br-lan: port 1(eth1.1) entered blocking state
<6>[ 49.444915] br-lan: port 1(eth1.1) entered disabled state
<6>[ 49.445476] device eth1.1 entered promiscuous mode
<6>[ 49.445487] device eth1 entered promiscuous mode
<6>[ 49.446289] IPv6: ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
<6>[ 49.450282] br-lan: port 1(eth1.1) entered blocking state
<6>[ 49.450301] br-lan: port 1(eth1.1) entered forwarding state
<6>[ 49.468422] ipq8064-mdio 37000000.mdio eth0: 1000 Mbps Full Duplex
<6>[ 50.562381] IPv6: ADDRCONF(NETDEV_CHANGE): br-lan: link becomes ready
<6>[ 50.562624] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
<4>[ 57.985574] ath10k_pci 0001:01:00.0: Unknown eventid: 36933
<6>[ 57.989159] wlan1: Created a NSS virtual interface
<6>[ 57.991727] br-lan: port 2(wlan1) entered blocking state
<6>[ 57.991745] br-lan: port 2(wlan1) entered disabled state
<6>[ 57.992047] device wlan1 entered promiscuous mode
<6>[ 57.992205] br-lan: port 2(wlan1) entered blocking state
<6>[ 57.992225] br-lan: port 2(wlan1) entered forwarding state
<3>[ 57.998716] debugfs: File 'virt_if' in directory 'stats' already present!
<6>[ 57.999026] Created a NSS virtual interface for dev [nssifb]
<6>[ 57.999035] NSS IFB data callback registered
<6>[ 57.999042] NSS IFB transmit callback registered
<6>[ 57.999784] NSS IFB module loaded.
<6>[ 58.004807] br-lan: port 2(wlan1) entered disabled state
<6>[ 58.030319] 9cbb12a9: Found net device [eth0]
<6>[ 58.030333] 9cbb12a9: Net device [eth0] has NSS intf_num [1]
<1>[ 58.030805] 8<--- cut here ---
<1>[ 58.030833] Unable to handle kernel NULL pointer dereference at virtual address 00000138
<6>[ 58.031304] Nexthop successfully set for [eth0] to [nssifb]
<1>[ 58.032762] pgd = 6aa5ce7a
<1>[ 58.041082] [00000138] *pgd=00000000
<0>[ 58.043548] Internal error: Oops: 5 [#1] SMP ARM
<4>[ 58.047250] Modules linked in: nss_ifb ecm nft_fib_inet nf_flow_table_ipv6 nf_flow_table_ipv4 nf_flow_table_inet ath10k_pci ath10k_core ath wireguard pl2303 nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject nft_redir nft_quota nft_objref nft_numgen nft_nat nft_masq nft_log nft_limit nft_hash nft_flow_offload nft_fib_ipv6 nft_fib_ipv4 nft_fib nft_ct nft_counter nft_chain_nat nf_tables nf_conntrack_netlink mac80211 libchacha20poly1305 ipt_REJECT ftdi_sio curve25519_neon cp210x ch341 cfg80211 belkin_sa xt_time xt_tcpudp xt_tcpmss xt_statistic xt_state xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length xt_hl xt_ecn xt_dscp xt_conntrack xt_comment xt_TCPMSS xt_REDIRECT xt_MASQUERADE xt_LOG xt_HL xt_DSCP xt_CT xt_CLASSIFY usbserial sch_cake ppp_async poly1305_arm nfnetlink nf_reject_ipv4 nf_log_ipv6 nf_log_ipv4 nf_log_common nf_flow_table libcurve25519_generic libcrc32c iptable_nat iptable_mangle iptable_filter ipt_ECN ip_tables crc_ccitt compat chacha_neon fuse sch_tbf sch_ingress
<4>[ 58.047778] sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact qca_nss_qdisc qca_nss_pppoe pppoe pppox ppp_generic slhc ledtrig_usbport cryptodev ip6table_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ip6t_NPT ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsv4 nfsv3 nfs nfs_ssc msdos bonding ifb ip6_udp_tunnel udp_tunnel sit qca_nss_drv qca_nss_gmac oid_registry tunnel4 ip_tunnel tun xfrm_user xfrm_ipcomp af_key xfrm_algo vfat fat lockd sunrpc grace hfsplus hfs cdrom dns_resolver nls_utf8 nls_iso8859_15 nls_iso8859_1 nls_cp850 nls_cp437 nls_cp1250 wp512 twofish_generic twofish_common tgr192 tea serpent_generic khazad cast6_generic cast5_generic cast_common camellia_generic blowfish_generic blowfish_common anubis xts crypto_user algif_skcipher algif_rng algif_hash algif_aead af_alg sha1_generic seqiv md5 kpp echainiv ecb des_generic libdes cmac authenc uas usb_storage
<4>[ 58.117348] leds_gpio xhci_plat_hcd xhci_pci xhci_hcd dwc3 dwc3_qcom ohci_platform ohci_hcd phy_qcom_ipq806x_usb ahci fsl_mph_dr_of ehci_platform ehci_fsl sd_mod ahci_platform libahci_platform libahci libata scsi_mod ehci_hcd ramoops reed_solomon pstore gpio_button_hotplug f2fs ext4 mbcache jbd2 exfat dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax crc32c_generic crc32_generic cbc encrypted_keys trusted tpm
<4>[ 58.240122] CPU: 0 PID: 1427 Comm: odhcpd Not tainted 5.10.131 #0
<4>[ 58.262350] Hardware name: Generic DT based system
<4>[ 58.268610] PC is at eth_type_trans+0x20/0x20c
<4>[ 58.273292] LR is at nss_ifb_data_cb+0x20/0x54 [nss_ifb]
<4>[ 58.277714] pc : [<c08771e4>] lr : [<bf92e2e8>] psr: 80000113
<4>[ 58.283183] sp : c5d37de8 ip : bf5700a8 fp : 00000002
<4>[ 58.289172] r10: 00000028 r9 : c50b4800 r8 : bf566040
<4>[ 58.294381] r7 : 00000000 r6 : bf566388 r5 : 00000000 r4 : c73ae780
<4>[ 58.299591] r3 : 00000001 r2 : bf566690 r1 : 00000000 r0 : c73ae780
<4>[ 58.306190] Flags: Nzcv IRQs on FIQs on Mode SVC_32 ISA ARM Segment none
<4>[ 58.312701] Control: 10c5787d Table: 47be006a DAC: 00000051
<0>[ 58.319905] Process odhcpd (pid: 1427, stack limit = 0x09a28429)
<0>[ 58.325633] Stack: (0xc5d37de8 to 0xc5d38000)
<0>[ 58.331719] 7de0: c30d9540 00000028 c73ae780 bf566690 bf566388 00000000
<0>[ 58.335980] 7e00: bf566040 bf92e2e8 c73ae780 bf92e2c8 bf566388 bf51eb18 00000000 c5002e00
<0>[ 58.344141] 7e20: bf566690 c30d9040 bf566058 0000007f 0000001e 00000008 00000001 000000f0
<0>[ 58.352301] 7e40: c273f400 bf566680 00000002 00000001 c273f404 00000001 c5385840 bf566690
<0>[ 58.360460] 7e60: 00000040 bf566040 bf573000 00000000 bf548c20 bf566680 00000002 bf51fe20
<0>[ 58.368620] 7e80: c5385900 00000040 c5ef8d80 00000002 c5d37ec4 00000001 bf566690 00000040
<0>[ 58.376781] 7ea0: c5d37edf c5d37ee0 c0d03d00 1cd49000 c5d37ee8 c082d078 bf566690 dd991700
<0>[ 58.384940] 7ec0: 0000012c c0c48700 c5d37ee0 c082d394 c5d37ed0 ffffa17d 00000000 00385900
<0>[ 58.393099] 7ee0: c5d37ee0 c5d37ee0 c5d37ee8 c5d37ee8 c5d36000 00000000 00000003 c0d0308c
<0>[ 58.401259] 7f00: c0d03080 40000003 c5d36000 00000100 c5d37f18 c0301378 c5d37f28 000f423e
<0>[ 58.409420] 7f20: c5d37f34 c0d03080 c0c41220 0000000a c0c411ac c0c47940 c0c47940 ffffa17c
<0>[ 58.417578] 7f40: c0d03d00 00400100 c5d37f90 ffffe000 00000000 00000000 00000001 c1410000
<0>[ 58.425738] 7f60: de80200c c5d37f90 beec4e04 c032311c c0c46cb8 c0371848 c0d05334 c5d37fb0
<0>[ 58.433897] 7f80: c0d7e664 de802000 c0c46cc4 c064c0dc b6ea6b74 80000010 ffffffff 10c5787d
<0>[ 58.442058] 7fa0: 10c5387d b6efed10 beec4e0c c0300f10 018414c0 00000024 00000086 000004ff
<0>[ 58.450218] 7fc0: 03f0c19f 03f0c19f 00000000 b6efed10 beec4e08 b6efed10 beec4e0c beec4e04
<0>[ 58.458376] 7fe0: b6ee721c beec4d90 b6ea7ba8 b6ea6b74 80000010 ffffffff 00000000 00000000
<0>[ 58.466533] [<c08771e4>] (eth_type_trans) from [<bf92e2e8>] (nss_ifb_data_cb+0x20/0x54 [nss_ifb])
<0>[ 58.474905] [<bf92e2e8>] (nss_ifb_data_cb [nss_ifb]) from [<bf51eb18>] (nss_core_send_buffer+0x1b18/0x1fd8 [qca_nss_drv])
<0>[ 58.483723] [<bf51eb18>] (nss_core_send_buffer [qca_nss_drv]) from [<bf51fe20>] (nss_core_handle_napi+0x194/0x238 [qca_nss_drv])
<0>[ 58.494577] [<bf51fe20>] (nss_core_handle_napi [qca_nss_drv]) from [<c082d078>] (__napi_poll+0x34/0x150)
<0>[ 58.506112] [<c082d078>] (__napi_poll) from [<c082d394>] (net_rx_action+0xdc/0x270)
<0>[ 58.515574] [<c082d394>] (net_rx_action) from [<c0301378>] (__do_softirq+0x110/0x2b8)
<0>[ 58.522952] [<c0301378>] (__do_softirq) from [<c032311c>] (irq_exit+0xb8/0x118)
<0>[ 58.530936] [<c032311c>] (irq_exit) from [<c0371848>] (__handle_domain_irq+0x94/0xf4)
<0>[ 58.538057] [<c0371848>] (__handle_domain_irq) from [<c064c0dc>] (gic_handle_irq+0x90/0xb8)
<0>[ 58.546040] [<c064c0dc>] (gic_handle_irq) from [<c0300f10>] (__irq_usr+0x50/0x80)
<0>[ 58.554193] Exception stack(0xc5d37fb0 to 0xc5d37ff8)
<0>[ 58.561839] 7fa0: 018414c0 00000024 00000086 000004ff
<0>[ 58.566883] 7fc0: 03f0c19f 03f0c19f 00000000 b6efed10 beec4e08 b6efed10 beec4e0c beec4e04
<0>[ 58.575040] 7fe0: b6ee721c beec4d90 b6ea7ba8 b6ea6b74 80000010 ffffffff
<0>[ 58.583195] Code: e58d8010 e58de014 e24dd008 e5801008 (e5913138)
<4>[ 58.589842] ---[ end trace 409a7d1df4a9ab0a ]---
<0>[ 58.607126] Kernel panic - not syncing: Fatal exception in interrupt
<2>[ 58.607164] CPU1: stopping
<4>[ 58.612544] CPU: 1 PID: 3586 Comm: sugov:1 Tainted: G D 5.10.131 #0
<4>[ 58.615062] Hardware name: Generic DT based system
<4>[ 58.622630] [<c030e4ac>] (unwind_backtrace) from [<c030a22c>] (show_stack+0x14/0x20)
<4>[ 58.627402] [<c030a22c>] (show_stack) from [<c0632d48>] (dump_stack+0x94/0xa8)
<4>[ 58.635296] [<c0632d48>] (dump_stack) from [<c030d1d0>] (do_handle_IPI+0x140/0x184)
<4>[ 58.642325] [<c030d1d0>] (do_handle_IPI) from [<c030d230>] (ipi_handler+0x1c/0x2c)
<4>[ 58.649879] [<c030d230>] (ipi_handler) from [<c0371844>] (__handle_domain_irq+0x90/0xf4)
<4>[ 58.657520] [<c0371844>] (__handle_domain_irq) from [<c064c0dc>] (gic_handle_irq+0x90/0xb8)
<4>[ 58.665764] [<c064c0dc>] (gic_handle_irq) from [<c0300b8c>] (__irq_svc+0x6c/0x90)
<4>[ 58.673830] Exception stack(0xc5731df0 to 0xc5731e38)
<4>[ 58.681474] 1de0: c15f9600 00000003 c15fa940 c1591240
<4>[ 58.686523] 1e00: 00000000 00000000 c1591240 c15f9600 c15fa940 00000000 3b9aca00 c1ee9800
<4>[ 58.694678] 1e20: c0d8268c c5731e40 c06898a8 c0689630 60000013 ffffffff
<4>[ 58.702836] [<c0300b8c>] (__irq_svc) from [<c0689630>] (clk_fetch_parent_index.part.0+0x74/0xfc)
<4>[ 58.709257] [<c0689630>] (clk_fetch_parent_index.part.0) from [<c06898a8>] (clk_calc_new_rates+0x1f0/0x200)
<4>[ 58.718288] [<c06898a8>] (clk_calc_new_rates) from [<c068d07c>] (clk_core_set_rate_nolock+0x94/0x1f8)
<4>[ 58.727748] [<c068d07c>] (clk_core_set_rate_nolock) from [<c068d21c>] (clk_set_rate+0x3c/0x170)
<4>[ 58.737125] [<c068d21c>] (clk_set_rate) from [<c07b0cc8>] (dev_pm_opp_set_rate+0x304/0x674)
<4>[ 58.745633] [<c07b0cc8>] (dev_pm_opp_set_rate) from [<c07b5f64>] (__cpufreq_driver_target+0x1a0/0x5b4)
<4>[ 58.753965] [<c07b5f64>] (__cpufreq_driver_target) from [<c0366338>] (sugov_work+0x54/0x70)
<4>[ 58.763339] [<c0366338>] (sugov_work) from [<c033fc24>] (kthread_worker_fn+0x90/0x198)
<4>[ 58.771581] [<c033fc24>] (kthread_worker_fn) from [<c033ea9c>] (kthread+0x15c/0x160)
<4>[ 58.779565] [<c033ea9c>] (kthread) from [<c0300148>] (ret_from_fork+0x14/0x2c)
<4>[ 58.787458] Exception stack(0xc5731fb0 to 0xc5731ff8)
<4>[ 58.794495] 1fa0: 00000000 00000000 00000000 00000000
<4>[ 58.799629] 1fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[ 58.807784] 1fe0: 00000000 00000000 00000000 00000000 00000013 00000000
Ok. Looks like your router crashed immediately upon setting up the nssifb interface.
How are you setting up the nssifb interface?
Last week, my router crashed randomly (same null pointer crash) when it was up and running overnight. The crash I've just shown you was after a manual reboot. I noticed that the WIFI SSID seemed to take too long to show up after the reboot, so I checked /sys/fs/pstore and found these crash dumps.
I added this snippet in in the /etc/rc.local:
modprobe nss-ifb && ip link set up nssifb
# Shape ingress traffic to 600 Mbit with chained NSSFQ_CODEL
tc qdisc add dev nssifb root handle 1: nsstbl rate 600Mbit burst 1Mb
tc qdisc add dev nssifb parent 1: handle 10: nssfq_codel limit 10240 flows 1024 quantum 1514 target 5ms interval 100ms set_default
# Shape egress traffic to 200 Mbit with chained NSSFQ_CODEL
tc qdisc add dev eth0 root handle 1: nsstbl rate 200Mbit burst 1Mb
tc qdisc add dev eth0 parent 1: handle 10: nssfq_codel limit 10240 flows 1024 quantum 1514 target 5ms interval 100ms set_default
1 Like
Does the nssifb interface work at all for you?
The kernel panic is triggerred by the eth_type_trans() kernel API, and this API takes in 2 parameters: the skb and the device pointer. If your router works with nssifb configured but crashes intermittently (with this panic log), then it's likely caused by the skb data structure passed in.