Kernel warn messages

Hi all,

My Raspberry Pi 2 is currently on 22.03.0.rc1 and I've noticed that whenever I get flooded with kernel warn messages like the below, LAN network performance gets degraded.

Fri May 27 09:44:11 2022 kern.warn kernel: [ 3832.782522] WARNING: CPU: 0 PID: 10 at backports-5.15.33-1/drivers/net/wireless/broadcom/brcm80211/brcmfmac/fwsignal.c:1735 0xbf395d9c [brcmfmac@217398b3+0x35000]
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3832.804551] Modules linked in: pppoe ppp_async brcmfmac pppox ppp_generic nft_redir nft_nat nft_masq nft_flow_offload nft_fib_inet nft_ct nft_chain_nat nf_nat nf_flow_table_ipv6 nf_flow_table_ipv4 nf_flow_table_inet nf_flow_table nf_conntrack_netlink nf_conntrack_bridge nf_conntrack ipt_REJECT cfg80211 xt_time xt_tcpudp xt_multiport xt_mark xt_mac xt_limit xt_comment xt_TCPMSS xt_LOG usbhid slhc r8152 nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_quota nft_objref nft_numgen nft_meta_bridge nft_log nft_limit nft_hash nft_fwd_netdev nft_fib_ipv6 nft_fib_ipv4 nft_fib nft_dup_netdev nft_counter nf_tables nf_reject_ipv6 nf_reject_ipv4 nf_log_ipv6 nf_log_ipv4 nf_log_common nf_dup_netdev nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c iptable_mangle iptable_filter ip_tables hid_generic crc_ccitt compat cdc_ncm cdc_ether brcmutil snd_bcm2835(C) hid evdev xt_set x_tables ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3832.804935]  ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set nfnetlink netlink_diag snd_rawmidi snd_seq_device snd_pcm_oss snd_pcm_dmaengine snd_mixer_oss snd_hwdep snd_compress snd_pcm snd_timer snd soundcore nls_utf8 vfat fat nls_iso8859_1 nls_cp437
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3832.965075] CPU: 0 PID: 10 Comm: ksoftirqd/0 Tainted: G        WC        5.10.111 #0
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3832.977154] Hardware name: BCM2835
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3832.982662] Function entered at [<c020ea08>] from [<c0209d88>]
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3832.990589] Function entered at [<c0209d88>] from [<c0546a58>]
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3832.998440] Function entered at [<c0546a58>] from [<c021e530>]
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.006202] Function entered at [<c021e530>] from [<c021e5f4>]
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.013892] Function entered at [<c021e5f4>] from [<bf395d9c>]
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.021501] Function entered at [<bf395d9c>] from [<bf38f95c>]
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.029035] Function entered at [<bf38f95c>] from [<bf3a1d9c>]
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.036490] Function entered at [<bf3a1d9c>] from [<c0681f34>]
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.043869] Function entered at [<c0681f34>] from [<c06c5ec4>]
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.051185] Function entered at [<c06c5ec4>] from [<c02235e4>]
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.058412] Function entered at [<c02235e4>] from [<c02019bc>]
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.065562] Function entered at [<c02019bc>] from [<c0223db0>]
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.072624] Function entered at [<c0223db0>] from [<c026dfcc>]
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.079610] Function entered at [<c026dfcc>] from [<c02012b8>]
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.086511] Exception stack(0xc10a1ea0 to 0xc10a1ee8)
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.092591] 1ea0: c0e08dc0 00000002 00000000 0000f892 c0c51fc0 c0e08dc0 ef75afc0 00000000
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.102765] 1ec0: 00000000 2eb09000 c1083520 c10a1f1c c0e00040 c10a1ef0 c08f0690 c024507c
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.112967] 1ee0: 60000013 ffffffff
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.117468] Function entered at [<c02012b8>] from [<c024507c>]
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.124348] Function entered at [<c024507c>] from [<c08f0690>]
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.131233] Function entered at [<c08f0690>] from [<c08f09f4>]
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.138114] Function entered at [<c08f09f4>] from [<c0242c34>]
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.144995] Function entered at [<c0242c34>] from [<c023d990>]
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.151875] Function entered at [<c023d990>] from [<c0200138>]
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.158747] Exception stack(0xc10a1fb0 to 0xc10a1ff8)
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.164882] 1fa0:                                     00000000 00000000 00000000 00000000
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.175356] 1fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.186115] 1fe0: 00000000 00000000 00000000 00000000 00000013 00000000
Fri May 27 09:44:11 2022 kern.warn kernel: [ 3833.195673] ---[ end trace 879ccd60e739ac5a ]---

Initially I thought it was due to enabling limit rate feature in NFT-QoS settings, but recently even if the feature is disabled issue persists.

ubus call system board
{
	"kernel": "5.10.111",
	"hostname": "OpenWrt",
	"system": "ARMv7 Processor rev 5 (v7l)",
	"model": "Raspberry Pi 2 Model B Rev 1.1",
	"board_name": "raspberrypi,2-model-b",
	"rootfs_type": "ext4",
	"release": {
		"distribution": "OpenWrt",
		"version": "22.03.0-rc1",
		"revision": "r19302-df622768da",
		"target": "bcm27xx/bcm2709",
		"description": "OpenWrt 22.03.0-rc1 r19302-df622768da"
	}
}

The aforementioned also happens on 21.02.03, is it due to buggy broadcom wireless driver? Is there a fix for this?

Thanks.

Good Morning!

I searched a bit and have been reading up for the last hour; not a Pi user, but thought I could help by reading.
Buggy Broadcom is funny and obvious in the first line of your log and backported??

CPU: 0 PID: 10 Comm: ksoftirqd/0 Tainted: G        WC        5.10.111 #0

Is this intermittent, or causal, meaning are you seeing this CPU hit while doing something. I say CPU from the search I did on "ksoftirqd/0", found an OpenWrt link.

When your reading is up and the next time your reboot, Other's and myself would like to see

dmesg

Hi Bill,

The thread you mentioned is quite long, as requested please see below dmesg logs:

[    0.000000] Booting Linux on physical CPU 0xf00
[    0.000000] Linux version 5.10.111 (builder@buildhost) (arm-openwrt-linux-muslgnueabi-gcc (OpenWrt GCC 11.2.0 r19302-df622768da) 11.2.0, GNU ld (GNU Binutils) 2.37) #0 SMP Wed Apr 20 10:37:37 2022
[    0.000000] CPU: ARMv7 Processor [410fc075] revision 5 (ARMv7), cr=30c5387d
[    0.000000] CPU: div instructions available: patching division code
[    0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing instruction cache
[    0.000000] OF: fdt: Machine model: Raspberry Pi 2 Model B Rev 1.1
[    0.000000] Memory policy: Data cache writealloc
[    0.000000] Reserved memory: created CMA memory pool at 0x0000000037400000, size 64 MiB
[    0.000000] OF: reserved mem: initialized node linux,cma, compatible id shared-dma-pool
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000000000-0x000000002fffffff]
[    0.000000]   Normal   empty
[    0.000000]   HighMem  [mem 0x0000000030000000-0x000000003b3fffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x000000003b3fffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x000000003b3fffff]
[    0.000000] On node 0 totalpages: 242688
[    0.000000]   DMA zone: 1728 pages used for memmap
[    0.000000]   DMA zone: 0 pages reserved
[    0.000000]   DMA zone: 196608 pages, LIFO batch:63
[    0.000000]   HighMem zone: 46080 pages, LIFO batch:15
[    0.000000] percpu: Embedded 15 pages/cpu s31564 r8192 d21684 u61440
[    0.000000] pcpu-alloc: s31564 r8192 d21684 u61440 alloc=15*4096
[    0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 240960
[    0.000000] Kernel command line: coherent_pool=1M snd_bcm2835.enable_compat_alsa=0 snd_bcm2835.enable_hdmi=1 bcm2708_fb.fbwidth=656 bcm2708_fb.fbheight=416 bcm2708_fb.fbswap=1 vc_mem.mem_base=0x3ec00000 vc_mem.mem_size=0x40000000  console=ttyAMA0,115200 console=tty1 root=/dev/mmcblk0p2 rootfstype=squashfs,ext4 rootwait
[    0.000000] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes, linear)
[    0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] Memory: 882184K/970752K available (7124K kernel code, 644K rwdata, 1080K rodata, 2048K init, 403K bss, 23032K reserved, 65536K cma-reserved, 118784K highmem)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000000] rcu: Hierarchical RCU implementation.
[    0.000000] 	Tracing variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 10 jiffies.
[    0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
[    0.000000] random: get_random_bytes called from 0xc0c00d18 with crng_init=0
[    0.000000] arch_timer: cp15 timer(s) running at 19.20MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x46d987e47, max_idle_ns: 440795202767 ns
[    0.000010] sched_clock: 56 bits at 19MHz, resolution 52ns, wraps every 4398046511078ns
[    0.000031] Switching to timer-based delay loop, resolution 52ns
[    0.000261] Console: colour dummy device 80x30
[    0.000914] printk: console [tty1] enabled
[    0.000995] Calibrating delay loop (skipped), value calculated using timer frequency.. 38.40 BogoMIPS (lpj=192000)
[    0.001046] pid_max: default: 32768 minimum: 301
[    0.001306] Mount-cache hash table entries: 2048 (order: 1, 8192 bytes, linear)
[    0.001355] Mountpoint-cache hash table entries: 2048 (order: 1, 8192 bytes, linear)
[    0.002430] cgroup: Disabling memory control group subsystem
[    0.002681] CPU: Testing write buffer coherency: ok
[    0.003144] CPU0: update cpu_capacity 1024
[    0.003182] CPU0: thread -1, cpu 0, socket 15, mpidr 80000f00
[    0.004041] Setting up static identity map for 0x200000 - 0x200060
[    0.004226] rcu: Hierarchical SRCU implementation.
[    0.004485] dyndbg: Ignore empty _ddebug table in a CONFIG_DYNAMIC_DEBUG_CORE build
[    0.004807] smp: Bringing up secondary CPUs ...
[    0.005848] CPU1: update cpu_capacity 1024
[    0.005858] CPU1: thread -1, cpu 1, socket 15, mpidr 80000f01
[    0.007128] CPU2: update cpu_capacity 1024
[    0.007140] CPU2: thread -1, cpu 2, socket 15, mpidr 80000f02
[    0.008228] CPU3: update cpu_capacity 1024
[    0.008240] CPU3: thread -1, cpu 3, socket 15, mpidr 80000f03
[    0.008452] smp: Brought up 1 node, 4 CPUs
[    0.008587] SMP: Total of 4 processors activated (153.60 BogoMIPS).
[    0.008614] CPU: All CPU(s) started in HYP mode.
[    0.008636] CPU: Virtualization extensions available.
[    0.023161] VFP support v0.3: implementor 41 architecture 2 part 30 variant 7 rev 5
[    0.023561] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.023620] futex hash table entries: 1024 (order: 4, 65536 bytes, linear)
[    0.027270] pinctrl core: initialized pinctrl subsystem
[    0.028825] NET: Registered protocol family 16
[    0.032007] DMA: preallocated 1024 KiB pool for atomic coherent allocations
[    0.038105] thermal_sys: Registered thermal governor 'step_wise'
[    0.038376] cpuidle: using governor ladder
[    0.038466] cpuidle: using governor menu
[    0.039176] Serial: AMBA PL011 UART driver
[    0.049181] bcm2835-mbox 3f00b880.mailbox: mailbox enabled
[    0.060125] raspberrypi-firmware soc:firmware: Attached to firmware from 2021-08-19T12:28:18, variant start
[    0.070127] raspberrypi-firmware soc:firmware: Firmware hash is ef2c018dccdeb94b0376db62a2ea4c882f9b500d
[    0.113113] bcm2835-dma 3f007000.dma: DMA legacy API manager, dmachans=0x1
[    0.115836] SCSI subsystem initialized
[    0.116150] usbcore: registered new interface driver usbfs
[    0.116235] usbcore: registered new interface driver hub
[    0.116319] usbcore: registered new device driver usb
[    0.116517] usb_phy_generic phy: supply vcc not found, using dummy regulator
[    0.118816] clocksource: Switched to clocksource arch_sys_counter
[    0.125764] NET: Registered protocol family 2
[    0.126130] IP idents hash table entries: 16384 (order: 5, 131072 bytes, linear)
[    0.128067] tcp_listen_portaddr_hash hash table entries: 512 (order: 0, 6144 bytes, linear)
[    0.128163] TCP established hash table entries: 8192 (order: 3, 32768 bytes, linear)
[    0.128305] TCP bind hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.128514] TCP: Hash tables configured (established 8192 bind 8192)
[    0.128719] UDP hash table entries: 512 (order: 2, 16384 bytes, linear)
[    0.128864] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes, linear)
[    0.129183] NET: Registered protocol family 1
[    0.129253] PCI: CLS 0 bytes, default 64
[    0.131350] workingset: timestamp_bits=14 max_order=18 bucket_order=4
[    0.138457] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.297281] bounce: pool size: 64 pages
[    0.297377] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
[    0.299765] bcm2708_fb soc:fb: FB found 1 display(s)
[    0.310953] Console: switching to colour frame buffer device 82x26
[    0.318147] bcm2708_fb soc:fb: Registered framebuffer for display 0, size 656x416
[    0.326387] Serial: 8250/16550 driver, 16 ports, IRQ sharing enabled
[    0.333293] bcm2835-rng 3f104000.rng: hwrng registered
[    0.333833] random: fast init done
[    0.336452] vc-mem: phys_addr:0x00000000 mem_base=0x3ec00000 mem_size:0x40000000(1024 MiB)
[    0.339010] random: crng init done
[    0.344856] gpiomem-bcm2835 3f200000.gpiomem: Initialised: Registers at 0x3f200000
[    0.364648] brd: module loaded
[    0.373637] loop: module loaded
[    0.377086] Loading iSCSI transport class v2.0-870.
[    0.383304] usbcore: registered new interface driver lan78xx
[    0.385963] usbcore: registered new interface driver smsc95xx
[    0.388748] dwc_otg: version 3.00a 10-AUG-2012 (platform bus)
[    1.119346] Core Release: 2.80a
[    1.121728] Setting default values for core params
[    1.124084] Finished setting default values for core params
[    1.326710] Using Buffer DMA mode
[    1.329019] Periodic Transfer Interrupt Enhancement - disabled
[    1.331339] Multiprocessor Interrupt Enhancement - disabled
[    1.333606] OTG VER PARAM: 0, OTG VER FLAG: 0
[    1.335818] Dedicated Tx FIFOs mode
[    1.338399]
[    1.338421] WARN::dwc_otg_hcd_init:1072: FIQ DMA bounce buffers: virt = f0bfa000 dma = 0x00000000f7514000 len=9024
[    1.344832] FIQ FSM acceleration enabled for :
[    1.344832] Non-periodic Split Transactions
[    1.344832] Periodic Split Transactions
[    1.344832] High-Speed Isochronous Endpoints
[    1.344832] Interrupt/Control Split Transaction hack enabled
[    1.355011] dwc_otg: Microframe scheduler enabled
[    1.355091]
[    1.355104] WARN::hcd_init_fiq:457: FIQ on core 1
[    1.359121]
[    1.359133] WARN::hcd_init_fiq:458: FIQ ASM at c06d32cc length 36
[    1.363256]
[    1.363266] WARN::hcd_init_fiq:496: MPHI regs_base at f0810000
[    1.367438] dwc_otg 3f980000.usb: DWC OTG Controller
[    1.369620] dwc_otg 3f980000.usb: new USB bus registered, assigned bus number 1
[    1.371833] dwc_otg 3f980000.usb: irq 89, io mem 0x00000000
[    1.373994] Init: Port Power? op_state=1
[    1.376067] Init: Power Port (0)
[    1.378356] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
[    1.382655] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.384942] usb usb1: Product: DWC OTG Controller
[    1.387130] usb usb1: Manufacturer: Linux 5.10.111 dwc_otg_hcd
[    1.389357] usb usb1: SerialNumber: 3f980000.usb
[    1.392141] hub 1-0:1.0: USB hub found
[    1.394398] hub 1-0:1.0: 1 port detected
[    1.397403] dwc_otg: FIQ enabled
[    1.397414] dwc_otg: NAK holdoff enabled
[    1.397422] dwc_otg: FIQ split-transaction FSM enabled
[    1.397435] Module dwc_common_port init
[    1.398075] usbcore: registered new interface driver uas
[    1.400440] usbcore: registered new interface driver usb-storage
[    1.402710] mousedev: PS/2 mouse device common for all mice
[    1.405581] bcm2835-wdt bcm2835-wdt: Broadcom BCM2835 watchdog timer
[    1.409545] sdhci: Secure Digital Host Controller Interface driver
[    1.411807] sdhci: Copyright(c) Pierre Ossman
[    1.414575] sdhost-bcm2835 3f202000.mmc: could not get clk, deferring probe
[    1.417337] Error: Driver 'sdhost-bcm2835' is already registered, aborting...
[    1.419291] sdhci-pltfm: SDHCI platform and OF driver helper
[    1.425109] NET: Registered protocol family 10
[    1.427778] Segment Routing with IPv6
[    1.429455] NET: Registered protocol family 17
[    1.431082] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[    1.434202] 8021q: 802.1Q VLAN Support v1.8
[    1.436008] Registering SWP/SWPB emulation handler
[    1.438043] Key type ._fscrypt registered
[    1.439586] Key type .fscrypt registered
[    1.441051] Key type fscrypt-provisioning registered
[    1.449394] uart-pl011 3f201000.serial: cts_event_workaround enabled
[    1.451066] 3f201000.serial: ttyAMA0 at MMIO 0x3f201000 (irq = 114, base_baud = 0) is a PL011 rev2
[    1.524409] Indeed it is in host mode hprt0 = 00021501
[    1.526796] printk: console [ttyAMA0] enabled
[    1.718811] usb 1-1: new high-speed USB device number 2 using dwc_otg
[    1.728579] bcm2835-power bcm2835-power: Broadcom BCM2835 power domains driver
[    1.731952] Indeed it is in host mode hprt0 = 00001101
[    1.740165] sdhost: log_buf @ 7a62fe03 (f7513000)
[    1.979061] usb 1-1: New USB device found, idVendor=0424, idProduct=9514, bcdDevice= 2.00
[    2.031811] mmc0: sdhost-bcm2835 loaded - DMA enabled (>1)
[    2.032905] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    2.040539] of_cfs_init
[    2.043198] hub 1-1:1.0: USB hub found
[    2.050085] of_cfs_init: OK
[    2.055039] hub 1-1:1.0: 5 ports detected
[    2.120158] mmc0: host does not support reading read-only switch, assuming write-enable
[    2.438818] usb 1-1.1: new high-speed USB device number 3 using dwc_otg
[    2.447190] mmc0: new high speed SDHC card at address 59b4
[    2.519104] mmcblk0: mmc0:59b4 SD    29.6 GiB
[    2.526956]  mmcblk0: p1 p2
[    2.541243] EXT4-fs (mmcblk0p2): mounted filesystem without journal. Opts: (null)
[    2.552720] VFS: Mounted root (ext4 filesystem) readonly on device 179:2.
[    2.564547] Freeing unused kernel memory: 2048K
[    2.599079] usb 1-1.1: New USB device found, idVendor=0424, idProduct=ec00, bcdDevice= 2.00
[    2.611431] usb 1-1.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    2.621859] Run /sbin/init as init process
[    2.628262]   with arguments:
[    2.628270]     /sbin/init
[    2.628276]   with environment:
[    2.628282]     HOME=/
[    2.628288]     TERM=linux
[    2.629084] smsc95xx v2.0.0
[    2.694111] init: Console is alive
[    2.699902] init: - watchdog -
[    2.893579] kmodloader: loading kernel modules from /etc/modules-boot.d/*
[    2.908537] kmodloader: done loading kernel modules from /etc/modules-boot.d/*
[    2.928037] init: - preinit -
[    2.980998] SMSC LAN8700 usb-001:003:01: attached PHY driver [SMSC LAN8700] (mii_bus:phy_addr=usb-001:003:01, irq=POLL)
[    2.997094] smsc95xx 1-1.1:1.0 eth0: register 'smsc95xx' at usb-3f980000.usb-1.1, smsc95xx USB 2.0 Ethernet, b8:27:eb:04:24:ba
[    3.121391] smsc95xx 1-1.1:1.0 eth0: hardware isn't capable of remote wakeup
[    3.129849] smsc95xx 1-1.1:1.0 eth0: Link is Down
[    3.318862] usb 1-1.3: new high-speed USB device number 4 using dwc_otg
[    3.449904] usb 1-1.3: New USB device found, idVendor=2357, idProduct=0601, bcdDevice=30.00
[    3.463690] usb 1-1.3: New USB device strings: Mfr=1, Product=2, SerialNumber=6
[    3.473807] usb 1-1.3: Product: USB 10/100/1000 LAN
[    3.481390] usb 1-1.3: Manufacturer: TP-Link
[    3.488261] usb 1-1.3: SerialNumber: 000001000000
[    3.588875] usb 1-1.5: new high-speed USB device number 5 using dwc_otg
[    3.721681] usb 1-1.5: New USB device found, idVendor=0a5c, idProduct=bd1e, bcdDevice= 0.01
[    3.735507] usb 1-1.5: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    3.745689] usb 1-1.5: Product: Remote Download Wireless Adapter
[    3.754520] usb 1-1.5: Manufacturer: Broadcom
[    3.761614] usb 1-1.5: SerialNumber: 000000000001
[    7.258571] mount_root: mounting /dev/root
[    7.266226] EXT4-fs (mmcblk0p2): warning: mounting unchecked fs, running e2fsck is recommended
[    7.280853] EXT4-fs (mmcblk0p2): re-mounted. Opts: (null)
[    7.327237] urandom-seed: Seeding with /etc/urandom.seed
[    7.533185] smsc95xx 1-1.1:1.0 eth0: hardware isn't capable of remote wakeup
[    7.549723] procd: - early -
[    7.554990] procd: - watchdog -
[    8.120680] procd: - watchdog -
[    8.127519] procd: - ubus -
[    8.186043] procd: - init -
[    8.192896] uart-pl011 3f201000.serial: no DMA platform data
[    8.405566] kmodloader: loading kernel modules from /etc/modules.d/*
[    8.470999] hid: raw HID events driver (C) Jiri Kosina
[    8.479773] snd_bcm2835: module is from the staging directory, the quality is unknown, you have been warned.
[    8.513899] usbcore: registered new interface driver cdc_ether
[    8.526178] usbcore: registered new interface driver cdc_ncm
[    8.541361] Loading modules backported from Linux version v5.15.33-0-g06f50ca83ace
[    8.552016] Backport generated by backports.git v5.15.33-1-0-g183c4ab2
[    8.589417] usbcore: registered new interface driver r8152
[    8.604716] usbcore: registered new interface driver usbhid
[    8.611878] usbhid: USB HID core driver
[    8.621462] xt_time: kernel timezone is -0000
[    8.661424] PPP generic driver version 2.4.2
[    8.668162] NET: Registered protocol family 24
[    8.683818] brcmfmac: brcmf_fw_alloc_request: using brcm/brcmfmac43143 for chip BCM43143/2
[    8.700797] usb 1-1.3: reset high-speed USB device number 4 using dwc_otg
[    8.962585] brcmfmac: brcmf_fw_alloc_request: using brcm/brcmfmac43143 for chip BCM43143/2
[    8.989551] r8152 1-1.3:1.0: load rtl8153a-3 v2 02/07/20 successfully
[    8.998403] brcmfmac: brcmf_c_process_clm_blob: no clm_blob available (err=-12), device may have limited channels available
[    9.014202] brcmfmac: brcmf_c_preinit_dcmds: Firmware: BCM43143/2 wl0: Apr  3 2014 04:43:32 version 6.10.198.66 (r467479) FWID 01-32bd010e
[    9.063474] usbcore: registered new interface driver brcmfmac
[    9.074668] r8152 1-1.3:1.0 eth1: v1.12.11
[    9.083687] kmodloader: done loading kernel modules from /etc/modules.d/*
[   13.193768] smsc95xx 1-1.1:1.0 eth0: hardware isn't capable of remote wakeup
[   13.210948] smsc95xx 1-1.1:1.0 eth0: Link is Down
[   13.217890] br-lan: port 1(eth0) entered blocking state
[   13.225249] br-lan: port 1(eth0) entered disabled state
[   13.233008] device eth0 entered promiscuous mode
[   14.968224] br-lan: port 2(wlan0) entered blocking state
[   14.976052] br-lan: port 2(wlan0) entered disabled state
[   14.984374] device wlan0 entered promiscuous mode
[   15.089797] IPv6: ADDRCONF(NETDEV_CHANGE): wlan0: link becomes ready
[   15.098477] br-lan: port 2(wlan0) entered blocking state
[   15.106147] br-lan: port 2(wlan0) entered forwarding state
[   15.114412] IPv6: ADDRCONF(NETDEV_CHANGE): br-lan: link becomes ready
[   16.872220] IPv6: ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
[   16.881914] r8152 1-1.3:1.0 eth1: carrier on
[   17.408509] br-lan: received packet on wlan0 with own address as source address (addr:d4:7b:b0:13:c8:36, vlan:0)

It's intermittent as far as I know though initially I thought it was causal i.e., enabling limit rate feature in NFT-QoS but it appears it's not the case. The box uptime was 11days until I decided to upgrade the packages, the issue happened after the packages upgrade.

P.S. packet steering is enabled in global network options.

Now we have a baseline.
Next is to capture the logread and dmesg at the next instance of the:

Possibly.

At least it looks like a proper driver crash, not just a warning.
Did you cut a few first lines of the crash message?

Happening as I write this, see logread and dmesg snippet below.

logread:

Sat May 28 08:21:05 2022 kern.warn kernel: [49524.547003] Exception stack(0xc0e0
1f08 to 0xc0e01f50)
Sat May 28 08:21:05 2022 kern.warn kernel: [49524.553202] 1f00:
  1a0961b2 00000000 1a0961b4 c02152a0 c0e00000 00000000
Sat May 28 08:21:05 2022 kern.warn kernel: [49524.563589] 1f20: c0e04f1c c0e04f5
c 00000000 00000000 00000000 c0c511f0 c0e0501c c0e01f58
Sat May 28 08:21:05 2022 kern.warn kernel: [49524.573978] 1f40: c02076f8 c02076f
c 60000013 ffffffff
Sat May 28 08:21:05 2022 kern.warn kernel: [49524.580192] Function entered at [<
c02012b8>] from [<c02076fc>]
Sat May 28 08:21:05 2022 kern.warn kernel: [49524.587200] Function entered at [<
c02076fc>] from [<c024c240>]
Sat May 28 08:21:05 2022 kern.warn kernel: [49524.594209] Function entered at [<
c024c240>] from [<c024c57c>]
Sat May 28 08:21:05 2022 kern.warn kernel: [49524.601211] Function entered at [<
c024c57c>] from [<c0c00e3c>]
Sat May 28 08:21:05 2022 kern.warn kernel: [49524.609813] ---[ end trace e65d1c4
ec0b09e6e ]---

dmesg:

[49196.937243] WARNING: CPU: 0 PID: 0 at backports-5.15.33-1/drivers/net/wireless/broadcom/brcm80211/brcmfmac/fwsignal.c:1735 0xbf386d9c [brcmfmac@3efb02d2+0x35000]
[49196.957402] Modules linked in: pppoe ppp_async brcmfmac pppox ppp_generic nft_redir nft_nat nft_masq nft_flow_offload nft_fib_inet nft_ct nft_chain_nat nf_nat nf_flow_table_ipv6 nf_flow_table_ipv4 nf_flow_table_inet nf_flow_table nf_conntrack_netlink nf_conntrack_bridge nf_conntrack ipt_REJECT cfg80211 xt_time xt_tcpudp xt_multiport xt_mark xt_mac xt_limit xt_comment xt_TCPMSS xt_LOG usbhid slhc r8152 nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_quota nft_objref nft_numgen nft_meta_bridge nft_log nft_limit nft_hash nft_fwd_netdev nft_fib_ipv6 nft_fib_ipv4 nft_fib nft_dup_netdev nft_counter nf_tables nf_reject_ipv6 nf_reject_ipv4 nf_log_ipv6 nf_log_ipv4 nf_log_common nf_dup_netdev nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c iptable_mangle iptable_filter ip_tables hid_generic crc_ccitt compat cdc_ncm cdc_ether brcmutil snd_bcm2835(C) hid evdev xt_set x_tables ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface
[49196.958407]  ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set nfnetlink netlink_diag snd_rawmidi snd_seq_device snd_pcm_oss snd_pcm_dmaengine snd_mixer_oss snd_hwdep snd_compress snd_pcm snd_timer snd soundcore nls_utf8 vfat fat nls_iso8859_1 nls_cp437
[49197.120430] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G        WC        5.10.111 #0
[49197.136206] Hardware name: BCM2835
[49197.142756] Function entered at [<c020ea08>] from [<c0209d88>]
[49197.151727] Function entered at [<c0209d88>] from [<c0546a58>]
[49197.160569] Function entered at [<c0546a58>] from [<c021e530>]
[49197.169293] Function entered at [<c021e530>] from [<c021e5f4>]
[49197.177889] Function entered at [<c021e5f4>] from [<bf386d9c>]
[49197.186367] Function entered at [<bf386d9c>] from [<bf38095c>]
[49197.194731] Function entered at [<bf38095c>] from [<bf392d9c>]
[49197.202974] Function entered at [<bf392d9c>] from [<c0681f34>]
[49197.211109] Function entered at [<c0681f34>] from [<c06c5ec4>]
[49197.219151] Function entered at [<c06c5ec4>] from [<c02235e4>]
[49197.227066] Function entered at [<c02235e4>] from [<c02019bc>]
[49197.234860] Function entered at [<c02019bc>] from [<c0223db0>]
[49197.242530] Function entered at [<c0223db0>] from [<c026dfcc>]
[49197.250076] Function entered at [<c026dfcc>] from [<c02012b8>]
[49197.257500] Exception stack(0xc0e01f08 to 0xc0e01f50)
[49197.264077] 1f00:                   19e2b666 00000000 19e2b668 c02152a0 c0e00000 00000000
[49197.275194] 1f20: c0e04f1c c0e04f5c 00000000 00000000 00000000 c0c511f0 c0e0501c c0e01f58
[49197.286308] 1f40: c02076f8 c02076fc 60000013 ffffffff
[49197.292907] Function entered at [<c02012b8>] from [<c02076fc>]
[49197.300305] Function entered at [<c02076fc>] from [<c024c240>]
[49197.307707] Function entered at [<c024c240>] from [<c024c57c>]
[49197.315100] Function entered at [<c024c57c>] from [<c0c00e3c>]
[49197.324508] ---[ end trace e65d1c4ec0b09d48 ]---
[49197.333365] ------------[ cut here ]------------

@hnyman it appears like a hardware driver crash Broadcom BCM2835.

Did you edit out the "attached are the full logread and dmesg" ?

Are you using a usb ethernet adaptor (Broadcom)?

I realize the log is buffered and will overwrite but the Kernel Log dmesg is good to read top to bottom.

@Bill the output of both logread and dmesg is repetitive, and can't find anything different other than the logs I've posted. Also, can't seem to upload a text file.

Regarding the ethernet, yes I'm using the Raspberry Pi's Broadcom USB wireless dongle WLU6331 for my wireless LAN and TP-Link UE300 for my WAN.

lsusb:

Bus 001 Device 003: ID 0424:ec00
Bus 001 Device 004: ID 2357:0601 TP-Link USB 10/100/1000 LAN
Bus 001 Device 005: ID 0a5c:bd1e Broadcom Remote Download Wireless Adapter
Bus 001 Device 002: ID 0424:9514
Bus 001 Device 001: ID 1d6b:0002 Linux 5.10.111 dwc_otg_hcd DWC OTG Controller