That doesn't look like evidence of 'boots fine' - or was that the log from first boot before vendor firmware was loaded?
Correct - that was before the vendor firmware was loaded. Trimmed a little to fit here, same interface repeat is shown for all ports.
XikeStor boot log - successful
[ 0.000000] Linux version 6.6.74 (builder@buildhost) (mips-openwrt-linux-musl-gcc (OpenWrt GCC 13.3.0 r28695-22d1e6cd26) 13.3.0, GNU ld (GNU Binutils) 2.42) #0 Sun Jan 26 14:42:44 2025
[ 0.000000] RTL838X model is 0
[ 0.000000] RTL839X model is 0
[ 0.000000] RTL93XX model is 93030001
[ 0.000000] SoC Type: RTL9303
[ 0.000000] printk: bootconsole [early0] enabled
[ 0.000000] CPU0 revision is: 00019555 (MIPS 34Kc)
[ 0.000000] MIPS: machine is XikeStor SKS8300-8X
[ 0.000000] earlycon: ns16550a0 at MMIO 0x18002000 (options '9600n8')
[ 0.000000] printk: bootconsole [ns16550a0] enabled
[ 0.000000] Initrd not found or empty - disabling initrd
[ 0.000000] Using appended Device Tree.
[ 0.000000] Primary instruction cache 32kB, VIPT, 4-way, linesize 32 bytes.
[ 0.000000] Primary data cache 32kB, 4-way, PIPT, no aliases, linesize 32 bytes
[ 0.000000] Zone ranges:
[ 0.000000] Normal [mem 0x0000000000000000-0x000000001fffffff]
[ 0.000000] HighMem [mem 0x0000000020000000-0x000000002fffffff]
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x0000000000000000-0x000000000fffffff]
[ 0.000000] node 0: [mem 0x0000000020000000-0x000000002fffffff]
[ 0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x000000002fffffff]
[ 0.000000] On node 0, zone HighMem: 65536 pages in unavailable ranges
[ 0.000000] pcpu-alloc: s0 r0 d32768 u32768 alloc=1*32768
[ 0.000000] pcpu-alloc: [0] 0
[ 0.000000] Kernel command line: earlycon
[ 0.000000] Dentry cache hash table entries: 32768 (order: 5, 131072 bytes, linear)
[ 0.000000] Inode-cache hash table entries: 16384 (order: 4, 65536 bytes, linear)
[ 0.000000] Writing ErrCtl register=00028dbd
[ 0.000000] Readback ErrCtl register=00028dbd
[ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 129920
[ 0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[ 0.000000] Memory: 506396K/524288K available (6969K kernel code, 628K rwdata, 1608K rodata, 1220K init, 256K bss, 17892K reserved, 0K cma-reserved, 262144K highmem)
[ 0.000000] SLUB: HWalign=32, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[ 0.000000] NR_IRQS: 256
[ 0.000000] Failed to get CPU clock: -2
[ 0.000000] CPU frequency from device tree: 800MHz
[ 0.000000] clocksource: realtek_otto_timer: mask: 0xfffffff max_cycles: 0xfffffff, max_idle_ns: 38225208801 ns
[ 0.000001] sched_clock: 28 bits at 3125kHz, resolution 320ns, wraps every 42949672800ns
[ 0.106757] Calibrating delay loop... 531.66 BogoMIPS (lpj=2658304)
[ 0.238999] pid_max: default: 32768 minimum: 301
[ 0.309776] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes, linear)
[ 0.406067] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes, linear)
[ 0.517897] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.
[ 0.645745] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[ 0.775253] futex hash table entries: 256 (order: -1, 3072 bytes, linear)
[ 0.867271] pinctrl core: initialized pinctrl subsystem
[ 0.938789] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[ 1.017499] thermal_sys: Registered thermal governor 'step_wise'
[ 1.034387] clocksource: Switched to clocksource realtek_otto_timer
[ 1.207151] NET: Registered PF_INET protocol family
[ 1.271673] IP idents hash table entries: 4096 (order: 3, 32768 bytes, linear)
[ 1.368748] tcp_listen_portaddr_hash hash table entries: 1024 (order: 0, 4096 bytes, linear)
[ 1.479988] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[ 1.582019] TCP established hash table entries: 2048 (order: 1, 8192 bytes, linear)
[ 1.682931] TCP bind hash table entries: 2048 (order: 2, 16384 bytes, linear)
[ 1.777002] TCP: Hash tables configured (established 2048 bind 2048)
[ 1.861493] MPTCP token hash table entries: 512 (order: 0, 6144 bytes, linear)
[ 1.956991] UDP hash table entries: 256 (order: 0, 4096 bytes, linear)
[ 2.043050] UDP-Lite hash table entries: 256 (order: 0, 4096 bytes, linear)
[ 2.135778] NET: Registered PF_UNIX/PF_LOCAL protocol family
[ 2.216912] workingset: timestamp_bits=14 max_order=17 bucket_order=3
[ 2.303599] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[ 2.380443] jffs2: version 2.2 (NAND) (SUMMARY) (ZLIB) (LZMA) (RTIME) (CMODE_PRIORITY) (c) 2001-2006 Red Hat, Inc.
[ 2.524788] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)
[ 2.624086] pinctrl-single 1b00c600.pinmux: 32 pins, size 4
[ 2.698034] pinctrl-single 1b00cc00.pinmux: 32 pins, size 4
[ 2.773561] Serial: 8250/16550 driver, 16 ports, IRQ sharing enabled
[ 2.864524] printk: console [ttyS0] disabled
[ 2.921322] 18002000.uart: ttyS0 at MMIO 0x18002000 (irq = 30, base_baud = 10937500) is a 16550A
[ 3.037189] printk: console [ttyS0] enabled
[ 3.147252] printk: bootconsole [early0] disabled
[ 3.310282] printk: bootconsole [ns16550a0] disabled
[ 3.481258] brd: module loaded
[ 3.526500] spi-nor spi0.0: w25q256 (32768 Kbytes)
[ 3.589800] 4 fixed-partitions partitions found on MTD device spi0.0
[ 3.673563] OF: Bad cell count for /soc/spi@1200/flash@0/partitions
[ 3.756169] OF: Bad cell count for /soc/spi@1200/flash@0/partitions
[ 3.838989] Creating 4 MTD partitions on "spi0.0":
[ 3.902111] 0x000000000000-0x000000100000 : "u-boot"
[ 3.971023] 0x000000100000-0x000000130000 : "board-info"
[ 4.043677] 0x000000130000-0x000000200000 : "syslog"
[ 4.111767] 0x000000200000-0x000002000000 : "firmware"
[ 4.182190] 2 fixed-partitions partitions found on MTD device firmware
[ 4.268279] Creating 2 MTD partitions on "firmware":
[ 4.333689] 0x000000000000-0x000000800000 : "kernel"
[ 4.401631] 0x000000800000-0x000001e00000 : "rootfs"
[ 4.469741] mtd: setting mtd5 (rootfs) as root device
[ 4.536437] 1 squashfs-split partitions found on MTD device rootfs
[ 4.617833] 0x000000a10000-0x000001e00000 : "rootfs_data"
[ 4.708396] Probing RTL838X eth device pdev: 818b3a00, dev: 818b3a10
[ 4.812236] Found SoC ID: 9303: RTL9303, family 9300
[ 4.877790] Using MAC 000000e04c000000
[ 4.927128] set sds port 0 to 2
[ 4.968447] set sds port 8 to 3
[ 5.009712] set sds port 16 to 4
[ 5.052142] set sds port 20 to 5
[ 5.094556] set sds port 24 to 6
[ 5.136974] set sds port 25 to 7
[ 5.179404] set sds port 26 to 8
[ 5.221839] set sds port 27 to 9
[ 5.265091] c45_mask: 00000000
[ 5.364672] REALTEK RTL9300 SERDES mdio-bus:00: Detected internal RTL9300 Serdes
[ 5.474497] REALTEK RTL9300 SERDES mdio-bus:08: Detected internal RTL9300 Serdes
[ 5.584448] REALTEK RTL9300 SERDES mdio-bus:10: Detected internal RTL9300 Serdes
[ 5.694443] REALTEK RTL9300 SERDES mdio-bus:14: Detected internal RTL9300 Serdes
[ 5.804350] REALTEK RTL9300 SERDES mdio-bus:18: Detected internal RTL9300 Serdes
[ 5.914264] REALTEK RTL9300 SERDES mdio-bus:19: Detected internal RTL9300 Serdes
[ 6.024196] REALTEK RTL9300 SERDES mdio-bus:1a: Detected internal RTL9300 Serdes
[ 6.134130] REALTEK RTL9300 SERDES mdio-bus:1b: Detected internal RTL9300 Serdes
[ 6.240999] i2c_dev: i2c /dev entries driver
[ 6.297480] rtl9300_i2c_probe probing I2C adapter
[ 6.359434] i2c-rtl9300 1b00036c.i2c: SCL speed 100000, mode is 0
[ 6.439732] rtl9300_i2c_probe scl_num 0
[ 6.490178] rtl9300_i2c_probe sda_num 0
[ 6.541300] rtl9300_i2c_mux_probe probing I2C adapter
[ 6.607913] rtl9300_i2c_mux_probe base memory bb00036c
[ 6.675607] rtl9300_i2c_mux_probe channel 0 scl_num 0
[ 6.742102] rtl9300_i2c_mux_probe channel 0 sda_num 0
[ 6.809052] i2c i2c-0: Added multiplexed i2c bus 1
[ 6.872219] rtl9300_i2c_mux_probe channel 1 scl_num 0
[ 6.938774] rtl9300_i2c_mux_probe channel 1 sda_num 1
[ 7.005677] i2c i2c-0: Added multiplexed i2c bus 2
[ 7.068779] rtl9300_i2c_mux_probe channel 2 scl_num 0
[ 7.135252] rtl9300_i2c_mux_probe channel 2 sda_num 2
[ 7.202070] i2c i2c-0: Added multiplexed i2c bus 3
[ 7.265171] rtl9300_i2c_mux_probe channel 3 scl_num 0
[ 7.331718] rtl9300_i2c_mux_probe channel 3 sda_num 3
[ 7.398648] i2c i2c-0: Added multiplexed i2c bus 4
[ 7.461734] rtl9300_i2c_mux_probe channel 4 scl_num 0
[ 7.528300] rtl9300_i2c_mux_probe channel 4 sda_num 4
[ 7.595170] i2c i2c-0: Added multiplexed i2c bus 5
[ 7.658305] rtl9300_i2c_mux_probe channel 5 scl_num 0
[ 7.724865] rtl9300_i2c_mux_probe channel 5 sda_num 5
[ 7.791758] i2c i2c-0: Added multiplexed i2c bus 6
[ 7.854874] rtl9300_i2c_mux_probe channel 6 scl_num 0
[ 7.921344] rtl9300_i2c_mux_probe channel 6 sda_num 6
[ 7.988219] i2c i2c-0: Added multiplexed i2c bus 7
[ 8.051352] rtl9300_i2c_mux_probe channel 7 scl_num 0
[ 8.117910] rtl9300_i2c_mux_probe channel 7 sda_num 7
[ 8.184798] i2c i2c-0: Added multiplexed i2c bus 8
[ 8.247920] i2c-mux-rtl9300 i2c-mux: 8-port mux on 1b00036c.i2c adapter
[ 8.338716] NET: Registered PF_INET6 protocol family
[ 8.427217] Segment Routing with IPv6
[ 8.475614] In-situ OAM (IOAM) with IPv6
[ 8.527433] NET: Registered PF_PACKET protocol family
[ 8.594015] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[ 8.765563] 8021q: 802.1Q VLAN Support v1.8
[ 8.845412] sfp sfp-p1: Host maximum power 2.9W
[ 8.905951] sfp sfp-p2: Host maximum power 1.5W
[ 8.966454] sfp sfp-p3: Host maximum power 1.5W
[ 9.026894] sfp sfp-p4: Host maximum power 2.0W
[ 9.087364] sfp sfp-p5: Host maximum power 2.0W
[ 9.147866] sfp sfp-p6: Host maximum power 1.5W
[ 9.208378] sfp sfp-p7: Host maximum power 1.5W
[ 9.269021] sfp sfp-p8: Host maximum power 2.9W
[ 9.405901] sfp sfp-p1: module SonicWALL,Inc. 01-SSC-9787 rev RevA sn FFFFFF1057AA dc 2105271
[ 9.532518] REALTEK RTL9300 SERDES rtl838x slave mii-0:00: Detected internal RTL9300 Serdes
[ 9.656158] REALTEK RTL9300 SERDES rtl838x slave mii-0:08: Detected internal RTL9300 Serdes
[ 9.779930] REALTEK RTL9300 SERDES rtl838x slave mii-0:10: Detected internal RTL9300 Serdes
[ 9.903325] REALTEK RTL9300 SERDES rtl838x slave mii-0:14: Detected internal RTL9300 Serdes
[ 10.026804] REALTEK RTL9300 SERDES rtl838x slave mii-0:18: Detected internal RTL9300 Serdes
[ 10.149114] REALTEK RTL9300 SERDES rtl838x slave mii-0:19: Detected internal RTL9300 Serdes
[ 10.272329] REALTEK RTL9300 SERDES rtl838x slave mii-0:1a: Detected internal RTL9300 Serdes
[ 10.394648] REALTEK RTL9300 SERDES rtl838x slave mii-0:1b: Detected internal RTL9300 Serdes
[ 10.517968] REALTEK RTL9300 SERDES rtl838x slave mii-0:3f: Detected internal RTL9300 Serdes
[ 10.638385] rtl93xx_setup called
[ 10.680855] In rtl83xx_vlan_setup
[ 10.724455] In rtl930x_vlan_profile_setup
[ 10.777205] In rtl930x_vlan_profile_setup
[ 10.829939] UNKNOWN_MC_PMASK: 000000001fffffff
[ 10.888418] VLAN 0: L2 learn: 0; Unknown MC PMasks: L2 1fffffff, IPv4 1fffffff, IPv6: 1fffffff
[ 10.888439] Routing enabled: IPv4 UC y, IPv6 UC y, IPv4 MC y, IPv6 MC y
[ 11.091354] Bridge enabled: IPv4 MC n, IPv6 MC n,
[ 11.155556] VLAN profile 0: raw 00033000 00000000 1fffffff 1fffffff 1fffffff
[ 12.284394] rtl83xx_enable_phy_polling: f110101
[ 12.354417] rtl930x_pie_init
[ 12.392447] rtl930x_led_init called
[ 12.438394] rtl930x_led_init led_set configuration invalid skipping over this set
[ 12.537021] rtl930x_led_init led_set configuration invalid skipping over this set
[ 12.635601] rtl930x_led_init led_set configuration invalid skipping over this set
[ 12.734224] rtl930x_led_init bb00cc00: 01053659
[ 12.793825] rtl930x_led_init bb00cc04: aaa9aaa9
[ 12.853442] rtl930x_led_init bb00cc08: 0055a9a9
[ 12.913048] rtl930x_led_init bb00cc0c: 00000000
[ 12.972671] rtl930x_led_init bb00cc10: 00000000
[ 13.032285] rtl930x_led_init bb00cc14: 00000000
[ 13.091908] rtl930x_led_init bb00cc18: 00000000
[ 13.151522] rtl930x_led_init bb00cc1c: 00000000
[ 13.211145] rtl930x_led_init bb00cc20: 00000000
[ 13.270760] rtl930x_led_init bb00cc24: 00000000
[ 13.330383] rtl930x_led_init bb00cc28: 0baa0a01
[ 13.389997] rtl930x_led_init bb00cc2c: 00000000
[ 13.449620] rtl930x_led_init bb00cc30: 00000000
[ 13.509244] rtl930x_led_init bb00cc34: 00000000
[ 13.568862] rtl930x_led_init bb00cc38: 00000000
[ 13.628473] rtl930x_led_init bb00cc3c: 0f110101
[ 13.688096] rtl930x_led_init bb00cc40: 0f110101
[ 13.747710] rtl930x_led_init bb00cc44: 0f110101
[ 13.807334] rtl930x_led_init bb00cc48: 00000000
[ 13.866949] rtl930x_led_init bb00cc4c: 00000000
[ 13.926571] rtl930x_led_init bb00cc50: 00000000
[ 13.986184] rtl930x_led_init bb00cc54: 00000000
[ 14.045809] rtl930x_led_init bb00cc58: 00000000
[ 14.105422] rtl930x_led_init bb00cc5c: 00000000
[ 14.165223] rtl83xx-switch switch@1b000000: configuring for fixed/internal link mode
[ 14.267320] rtl93xx_phylink_mac_config port 28, mode 1, phy-mode: internal, speed -1, link 0
[ 14.379961] rtl83xx-switch switch@1b000000 lan1 (uninitialized): PHY [mdio-bus:00] driver [REALTEK RTL9300 SERDES] (irq=POLL)
[ 14.531762] rtl83xx-switch switch@1b000000 lan2 (uninitialized): PHY [mdio-bus:08] driver [REALTEK RTL9300 SERDES] (irq=POLL)
[ 14.683739] rtl83xx-switch switch@1b000000 lan3 (uninitialized): PHY [mdio-bus:10] driver [REALTEK RTL9300 SERDES] (irq=POLL)
[ 14.835851] rtl83xx-switch switch@1b000000 lan4 (uninitialized): PHY [mdio-bus:14] driver [REALTEK RTL9300 SERDES] (irq=POLL)
[ 14.987731] rtl83xx-switch switch@1b000000 lan5 (uninitialized): PHY [mdio-bus:18] driver [REALTEK RTL9300 SERDES] (irq=POLL)
[ 15.139569] rtl83xx-switch switch@1b000000 lan6 (uninitialized): PHY [mdio-bus:19] driver [REALTEK RTL9300 SERDES] (irq=POLL)
[ 15.291360] rtl83xx-switch switch@1b000000 lan7 (uninitialized): PHY [mdio-bus:1a] driver [REALTEK RTL9300 SERDES] (irq=POLL)
[ 15.443243] rtl83xx-switch switch@1b000000 lan8 (uninitialized): PHY [mdio-bus:1b] driver [REALTEK RTL9300 SERDES] (irq=POLL)
[ 15.594141] rtl838x-eth 1b00a300.ethernet eth0: entered promiscuous mode
[ 15.682553] DSA: tree 0 setup
[ 15.721700] LINK state irq: 23
[ 15.761875] In rtl83xx_setup_qos
[ 15.804438] L3_IPUC_ROUTE_CTRL 00002000, IPMC_ROUTE 00000500, IP6UC_ROUTE 00014580, IP6MC_ROUTE 00012880
[ 15.929435] L3_IPUC_ROUTE_CTRL 00002001, IPMC_ROUTE 00000501, IP6UC_ROUTE 00014581, IP6MC_ROUTE 00012881
[ 16.054408] L3_IP_ROUTE_CTRL 00000130
[ 16.102658] rtl930x_dbgfs_init called
[ 16.151826] rtl83xx-switch switch@1b000000: Link is Up - 10Gbps/Full - flow control off
[ 16.261143] rtl83xx_fib_event_work_do: FIB4 default rule failed
[ 16.339239] rtl83xx_fib_event_work_do: FIB4 default rule failed
[ 16.427811] clk: Disabling unused clocks
[ 16.486022] VFS: Mounted root (squashfs filesystem) readonly on device 31:5.
[ 16.584454] Freeing unused kernel image (initmem) memory: 1220K
[ 16.662463] This architecture does not have kernel memory protection.
[ 16.747322] Run /sbin/init as init process
[ 16.801190] with arguments:
[ 16.840167] /sbin/init
[ 16.875734] with environment:
[ 16.916990] HOME=/
[ 16.947940] TERM=linux
[ 17.468544] init: Console is alive
[ 17.513837] init: - watchdog -
[ 17.860831] kmodloader: loading kernel modules from /etc/modules-boot.d/*
[ 17.989973] gpio_button_hotplug: loading out-of-tree module taints kernel.
[ 18.086667] kmodloader: done loading kernel modules from /etc/modules-boot.d/*
[ 18.192721] init: - preinit -
[ 21.574449] random: crng init done
[ 22.840638] RESETTING 9300, CPU_PORT 28
[ 23.091525] rtl838x-eth 1b00a300.ethernet eth0: configuring for fixed/internal link mode
[ 23.198086] In rtl838x_mac_config, mode 1
[ 23.251716] rtl83xx-switch switch@1b000000 lan1: configuring for inband/10gbase-r link mode
[ 23.361914] rtl93xx_phylink_mac_config port 0, mode 2, phy-mode: 10gbase-r, speed -1, link 0
[ 23.473182] rtl93xx_phylink_mac_config SDS is 2
[ 23.532791] rtl9300_sds_rst 31
[ 23.713763] rtl9300_phy_enable_10g_1g 1gbit phy: 00001140
[ 23.785811] rtl9300_phy_enable_10g_1g 1gbit phy enabled: 00001140
[ 23.867120] rtl9300_phy_enable_10g_1g 10gbit phy: 00002040
[ 23.940384] rtl9300_phy_enable_10g_1g 10gbit phy after: 00002040
[ 24.020542] rtl9300_phy_enable_10g_1g set medium: 00000000
[ 24.093809] rtl9300_phy_enable_10g_1g set medium after: 00000002
[ 24.192937] rtl9300_serdes_setup: Configuring RTL9300 SERDES 2
[ 24.271783] rtl9300_serdes_mac_link_config: registers before 00000000 00001403
[ 24.370929] rtl9300_serdes_mac_link_config: registers after 00000000 00001403
[ 24.464908] rtl9300_force_sds_mode: SDS: 2, mode 28
[ 24.529135] rtl9300_force_sds_mode --------------------- serdes 2 forcing to 1a ...
[ 24.941476] rtl9300_force_sds_mode --------------------- serdes 2 forced to 1a DONE
[ 25.047350] start_1.1.1 initial value for sds 2
[ 25.163882] end_1.1.1 --
[ 25.197109] start_1.1.2 Load DFE init. value
[ 25.255307] end_1.1.2
[ 25.285081] start_1.1.3 disable LEQ training,enable DFE clock
[ 25.372742] end_1.1.3 --
[ 25.405987] start_1.1.4 offset cali setting
[ 25.463012] end_1.1.4
[ 25.492815] start_1.1.5 LEQ and DFE setting
[ 25.561823] end_1.1.5
[ 25.600615] start_1.2.1 ForegroundOffsetCal_Manual
[ 25.667657] end_1.2.1
[ 25.678664] start_1.2.3 Foreground Calibration
[ 25.777920] rtl9300_do_rx_calibration_2_3: fgcal_gray: 20, fgcal_binary 30
[ 25.869559] rtl9300_do_rx_calibration_2_3: end_1.2.3
[ 25.934948] start_1.4.1
[ 26.158526] end_1.4.1
[ 26.190616] start_1.4.2
[ 26.230436] vth_set_bin = 3
[ 26.262535] vth_set_bin = 3
[ 26.300220] Vth Maunal = 0
[ 26.452741] Tap0 Sign : +
[ 26.488296] tap0_coef_bin = 15
[ 26.523687] tap0 manual = 0
[ 26.569872] end_1.4.2
[ 26.606593] start_1.5.2
[ 26.714273] end_1.5.2
[ 26.767323] rtl9300_do_rx_calibration: SDS enabled
[ 26.913112] start_1.4.1
[ 27.136708] end_1.4.1
[ 27.168801] start_1.4.2
[ 27.208602] vth_set_bin = 3
[ 27.240728] vth_set_bin = 3
[ 27.278409] Vth Maunal = 0
[ 27.430922] Tap0 Sign : +
[ 27.466485] tap0_coef_bin = 15
[ 27.501944] tap0 manual = 0
[ 27.548057] end_1.4.2
[ 27.584802] start_1.5.2
[ 27.692438] end_1.5.2
[ 27.794635] 8021q: adding VLAN 0 to HW filter on device lan1
[ 27.899347] rtl838x-eth 1b00a300.ethernet eth0: Link is Up - 1Gbps/Full - flow control off
[ 28.008552] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 28.094691] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 28.241451] sfp sfp-p1: module SonicWALL,Inc. 01-SSC-9787 rev RevA sn FFFFFF1057AA dc 2105271
[ 28.367699] rtl93xx_phylink_mac_config port 0, mode 2, phy-mode: 10gbase-r, speed -1, link 0
[ 28.478993] rtl93xx_phylink_mac_config SDS is 2
[ 28.538583] rtl9300_sds_rst 31
[ 28.719514] rtl9300_phy_enable_10g_1g 1gbit phy: 00001140
[ 28.791600] rtl9300_phy_enable_10g_1g 1gbit phy enabled: 00001140
[ 28.872910] rtl9300_phy_enable_10g_1g 10gbit phy: 00002040
[ 28.946172] rtl9300_phy_enable_10g_1g 10gbit phy after: 00002040
[ 29.026328] rtl9300_phy_enable_10g_1g set medium: 00000002
[ 29.099597] rtl9300_phy_enable_10g_1g set medium after: 00000002
[ 29.198727] rtl9300_serdes_setup: Configuring RTL9300 SERDES 2
[ 29.277578] rtl9300_serdes_mac_link_config: registers before 00000000 00001203
[ 29.376738] rtl9300_serdes_mac_link_config: registers after 00000000 00001003
[ 29.470795] rtl9300_force_sds_mode: SDS: 2, mode 28
[ 29.535012] rtl9300_force_sds_mode --------------------- serdes 2 forcing to 1a ...
[ 29.947375] rtl9300_force_sds_mode --------------------- serdes 2 forced to 1a DONE
[ 30.053333] start_1.1.1 initial value for sds 2
[ 30.169892] end_1.1.1 --
[ 30.203104] start_1.1.2 Load DFE init. value
[ 30.261279] end_1.1.2
[ 30.291082] start_1.1.3 disable LEQ training,enable DFE clock
[ 30.378732] end_1.1.3 --
[ 30.411986] start_1.1.4 offset cali setting
[ 30.469009] end_1.1.4
[ 30.498801] start_1.1.5 LEQ and DFE setting
[ 30.567837] end_1.1.5
[ 30.606602] start_1.2.1 ForegroundOffsetCal_Manual
[ 30.673629] end_1.2.1
[ 30.684642] start_1.2.3 Foreground Calibration
[ 30.783918] rtl9300_do_rx_calibration_2_3: fgcal_gray: 20, fgcal_binary 30
[ 30.875656] rtl9300_do_rx_calibration_2_3: end_1.2.3
[ 30.941072] start_1.4.1
[ 31.164835] end_1.4.1
[ 31.196925] start_1.4.2
[ 31.236723] vth_set_bin = 3
[ 31.268849] vth_set_bin = 3
[ 31.306530] Vth Maunal = 0
[ 31.459055] Tap0 Sign : +
[ 31.494607] tap0_coef_bin = 16
[ 31.529997] tap0 manual = 0
[ 31.576278] end_1.4.2
[ 31.613012] start_1.5.2
[ 31.720682] end_1.5.2
[ 31.773903] rtl9300_do_rx_calibration: SDS enabled
[ 31.919738] start_1.4.1
[ 32.143678] end_1.4.1
[ 32.175840] start_1.4.2
[ 32.215651] vth_set_bin = 3
[ 32.247886] vth_set_bin = 3
[ 32.285568] Vth Maunal = 0
[ 32.438210] Tap0 Sign : +
[ 32.473725] tap0_coef_bin = 16
[ 32.509353] tap0 manual = 0
[ 32.555538] end_1.4.2
[ 32.592231] start_1.5.2
[ 32.699910] end_1.5.2
[ 32.814444] rtl83xx_fib_event_work_do: FIB4 failed
[ 32.907928] rtl83xx_fib_event_work_do: FIB4 failed
[ 32.994526] rtl83xx_fib_event_work_do: FIB4 failed
[ 33.092218] ------------[ cut here ]------------
[ 33.153043] WARNING: CPU: 0 PID: 446 at drivers/net/phy/phy.c:1415 phy_start+0xc0/0xe0
[ 33.257462] called from state RUNNING
[ 33.305594] Modules linked in: gpio_button_hotplug(O) crc32c_generic
[ 33.389294] CPU: 0 PID: 446 Comm: kworker/0:6 Tainted: G O 6.6.74 #0
[ 33.491281] Workqueue: events_power_efficient sfp_timeout
[ 33.562363] Stack : 81a5fd04 81bd7cb4 81cbbe50 80893490 80960000 81cbbe00 804c5cf8 00000009
[ 33.672426] 81bd7cb4 80168b78 80a00000 80893490 81a993c8 00000001 81a5fcc8 e68cedc3
[ 33.782491] 00000000 00000000 80893490 81a5fbf8 ffffefff 00000000 00000000 ffffffea
[ 33.892557] 00000173 81a5fbbc 00000173 00000000 00000001 80893490 81a5fdc8 804c5cf8
[ 34.002623] 00000009 81bd7cb4 81cbbe50 61c88647 8096f760 8045fe00 00000000 80b30000
[ 34.112688] ...
[ 34.144791] Call Trace:
[ 34.176893] [<80106140>] show_stack+0x28/0xf0
[ 34.234222] [<8079cf6c>] dump_stack_lvl+0x38/0x60
[ 34.296134] [<80127e28>] __warn+0xb0/0xe4
[ 34.348872] [<80127ee8>] warn_slowpath_fmt+0x8c/0xac
[ 34.414224] [<804c5cf8>] phy_start+0xc0/0xe0
[ 34.470404] [<804c3ed0>] phylink_sfp_module_start+0x38/0x48
[ 34.543781]
[ 34.563668] ---[ end trace 0000000000000000 ]---
[ 34.636614] rtl83xx-switch switch@1b000000 lan1: Link is Up - 10Gbps/Full - flow control off
[ 35.649472] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 36.366373] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 36.452767] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 36.538991] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 36.625270] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 36.711447] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 36.797662] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 37.964462] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 38.284465] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 38.370567] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 38.764444] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 38.857990] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 38.944187] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 39.142533] mount_root: jffs2 not ready yet, using temporary tmpfs overlay
[ 39.239320] urandom-seed: Seed file not found (/etc/urandom.seed)
[ 39.392991] rtl83xx_fib4_del: no such gateway: 0.0.0.0
[ 39.469283] ------------[ cut here ]------------
[ 39.530407] WARNING: CPU: 0 PID: 700 at drivers/net/phy/phy.c:1369 phy_stop+0x60/0x1d8
[ 39.634874] called from state HALTED
[ 39.681887] Modules linked in: gpio_button_hotplug(O) crc32c_generic
[ 39.765578] CPU: 0 PID: 700 Comm: ip Tainted: G W O 6.6.74 #0
[ 39.857248] Stack : 00000000 81cba30c 8198a000 80168a6c 00000000 00000004 00000000 00000000
[ 39.967311] 81a77ba4 80b30000 80a00000 80893490 81c11ec8 00000001 81a77b48 945bf0e5
[ 40.077376] 00000000 00000000 80893490 81a77a98 ffffefff 00000000 00000000 ffffffea
[ 40.187442] 00000198 81a77a5c 00000198 00000000 00000001 80893490 81a77c48 804c6e94
[ 40.297507] 00000009 81cba30c 8198a000 81cba300 8096f760 8045fe00 00000000 80b30000
[ 40.407572] ...
[ 40.439676] Call Trace:
[ 40.471778] [<80106140>] show_stack+0x28/0xf0
[ 40.529107] [<8079cf6c>] dump_stack_lvl+0x38/0x60
[ 40.591017] [<80127e28>] __warn+0xb0/0xe4
[ 40.643757] [<80127ee8>] warn_slowpath_fmt+0x8c/0xac
[ 40.709109] [<804c6e94>] phy_stop+0x60/0x1d8
[ 40.765288] [<804c02a0>] phylink_stop+0x44/0xec
[ 40.824906] [<80767240>] dsa_port_disable_rt+0x34/0xc8
[ 40.892551] [<8076d4a4>] dsa_slave_close+0x40/0x124
[ 40.956756] [<80560dc4>] __dev_close_many+0x9c/0x114
[ 41.022108] [<80568854>] __dev_change_flags+0x184/0x23c
[ 41.090898] [<80568934>] dev_change_flags+0x28/0x78
[ 41.155103] [<8065715c>] devinet_ioctl+0x2a4/0x908
[ 41.218161] [<80659c14>] inet_ioctl+0x128/0x250
[ 41.277780] [<80535378>] sock_ioctl+0x454/0x4f4
[ 41.337399] [<802cf4e4>] sys_ioctl+0xe4/0xfc
[ 41.393578] [<8010d500>] syscall_common+0x34/0x58
[ 41.455491]
[ 41.475607] ---[ end trace 0000000000000000 ]---
[ 41.538164] rtl83xx-switch switch@1b000000 lan1: Link is Down
[ 41.615489] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 41.701583] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 41.787650] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 41.873744] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 41.959834] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 42.045927] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 42.132063] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 42.218115] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 42.304205] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 42.390298] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 42.476390] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 42.562485] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 42.649011] rtl83xx_fib4_del: no such gateway: 0.0.0.0
[ 42.716784] rtl83xx_fib4_del: no such gateway: 0.0.0.0
[ 42.799400] procd: - early -
[ 42.837742] procd: - watchdog -
[ 43.598211] procd: - watchdog -
[ 43.640722] procd: - ubus -
[ 43.785530] procd: - init -
[ 44.932063] kmodloader: loading kernel modules from /etc/modules.d/*
[ 45.346884] kmodloader: done loading kernel modules from /etc/modules.d/*
[ 46.762380] urngd: v1.0.2 started.
[ 50.839035] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 69.782761] in rtl838x_eth_stop
[ 69.824369] rtl838x-eth 1b00a300.ethernet eth0: Link is Down
[ 70.004503] jffs2_scan_eraseblock(): End of filesystem marker found at 0x0
[ 70.617754] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 70.703812] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 70.789886] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 70.875971] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 70.983530] jffs2_build_filesystem(): unlocking the mtd device...
[ 70.983560] done.
[ 71.090324] jffs2_build_filesystem(): erasing all blocks after the end marker...
[ 71.872382] Using MAC 00008ca68270195d
[ 72.175502] RESETTING 9300, CPU_PORT 28
[ 72.426348] rtl838x-eth 1b00a300.ethernet eth0: configuring for fixed/internal link mode
[ 72.532908] In rtl838x_mac_config, mode 1
[ 72.776149] rtl838x-eth 1b00a300.ethernet eth0: Link is Up - 1Gbps/Full - flow control off
[ 72.934512] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 73.020649] rtl83xx_fib_event: FIB_RULE ADD/DEL for IPv6 not supported
[ 73.344504] rtl83xx-switch switch@1b000000 lan1: configuring for inband/10gbase-r link mode
[ 73.454688] rtl93xx_phylink_mac_config port 0, mode 2, phy-mode: 10gbase-r, speed -1, link 0
[ 73.565987] rtl93xx_phylink_mac_config SDS is 2
[ 73.625681] rtl9300_sds_rst 31
[ 73.806672] rtl9300_phy_enable_10g_1g 1gbit phy: 00001140
[ 73.878794] rtl9300_phy_enable_10g_1g 1gbit phy enabled: 00001140
[ 73.960104] rtl9300_phy_enable_10g_1g 10gbit phy: 00002040
[ 74.033381] rtl9300_phy_enable_10g_1g 10gbit phy after: 00002040
[ 74.113534] rtl9300_phy_enable_10g_1g set medium: 00000002
[ 74.186798] rtl9300_phy_enable_10g_1g set medium after: 00000002
[ 74.285944] rtl9300_serdes_setup: Configuring RTL9300 SERDES 2
[ 74.364781] rtl9300_serdes_mac_link_config: registers before 00000000 00001a03
[ 74.463910] rtl9300_serdes_mac_link_config: registers after 00000000 00001803
[ 74.557905] rtl9300_force_sds_mode: SDS: 2, mode 28
[ 74.622113] rtl9300_force_sds_mode --------------------- serdes 2 forcing to 1a ...
[ 75.034501] rtl9300_force_sds_mode --------------------- serdes 2 forced to 1a DONE
[ 75.140419] start_1.1.1 initial value for sds 2
[ 75.257022] end_1.1.1 --
[ 75.290301] start_1.1.2 Load DFE init. value
[ 75.348479] end_1.1.2
[ 75.378281] start_1.1.3 disable LEQ training,enable DFE clock
[ 75.465957] end_1.1.3 --
[ 75.499181] start_1.1.4 offset cali setting
[ 75.556222] end_1.1.4
[ 75.585995] start_1.1.5 LEQ and DFE setting
[ 75.655044] end_1.1.5
[ 75.693893] start_1.2.1 ForegroundOffsetCal_Manual
[ 75.760933] end_1.2.1
[ 75.771946] start_1.2.3 Foreground Calibration
[ 75.871220] rtl9300_do_rx_calibration_2_3: fgcal_gray: 20, fgcal_binary 30
[ 75.962850] rtl9300_do_rx_calibration_2_3: end_1.2.3
[ 76.028252] start_1.4.1
[ 76.251858] end_1.4.1
[ 76.284017] start_1.4.2
[ 76.323831] vth_set_bin = 4
[ 76.355941] vth_set_bin = 4
[ 76.393625] Vth Maunal = 0
[ 76.546163] Tap0 Sign : +
[ 76.581699] tap0_coef_bin = 21
[ 76.617092] tap0 manual = 0
[ 76.663248] end_1.4.2
[ 76.699900] start_1.5.2
[ 76.807596] end_1.5.2
[ 76.860621] rtl9300_do_rx_calibration: SDS enabled
[ 77.006424] start_1.4.1
[ 77.230049] end_1.4.1
[ 77.262201] start_1.4.2
[ 77.302011] vth_set_bin = 4
[ 77.334119] vth_set_bin = 4
[ 77.371818] Vth Maunal = 0
[ 77.524340] Tap0 Sign : +
[ 77.559880] tap0_coef_bin = 21
[ 77.595301] tap0 manual = 0
[ 77.641434] end_1.4.2
Are you sure this wasn't just a coincidence? I've seen that crash on rtl8380 too a number of times when booting from initramfs.It looks like a spurious network interrupt before the driver is fully initialized. My theory is that this happens because we (obviously) enable networking in the bootloader when tftp booting.
See for example the partial bootlog I posted in
1 Like
Interesting, I've done a lot of TFTP booting with Netgear, HPE and Zyxel realtek switches here and haven't observed this spontaneously breaking in one boot and fixed on the next boot before. Entirely possible of course, just not something I'd seen.
One item I notice is that LLDP is not working on this RTL9303 switch, perhaps the switch is not setup for that yet.
Specifically - LLDP is being sent ok, but received frames don't appear to be hitting the CPU port.
It's a rare event with normal network traffic. You must be "lucky" to have a packet hit the cpu port at the exact wrong time. But I was able to trigger this quite reliably by simply flood pinging the bootloader IP address after running rtk network on. Forcing a broadcast storm should also work, as well as anything else throwing packets at the switch cpu port.
Didn't look further into the issue. The main point back then was to prove that this crash was not a v6.1 regression. And it's a very minor issue. If it happens, then simply try tftp booting again. I've never seen it happen two times in a row under normal network conditions.
1 Like
Ah, I also faced that problem while working to add support for the switch with initramfs image. Since the problem did not occur every time and did not occur after flashing sysupgrade image, I did not pay much attention to it. But maybe I should have written about this problem...
2 Likes
It is working now - as you note the problem does not occur every time.
However, I did spot a problem with LLDP. If you have any idea why this switch isn't receiving LLDP PDUs I am happy to test.
As well as not recieving LLDP on the CPU port, it appears that the device is forwarding LLDP PDUs through the switch from peers to other peers. I can see this mikrotik device from a different peer as well as seeing the XikeStor with 2 different MAC addresses:
-------------------------------------------------------------------------------
Interface: eth1, via: LLDP, RID: 5, Time: 0 day, 00:00:30
Chassis:
ChassisID: mac 18:fd:74:xx:xx:xx
SysName: mikrotik-CRS305
SysDescr: MikroTik RouterOS 7.16.1 (stable) 2024-10-10 14:03:32 CRS305-1G-4S+
MgmtIP: 192.168.0.xx
MgmtIface: 5
Capability: Bridge, on
Capability: Router, on
Port:
PortID: ifname sfp-sfpplus4
PortDescr: bridge/sfp-sfpplus4
TTL: 121
-------------------------------------------------------------------------------
Interface: eth1, via: LLDP, RID: 6, Time: 0 day, 00:00:21
Chassis:
ChassisID: local XikeStor
SysName: XikeStor
SysDescr: OpenWrt SNAPSHOT @ XikeStor
MgmtIP: 192.168.0.xx
MgmtIface: 14
MgmtIP: fe80::8ea6:82ff:fexx:xxxx
MgmtIface: 2
Capability: Bridge, on
Capability: Router, on
Capability: Wlan, off
Capability: Station, off
Port:
PortID: mac 8c:a6:82:xx:xx:xx
PortDescr: lan1
TTL: 120
-------------------------------------------------------------------------------
Interface: eth1, via: LLDP, RID: 6, Time: 0 day, 00:00:08
Chassis:
ChassisID: local XikeStor
SysName: XikeStor
SysDescr: OpenWrt SNAPSHOT @ XikeStor
MgmtIP: 192.168.0.xx
MgmtIface: 14
MgmtIP: fe80::8ea6:82ff:fexx:xxxx
MgmtIface: 2
Capability: Bridge, on
Capability: Router, on
Capability: Wlan, off
Capability: Station, off
Port:
PortID: mac 8e:a6:82:xx:xx:xx
PortDescr: lan8
TTL: 120
-------------------------------------------------------------------------------
Closing part of the RTL8231 migration, dropping the old driver: https://github.com/openwrt/openwrt/pull/17778
It would be good if someone with a G310TP (also GS110TP) could check if the PoE enable GPIO line is the same as for the GS110TPP. Then the same change can be applied there. See Netgear GS310TP GPIOs.
PR title has spelling error (RLT vs RTL), in case we need to search for it later.
1 Like
Wondering - I see mention of hwmon but can't see a way to get temperature sensor data. With some of these designs having compromised ventilation and with work ongoing for fan-speed control it would be useful to use lm-sensors to pull any relevant temperature sensors for external reporting.
1 Like
Upto 6.6 this was the case on the RTL8380 as well. Drove the FritzBoxes nuts. It would totally mess up the mesh view.
Aware of what changed to fix it?
IIRC It was a problem also seen on (iirc) MT7621, and a combination of mishandling of packets with the special address used for LLDP, and some fixes for DSA, that were included in 6.6. I still have an RTL8380 with 5.15 somewhere with that issue, I think.
From the Openwrt Changelog for RTL83:
realtek: Trap LLDP packets to the CPU and do not forward
/target/linux/realtek/files-5.15/drivers/net/dsa/rtl83xx/dsa.c
+static void rtl83xx_setup_lldp_traps(struct rtl838x_switch_priv *priv)
+{
+ for (int i = 0; i < priv->cpu_port; i++)
+ priv->r->set_receive_management_action(i, LLDP, TRAP2CPU);
+}
1 Like
I think I reported a similar problem too, the fix related to differentiating between multicast and LLDP frames in DSA.
1 Like
That's the one i was looking for to include in an edit of my message above.
Thank you (and all others involved) for all your work!
Edit: So, it seems, RTL9X needs a fix like analogous to
1 Like
This should be an easy one:
rtl838x_set_receive_management_action() must be copied/adapted for RTL93xx into rtl930x.c and manage RMA_PORT_LLDP_CTRL register.
I currently have no SDK and we have no RTL930x developer guide to look what needs to be written to these 3-bit fields. But https://github.com/plappermaul/realtek-doc/blob/main/RTL9310_Developer_Guide_V1.0.pdf should give a goot idea.
4 Likes
ACT field:
0x0: Forward
0x1: Drop
0x2: Trap to local CPU
0x3: Trap to master CPU
0x4: Flood(limited by RMA_LLDP_FLD_PMSK)
0x5 0x7: Reserved
Note: When it is set to Trap, LLDP packet should be able to bypass STP
and VLAN drop ("VLAN ingress filter", "VLAN error", "VLAN accept
frame type" and "CFI = 1")
| Type | Table Content | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| L2 Unicast | Valid (1) | FMT (1) | TYPE (1) | FID (12) | MAC (48) | L2_TNL (1) | Next_hop (1) | IS_TRK (1) | UNIT_ID (4) | PORT_ID (6) | Age (3) | SABLK (1) | DABLK (1) | Static (1) | Suspending (1) | TAGSTS (1) | AGG_PRI (3) | AGG_VID (12) |
| L2 Multicast | Valid (1) | FMT (1) | TYPE (1) | FID (12) | MAC (48) | LOCAL_FWD (1) | Next_hop (1) | MC_PMSK_IDX (12) | REMOTE_FWD (1) | L2_TNL_LST_IDX (13) | BPE_TYPE (1) |
1 Like
I had a crack at this. Anyone who has the 930x to compile and test, can use my attempt here. ( Currently this commit ). Any takers, @howels @stragies @plappermaul ?
1 Like
Thanks for trying but looks like there is no change, still reflecting neighbour LLDP frames through the switch to other peers and not able to capture LLDP on the CPU port as a client.
1 Like
The patch cannot work as it calculates registers/bits with 2-bit wide values. RTL930x/RTL931x are 3-bit wide. Thats why I mentioned it must be adapted. rtl931x_set_receive_management_action() is a better template but must be adapted as well.
1 Like