Jffs2_get_inode_nodes: Node header CRC failed at 0x****

Hello,

I made an custom openwrt image with image builder


make image PROFILE=zbtlink_zbt-we826-16m \
PACKAGES="luci-app-openvpn bash strongswan-full usb-modeswitch kmod-mii kmod-usb-net kmod-usb-wdm kmod-usb-net-qmi-wwan luci-proto-qmi uqmi \
zram-swap uhttpd uhttpd-mod-ubus libiwinfo-lua luci-base luci-app-firewall \
luci-mod-admin-full luci-theme-material " FILES=../../filesystem16/

It builds pretty fine. I work on an 16M device. I lost all my config after reboot, I read the logs seen the following messages.

[    0.000000] Linux version 4.14.171 (builder@buildhost) (gcc version 8.3.0 (OpenWrt GCC 8.3.0 r12364-29c6ddd99e)) #0 Fri Feb 28 16:50:46 2020
[    0.000000] Board has DDR2
[    0.000000] Analog PMU set to hw control
[    0.000000] Digital PMU set to hw control
[    0.000000] SoC Type: MediaTek MT7620A ver:2 eco:6
[    0.000000] bootconsole [early0] enabled
[    0.000000] CPU0 revision is: 00019650 (MIPS 24KEc)
[    0.000000] MIPS: machine is Zbtlink ZBT-WE826 (16M)
[    0.000000] Determined physical RAM map:
[    0.000000]  memory: 08000000 @ 00000000 (usable)
[    0.000000] Initrd not found or empty - disabling initrd
[    0.000000] Primary instruction cache 64kB, VIPT, 4-way, linesize 32 bytes.
[    0.000000] Primary data cache 32kB, 4-way, PIPT, no aliases, linesize 32 bytes
[    0.000000] Zone ranges:
[    0.000000]   Normal   [mem 0x0000000000000000-0x0000000007ffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x0000000007ffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x0000000007ffffff]
[    0.000000] On node 0 totalpages: 32768
[    0.000000] free_area_init_node: node 0, pgdat 80525b30, node_mem_map 81000040
[    0.000000]   Normal zone: 288 pages used for memmap
[    0.000000]   Normal zone: 0 pages reserved
[    0.000000]   Normal zone: 32768 pages, LIFO batch:7
[    0.000000] random: get_random_bytes called from start_kernel+0x98/0x4a8 with crng_init=0
[    0.000000] pcpu-alloc: s0 r0 d32768 u32768 alloc=1*32768
[    0.000000] pcpu-alloc: [0] 0
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 32480
[    0.000000] Kernel command line: console=ttyS0,115200 rootfstype=squashfs,jffs2
[    0.000000] PID hash table entries: 512 (order: -1, 2048 bytes)
[    0.000000] Dentry cache hash table entries: 16384 (order: 4, 65536 bytes)
[    0.000000] Inode-cache hash table entries: 8192 (order: 3, 32768 bytes)
[    0.000000] Writing ErrCtl register=00002c14
[    0.000000] Readback ErrCtl register=00002c14
[    0.000000] Memory: 123004K/131072K available (4138K kernel code, 197K rwdata, 940K rodata, 1180K init, 220K bss, 8068K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=32, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[    0.000000] NR_IRQS: 256
[    0.000000] CPU Clock: 580MHz
[    0.000000] clocksource: systick: mask: 0xffff max_cycles: 0xffff, max_idle_ns: 583261500 ns
[    0.000000] systick: enable autosleep mode
[    0.000000] systick: running - mult: 214748, shift: 32
[    0.000000] clocksource: MIPS: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 6590553264 ns
[    0.000009] sched_clock: 32 bits at 290MHz, resolution 3ns, wraps every 7405115902ns
[    0.007596] Calibrating delay loop... 385.84 BogoMIPS (lpj=1929216)
[    0.073554] pid_max: default: 32768 minimum: 301
[    0.078324] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes)
[    0.084704] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes)
[    0.098560] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.108130] futex hash table entries: 256 (order: -1, 3072 bytes)
[    0.114149] pinctrl core: initialized pinctrl subsystem
[    0.120668] NET: Registered protocol family 16
[    0.609764] mt7620-pci 10140000.pcie: PCIE0 no card, disable it(RST&CLK)
[    0.616267] mt7620-pci: probe of 10140000.pcie failed with error -1
[    0.642537] rt2880_gpio 10000600.gpio: registering 24 gpios
[    0.647998] rt2880_gpio 10000600.gpio: registering 24 irq handlers
[    0.654321] rt2880_gpio 10000638.gpio: registering 16 gpios
[    0.659745] rt2880_gpio 10000638.gpio: registering 16 irq handlers
[    0.666046] rt2880_gpio 10000688.gpio: registering 1 gpios
[    0.671385] rt2880_gpio 10000688.gpio: registering 1 irq handlers
[    0.682822] clocksource: Switched to clocksource systick
[    0.689173] NET: Registered protocol family 2
[    0.694441] TCP established hash table entries: 1024 (order: 0, 4096 bytes)
[    0.701163] TCP bind hash table entries: 1024 (order: 0, 4096 bytes)
[    0.707396] TCP: Hash tables configured (established 1024 bind 1024)
[    0.713675] UDP hash table entries: 256 (order: 0, 4096 bytes)
[    0.719300] UDP-Lite hash table entries: 256 (order: 0, 4096 bytes)
[    0.725737] NET: Registered protocol family 1
[    0.729932] PCI: CLS 0 bytes, default 32
[    0.733119] rt-timer 10000100.timer: maximum frequency is 1220Hz
[    0.739836] Crashlog allocated RAM at address 0x3f00000
[    0.746892] workingset: timestamp_bits=14 max_order=15 bucket_order=1
[    0.760460] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.766118] jffs2: version 2.2 (NAND) (SUMMARY) (LZMA) (RTIME) (CMODE_PRIORITY) (c) 2001-2006 Red Hat, Inc.
[    0.789004] io scheduler noop registered
[    0.792750] io scheduler deadline registered (default)
[    0.798733] Serial: 8250/16550 driver, 16 ports, IRQ sharing enabled
[    0.807961] console [ttyS0] disabled
[    0.811416] 10000c00.uartlite: ttyS0 at MMIO 0x10000c00 (irq = 20, base_baud = 2500000) is a Palmchip BK-3103
[    0.821102] console [ttyS0] enabled
[    0.828134] bootconsole [early0] disabled
[    0.845534] spi spi0.0: force spi mode3
[    0.858965] m25p80 spi0.0: w25q128 (16384 Kbytes)
[    0.863838] 4 fixed-partitions partitions found on MTD device spi0.0
[    0.870320] Creating 4 MTD partitions on "spi0.0":
[    0.875234] 0x000000000000-0x000000030000 : "u-boot"
[    0.881303] 0x000000030000-0x000000040000 : "u-boot-env"
[    0.887698] 0x000000040000-0x000000050000 : "factory"
[    0.893828] 0x000000050000-0x000001000000 : "firmware"
[    0.903392] 2 uimage-fw partitions found on MTD device firmware
[    0.909446] Creating 2 MTD partitions on "firmware":
[    0.914570] 0x000000000000-0x0000001adf2a : "kernel"
[    0.920619] 0x0000001adf2a-0x000000fb0000 : "rootfs"
[    0.926572] mtd: device 5 (rootfs) set to be root filesystem
[    0.934209] 1 squashfs-split partitions found on MTD device rootfs
[    0.940523] Creating 1 MTD partitions on "rootfs":
[    0.945479] 0x0000006e30d6-0x000000e020d6 : "rootfs_data"
[    0.952886] libphy: Fixed MDIO Bus: probed
[    0.966625] gsw: setting port4 to ephy mode
[    0.970946] mtk_soc_eth 10100000.ethernet eth0 (uninitialized): port 2 link up (100Mbps/Full duplex)
[    0.980568] mtk_soc_eth 10100000.ethernet: loaded mt7620 driver
[    0.987349] mtk_soc_eth 10100000.ethernet eth0: mediatek frame engine at 0xb0100000, irq 5
[    0.996372] rt2880_wdt 10000120.watchdog: Initialized
[    1.002861] NET: Registered protocol family 10
[    1.011754] Segment Routing with IPv6
[    1.015688] NET: Registered protocol family 17
[    1.020295] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[    1.033539] 8021q: 802.1Q VLAN Support v1.8
[    1.056562] VFS: Mounted root (squashfs filesystem) readonly on device 31:5.
[    1.070365] Freeing unused kernel memory: 1180K
[    1.075026] This architecture does not have kernel memory protection.
[    2.493830] init: Console is alive
[    2.497571] init: - watchdog -
[    2.593320] random: fast init done
[    5.149600] kmodloader: loading kernel modules from /etc/modules-boot.d/*
[    5.619369] usbcore: registered new interface driver usbfs
[    5.625160] usbcore: registered new interface driver hub
[    5.630693] usbcore: registered new device driver usb
[    5.642919] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    5.651535] ehci-platform: EHCI generic platform driver
[    5.667313] phy phy-usbphy.0: remote usb device wakeup disabled
[    5.673385] phy phy-usbphy.0: UTMI 16bit 30MHz
[    5.677936] ehci-platform 101c0000.ehci: EHCI Host Controller
[    5.683861] ehci-platform 101c0000.ehci: new USB bus registered, assigned bus number 1
[    5.692054] ehci-platform 101c0000.ehci: irq 26, io mem 0x101c0000
[    5.706916] ehci-platform 101c0000.ehci: USB 2.0 started, EHCI 1.00
[    5.714393] hub 1-0:1.0: USB hub found
[    5.718762] hub 1-0:1.0: 1 port detected
[    5.726655] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    5.735018] ohci-platform: OHCI generic platform driver
[    5.740736] ohci-platform 101c1000.ohci: Generic Platform OHCI controller
[    5.747745] ohci-platform 101c1000.ohci: new USB bus registered, assigned bus number 2
[    5.755914] ohci-platform 101c1000.ohci: irq 26, io mem 0x101c1000
[    5.789345] hub 2-0:1.0: USB hub found
[    5.793715] hub 2-0:1.0: 1 port detected
[    5.835651] kmodloader: done loading kernel modules from /etc/modules-boot.d/*
[    5.847302] init: - preinit -
[    6.804244] usb 1-1: new high-speed USB device number 2 using ehci-platform
[    7.067020] hub 1-1:1.0: USB hub found
[    7.072458] hub 1-1:1.0: 4 ports detected
[    7.632520] random: procd: uninitialized urandom read (4 bytes read)
[    7.764151] usb 1-1.3: new full-speed USB device number 3 using ehci-platform
[    8.165867] usb 1-1.3: new high-speed USB device number 4 using ehci-platform
[    8.786221] 8021q: adding VLAN 0 to HW filter on device eth0
[   11.457894] jffs2: error: (457) verify_xattr_ref: node CRC failed at 0x1929c0, read=0xffffffff, calc=0x7f1cdce2
[   11.468341] jffs2: error: (457) verify_xattr_ref: node CRC failed at 0x1929a4, read=0xffffffff, calc=0x7f1cdce2
[   11.479296] jffs2: notice: (457) jffs2_build_xattr_subsystem: complete building xattr subsystem, 6 of xdatum (2 unchecked, 4 orphan) and 18 of xref (3 dead, 3 orphan) found.
[   11.495325] jffs2: notice: (457) jffs2_get_inode_nodes: Node header CRC failed at 0x1923f8. {ffff,ffff,ffffffff,ffffffff}
[   11.509091] mount_root: overlay filesystem has not been fully initialized yet
[   11.516656] jffs2: error: (458) do_verify_xattr_datum: node CRC failed at 0x192974, read=0xffffffff, calc=0x9354f4
[   11.528022] jffs2: notice: (457) jffs2_get_inode_nodes: Node header CRC failed at 0x216338. {ffff,ffff,ffffffff,ffffffff}
[   11.541000] jffs2: notice: (457) jffs2_get_inode_nodes: Node header CRC failed at 0x216300. {ffff,ffff,ffffffff,ffffffff}
[   11.553626] jffs2: notice: (457) jffs2_get_inode_nodes: Node header CRC failed at 0x2161b8. {ffff,ffff,ffffffff,ffffffff}
[   11.565019] jffs2: notice: (457) jffs2_get_inode_nodes: Node header CRC failed at 0x216180. {ffff,ffff,ffffffff,ffffffff}
[   11.576345] jffs2: notice: (457) jffs2_get_inode_nodes: Node header CRC failed at 0x216040. {ffff,ffff,ffffffff,ffffffff}
[   11.587665] jffs2: notice: (457) jffs2_get_inode_nodes: Node header CRC failed at 0x21600c. {ffff,ffff,ffffffff,ffffffff}
[   11.599776] jffs2: notice: (457) jffs2_get_inode_nodes: Node header CRC failed at 0x192830. {ffff,ffff,ffffffff,ffffffff}
[   11.611098] jffs2: notice: (457) jffs2_get_inode_nodes: Node header CRC failed at 0x1927fc. {ffff,ffff,ffffffff,ffffffff}
[   11.622419] jffs2: notice: (457) jffs2_get_inode_nodes: Node header CRC failed at 0x192370. {ffff,ffff,ffffffff,ffffffff}
[   11.633765] jffs2: notice: (457) jffs2_get_inode_nodes: Node header CRC failed at 0x192100. {ffff,ffff,ffffffff,ffffffff}
[   11.655493] jffs2: notice: (458) jffs2_get_inode_nodes: Node header CRC failed at 0x192904. {ffff,ffff,ffffffff,ffffffff}
[   11.709128] jffs2: notice: (458) jffs2_get_inode_nodes: Node header CRC failed at 0x1923b0. {ffff,ffff,ffffffff,ffffffff}
[   11.720380] jffs2: warning: (458) jffs2_do_read_inode_internal: no data nodes found for ino #121
[   11.729357] jffs2: Returned error for crccheck of ino #121. Expect badness...
[   11.741583] mount_root: switching to jffs2 overlay
[   11.800559] overlayfs: upper fs does not support tmpfile.
[   11.810151] urandom-seed: Seed file not found (/etc/urandom.seed)
[   12.011288] jffs2: notice: (458) jffs2_get_inode_nodes: Node header CRC failed at 0x1926b8. {ffff,ffff,ffffffff,ffffffff}
[   12.047964] procd: - early -
[   12.051037] procd: - watchdog -
[   12.133635] jffs2: notice: (458) jffs2_get_inode_nodes: Node header CRC failed at 0x192574. {ffff,ffff,ffffffff,ffffffff}
[   12.304640] jffs2: notice: (458) jffs2_get_inode_nodes: Node header CRC failed at 0x192530. {ffff,ffff,ffffffff,ffffffff}
[   12.494433] jffs2: notice: (458) jffs2_get_inode_nodes: Node header CRC failed at 0x1924ec. {ffff,ffff,ffffffff,ffffffff}
[   12.614421] jffs2: notice: (458) jffs2_get_inode_nodes: Node header CRC failed at 0x1924a8. {ffff,ffff,ffffffff,ffffffff}
[   12.736195] jffs2: notice: (458) jffs2_get_inode_nodes: Node header CRC failed at 0x19242c. {ffff,ffff,ffffffff,ffffffff}
[   12.747436] jffs2: warning: (458) jffs2_do_read_inode_internal: no data nodes found for ino #122
[   12.756419] jffs2: Returned error for crccheck of ino #122. Expect badness...
[   12.986727] jffs2: notice: (458) jffs2_get_inode_nodes: Node header CRC failed at 0x192930. {ffff,ffff,ffffffff,ffffffff}
[   12.998164] procd: - watchdog -
[   13.001716] procd: - ubus -
[   13.274473] jffs2: notice: (458) jffs2_get_inode_nodes: Node header CRC failed at 0x1928c0. {ffff,ffff,ffffffff,ffffffff}
[   13.285716] jffs2: warning: (458) jffs2_do_read_inode_internal: no data nodes found for ino #123
[   13.294693] jffs2: notice: (458) jffs2_do_read_inode_internal: but it has children so we fake some modes for it
[   13.371085] random: jshn: uninitialized urandom read (4 bytes read)
[   13.377773] random: ubusd: uninitialized urandom read (4 bytes read)
[   13.598784] random: ubusd: uninitialized urandom read (4 bytes read)
[   13.607884] procd: - init -
[   13.974439] jffs2: notice: (458) jffs2_get_inode_nodes: Node header CRC failed at 0x21613c. {ffff,ffff,ffffffff,ffffffff}
[   14.330270] jffs2: notice: (458) jffs2_get_inode_nodes: Node header CRC failed at 0x2160f8. {ffff,ffff,ffffffff,ffffffff}
[   14.916410] jffs2: notice: (458) jffs2_get_inode_nodes: Node header CRC failed at 0x216078. {ffff,ffff,ffffffff,ffffffff}
[   14.927675] jffs2: warning: (458) jffs2_do_read_inode_internal: no data nodes found for ino #125
[   14.936668] jffs2: Returned error for crccheck of ino #125. Expect badness...
[   15.934288] jffs2: notice: (458) jffs2_get_inode_nodes: Node header CRC failed at 0x2162bc. {ffff,ffff,ffffffff,ffffffff}
[   16.411380] jffs2: notice: (458) jffs2_get_inode_nodes: Node header CRC failed at 0x216278. {ffff,ffff,ffffffff,ffffffff}
[   16.463119] kmodloader: loading kernel modules from /etc/modules.d/*
[   16.704208] jffs2: notice: (458) jffs2_get_inode_nodes: Node header CRC failed at 0x2161f4. {ffff,ffff,ffffffff,ffffffff}
[   16.715424] jffs2: warning: (458) jffs2_do_read_inode_internal: no data nodes found for ino #126
[   16.724414] jffs2: Returned error for crccheck of ino #126. Expect badness...
[   16.809255] NET: Registered protocol family 38
[   16.837119] zram: Added device: zram0
[   16.858682] NET: Registered protocol family 15
[   16.878029] Initializing XFRM netlink socket
[   16.937556] ip6_tables: (C) 2000-2006 Netfilter Core Team
[   16.969194] usbcore: registered new interface driver cdc_wdm
[   16.983715] urngd: jent-rng init failed, err: 2
[   16.990356] Loading modules backported from Linux version v5.4-rc8-0-gaf42d3466bdc
[   16.998156] Backport generated by backports.git v5.4-rc8-1-0-g368e8c51
[   17.009838] ip_tables: (C) 2000-2006 Netfilter Core Team
[   17.040810] nf_conntrack version 0.5.0 (2048 buckets, 8192 max)
[   17.178460] xt_time: kernel timezone is -0000
[   17.389235] PPP generic driver version 2.4.2
[   17.398894] NET: Registered protocol family 24
[   17.416527] qmi_wwan 1-1.3:1.4: cdc-wdm0: USB WDM device
[   17.445383] qmi_wwan 1-1.3:1.4 wwan0: register 'qmi_wwan' at usb-101c0000.ehci-1.3, WWAN/QMI device, c6:14:65:a8:22:11
[   17.456639] usbcore: registered new interface driver qmi_wwan
[   17.625279] rt2800_wmac 10180000.wmac: loaded eeprom from mtd device "factory"
[   17.632675] ieee80211 phy0: rt2x00_set_rt: Info - RT chipset 6352, rev 0500 detected
[   17.640617] ieee80211 phy0: rt2x00_set_rf: Info - RF chipset 7620 detected
[   17.648407] ieee80211 phy0: Selected rate control algorithm 'minstrel_ht'
[   17.704572] kmodloader: done loading kernel modules from /etc/modules.d/*
[   31.227728] zram0: detected capacity change from 0 to 62914560
[   31.245941] Adding 61436k swap on /dev/zram0.  Priority:-2 extents:1 across:61436k SS
[   46.946088] mtk_soc_eth 10100000.ethernet eth0: port 2 link down
[   48.571561] mtk_soc_eth 10100000.ethernet eth0: port 2 link up (100Mbps/Full duplex)
[   71.950118] mtk_soc_eth 10100000.ethernet eth0: port 2 link down
[   73.524392] mtk_soc_eth 10100000.ethernet eth0: port 2 link up (100Mbps/Full duplex)
[   97.061676] mtk_soc_eth 10100000.ethernet eth0: port 2 link down
[   98.821292] mtk_soc_eth 10100000.ethernet eth0: port 2 link up (100Mbps/Full duplex)
[  104.864984] 8021q: adding VLAN 0 to HW filter on device eth0
[  104.899462] br-lan: port 1(eth0.1) entered blocking state
[  104.905073] br-lan: port 1(eth0.1) entered disabled state
[  104.910959] device eth0.1 entered promiscuous mode
[  104.915905] device eth0 entered promiscuous mode
[  104.980193] br-lan: port 1(eth0.1) entered blocking state
[  104.985782] br-lan: port 1(eth0.1) entered forwarding state
[  104.991690] IPv6: ADDRCONF(NETDEV_UP): br-lan: link is not ready
[  105.894800] IPv6: ADDRCONF(NETDEV_CHANGE): br-lan: link becomes ready
[  111.804278] random: crng init done
[  111.807771] random: 6 urandom warning(s) missed due to ratelimiting
[  280.023446] jffs2: Erase at 0x0071e000 failed immediately: errno -22

I tested on the same device with official openwrt image, no such errors.

I tried running first boot after install, errors disappered, I changed few more files an got similar errors

[ 44.272450] jffs2: Erase at 0x0071e000 failed immediately: errno -22

It's a know issue, see https://bugs.openwrt.org/index.php?do=details&task_id=2837