X86/64 sysupgrade losing settings (F2FS)?

I'm running the 18.06 branch and my last upgrade yesterday caused me to lose my settings. First I thought it was because I had messed up my migration from the combined-ext4 to the combined-squashfs image earlier, but upgrading from an older combined-ext4 build to the very same (just using sysupgrade) yielded the same result, as did doing the same between combined-squashfs builds.

Once I load the backup again manually through LuCI, then reboot the router, the settings hold just fine. So I'm wondering what's going wrong? I see sysupgrade saying 'saving config files' or something during the process but upon reboot with the new firmware everything's been reset to default state...

Sysupgrade also says Image metadata not found consistently. Sysupgrade on non-x86 devices so far has worked fine for me (upgraded to the same build on ramips & ar71xx devices).

How do I find out what's wrong?

A few months ago I lost my configuration on my x86 device every reboot and found out that the overlayFS coundn't be created. I never figured out the cause of this, but in the end I wrote a fresh openwrt-x86-64-combined-squashfs.img to the mSATA disk using dd and the problem never occurred again.
Since you switched from ext4 to squashfs I recommend to do this, too. If the problem persists, look for filesystem related errors in dmesg.

Maybe I should try that. I just flashed the combined-squashfs image over the combined-ext4 one with sysupgrade -n (so not keeping settings) and then restored a backup, that seemed to work. Not sure what difference dd'ing the image would make compared with just using sysupgrade -n, but it won't hurt to try.

OK, so I took out the mSATA SSD, dd'ed the combined-squashfs image to it, put it back into the APU2 and ran sysupgrade. It lost its settings again. After that, I set up the configuration manually, thinking maybe there was something wrong with the configuration backup; unfortunately, just the same happens.

Seems the overlay is F2FS, but I'm not seeing any storage related error messages in dmesg:

# dmesg 
[    0.000000] Linux version 4.14.60 (stijn@okeanos) (gcc version 7.3.0 (OpenWrt GCC 7.3.0 r6910+14-323285ac00)) #0 SMP Sat Aug 4 15:13:08 2018
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz root=PARTUUID=5693b135-02 rootfstype=squashfs rootwait console=tty0 console=ttyS0,115200n8 noinitrd
[...]
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.000000] random: get_random_bytes called from 0xffffffff81cabb09 with crng_init=0
[    0.000000] setup_percpu: NR_CPUS:8 nr_cpumask_bits:8 nr_cpu_ids:4 nr_node_ids:1
[    0.000000] percpu: Embedded 42 pages/cpu @ffff880077c00000 s131864 r8192 d31976 u524288
[    0.000000] pcpu-alloc: s131864 r8192 d31976 u524288 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 0 1 2 3 
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 483640
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz root=PARTUUID=5693b135-02 rootfstype=squashfs rootwait console=tty0 console=ttyS0,115200n8 noinitrd
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes)
[    0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.000000] Calgary: detecting Calgary via BIOS EBDA area
[    0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[    0.000000] Memory: 1916352K/1965360K available (8200K kernel code, 508K rwdata, 1288K rodata, 1048K init, 408K bss, 49008K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	CONFIG_RCU_FANOUT set to non-default value of 32
[    0.000000] 	RCU restricting CPUs from NR_CPUS=8 to nr_cpu_ids=4.
[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
[    0.000000] NR_IRQS: 4352, nr_irqs: 1000, preallocated irqs: 16
[    0.000000] spurious 8259A interrupt: IRQ7.
[    0.000000] Console: colour dummy device 80x25
[    0.000000] console [tty0] enabled
[    0.000000] console [ttyS0] enabled
[    0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484873504 ns
[    0.000000] hpet clockevent registered
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.010000] tsc: Detected 998.153 MHz processor
[    0.010000] Calibrating delay loop (skipped), value calculated using timer frequency.. 1996.30 BogoMIPS (lpj=9981530)
[    0.020007] pid_max: default: 32768 minimum: 301
[    0.024669] ACPI: Core revision 20170728
[    0.047592] ACPI: 4 ACPI AML tables successfully acquired and loaded
[    0.050111] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes)
[    0.060044] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes)
[    0.067766] CPU: Physical Processor ID: 0
[    0.070008] CPU: Processor Core ID: 0
[    0.073729] mce: CPU supports 6 MCE banks
[    0.080020] LVT offset 1 assigned for vector 0xf9
[    0.084745] Last level iTLB entries: 4KB 512, 2MB 8, 4MB 4
[    0.090020] Last level dTLB entries: 4KB 512, 2MB 256, 4MB 128, 1GB 0
[    0.096481] Spectre V2 : Mitigation: Full AMD retpoline
[    0.100005] Spectre V2 : Spectre v2 mitigation: Filling RSB on context switch
[    0.107176] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl
[    0.110427] Freeing SMP alternatives memory: 24K
[    0.123712] smpboot: Max logical packages: 1
[    0.130711] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=0 pin2=0
[    0.240000] smpboot: CPU0: AMD GX-412TC SOC (family: 0x16, model: 0x30, stepping: 0x1)
[    0.240000] Performance Events: AMD PMU driver.
[    0.240008] ... version:                0
[    0.244024] ... bit width:              48
[    0.250005] ... generic registers:      4
[    0.254044] ... value mask:             0000ffffffffffff
[    0.260005] ... max period:             00007fffffffffff
[    0.265319] ... fixed-purpose events:   0
[    0.269339] ... event mask:             000000000000000f
[    0.270144] Hierarchical SRCU implementation.
[    0.280073] smp: Bringing up secondary CPUs ...
[    0.284962] x86: Booting SMP configuration:
[    0.289151] .... node  #0, CPUs:      #1 #2 #3
[    0.296358] smp: Brought up 1 node, 4 CPUs
[    0.304125] smpboot: Total of 4 processors activated (7985.22 BogoMIPS)
[    0.313204] reboot: PC Engines apu2 series board detected. Selecting PCI-method for reboots.
[    0.320167] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.330048] futex hash table entries: 1024 (order: 4, 65536 bytes)
[    0.340562] NET: Registered protocol family 16
[    0.345987] cpuidle: using governor ladder
[    0.352106] ACPI: bus type PCI registered
[    0.356129] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.360257] PCI: Using configuration type 1 for base access
[    0.365868] PCI: Using configuration type 1 for extended access
[    0.383931] ACPI: Added _OSI(Module Device)
[    0.388151] ACPI: Added _OSI(Processor Device)
[    0.390010] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.394721] ACPI: Added _OSI(Processor Aggregator Device)
[    0.400543] ACPI: Executed 1 blocks of module-level executable AML code
[    0.427541] ACPI: Interpreter enabled
[    0.430026] ACPI: (supports S0 S5)
[    0.433438] ACPI: Using IOAPIC for interrupt routing
[    0.438464] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.440498] ACPI: Enabled 7 GPEs in block 00 to 1F
[    0.465989] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.470049] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig Segments MSI]
[    0.477226] acpi PNP0A08:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI]
[    0.480225] acpi PNP0A08:00: host bridge window expanded to [io  0x0000-0x0cf7 window]; [io  0x03b0-0x03df window] ignored
[    0.490334] PCI host bridge to bus 0000:00
[    0.494491] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    0.500010] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.506846] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]
[    0.510009] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000dffff]
[    0.520008] pci_bus 0000:00: root bus resource [mem 0x7f000000-0xffffffff]
[    0.526922] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.530028] pci 0000:00:00.0: [1022:1566] type 00 class 0x060000
[    0.530530] pci 0000:00:02.0: [1022:156b] type 00 class 0x060000
[    0.530893] pci 0000:00:02.2: [1022:1439] type 01 class 0x060400
[    0.531038] pci 0000:00:02.2: enabling Extended Tags
[    0.540136] pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
[    0.540498] pci 0000:00:02.3: [1022:1439] type 01 class 0x060400
[    0.540641] pci 0000:00:02.3: enabling Extended Tags
[    0.545735] pci 0000:00:02.3: PME# supported from D0 D3hot D3cold
[    0.546091] pci 0000:00:02.4: [1022:1439] type 01 class 0x060400
[    0.546182] pci 0000:00:02.4: enabling Extended Tags
[    0.550133] pci 0000:00:02.4: PME# supported from D0 D3hot D3cold
[    0.550472] pci 0000:00:08.0: [1022:1537] type 00 class 0x108000
[    0.550505] pci 0000:00:08.0: reg 0x10: [mem 0xfeb00000-0xfeb1ffff 64bit pref]
[    0.550544] pci 0000:00:08.0: reg 0x18: [mem 0xfe900000-0xfe9fffff]
[    0.550557] pci 0000:00:08.0: reg 0x1c: [mem 0xfeb24000-0xfeb24fff]
[    0.550570] pci 0000:00:08.0: reg 0x20: [mem 0xfea00000-0xfeafffff]
[    0.550582] pci 0000:00:08.0: reg 0x24: [mem 0xfeb20000-0xfeb21fff]
[    0.550935] pci 0000:00:10.0: [1022:7814] type 00 class 0x0c0330
[    0.551007] pci 0000:00:10.0: reg 0x10: [mem 0xfeb22000-0xfeb23fff 64bit]
[    0.551175] pci 0000:00:10.0: PME# supported from D0 D3hot D3cold
[    0.551468] pci 0000:00:11.0: [1022:7800] type 00 class 0x01018f
[    0.551500] pci 0000:00:11.0: reg 0x10: [io  0x4010-0x4017]
[    0.551515] pci 0000:00:11.0: reg 0x14: [io  0x4020-0x4023]
[    0.551530] pci 0000:00:11.0: reg 0x18: [io  0x4018-0x401f]
[    0.551545] pci 0000:00:11.0: reg 0x1c: [io  0x4024-0x4027]
[    0.551559] pci 0000:00:11.0: reg 0x20: [io  0x4000-0x400f]
[    0.551575] pci 0000:00:11.0: reg 0x24: [mem 0xfeb25000-0xfeb253ff]
[    0.551639] pci 0000:00:11.0: set SATA to AHCI mode
[    0.556603] pci 0000:00:11.0: PME# supported from D3hot
[    0.556864] pci 0000:00:13.0: [1022:7808] type 00 class 0x0c0320
[    0.556896] pci 0000:00:13.0: reg 0x10: [mem 0xfeb25400-0xfeb254ff]
[    0.557033] pci 0000:00:13.0: supports D1 D2
[    0.557038] pci 0000:00:13.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.557286] pci 0000:00:14.0: [1022:780b] type 00 class 0x0c0500
[    0.557672] pci 0000:00:14.3: [1022:780e] type 00 class 0x060100
[    0.560102] pci 0000:00:14.7: [1022:7813] type 00 class 0x080501
[    0.560162] pci 0000:00:14.7: reg 0x10: [mem 0xfeb25500-0xfeb255ff 64bit]
[    0.560555] pci 0000:00:18.0: [1022:1580] type 00 class 0x060000
[    0.560881] pci 0000:00:18.1: [1022:1581] type 00 class 0x060000
[    0.561170] pci 0000:00:18.2: [1022:1582] type 00 class 0x060000
[    0.561436] pci 0000:00:18.3: [1022:1583] type 00 class 0x060000
[    0.561706] pci 0000:00:18.4: [1022:1584] type 00 class 0x060000
[    0.561967] pci 0000:00:18.5: [1022:1585] type 00 class 0x060000
[    0.562469] pci 0000:01:00.0: [8086:1539] type 00 class 0x020000
[    0.562521] pci 0000:01:00.0: reg 0x10: [mem 0xfe600000-0xfe61ffff]
[    0.562584] pci 0000:01:00.0: reg 0x18: [io  0x1000-0x101f]
[    0.562633] pci 0000:01:00.0: reg 0x1c: [mem 0xfe620000-0xfe623fff]
[    0.562918] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[    0.563071] pci 0000:00:02.2: PCI bridge to [bus 01]
[    0.568057] pci 0000:00:02.2:   bridge window [io  0x1000-0x1fff]
[    0.568065] pci 0000:00:02.2:   bridge window [mem 0xfe600000-0xfe6fffff]
[    0.568256] pci 0000:02:00.0: [8086:1539] type 00 class 0x020000
[    0.568334] pci 0000:02:00.0: reg 0x10: [mem 0xfe700000-0xfe71ffff]
[    0.568370] pci 0000:02:00.0: reg 0x18: [io  0x2000-0x201f]
[    0.568405] pci 0000:02:00.0: reg 0x1c: [mem 0xfe720000-0xfe723fff]
[    0.568593] pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
[    0.568797] pci 0000:00:02.3: PCI bridge to [bus 02]
[    0.570043] pci 0000:00:02.3:   bridge window [io  0x2000-0x2fff]
[    0.570051] pci 0000:00:02.3:   bridge window [mem 0xfe700000-0xfe7fffff]
[    0.570243] pci 0000:03:00.0: [8086:1539] type 00 class 0x020000
[    0.570319] pci 0000:03:00.0: reg 0x10: [mem 0xfe800000-0xfe81ffff]
[    0.570383] pci 0000:03:00.0: reg 0x18: [io  0x3000-0x301f]
[    0.570404] pci 0000:03:00.0: reg 0x1c: [mem 0xfe820000-0xfe823fff]
[    0.570659] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold
[    0.570838] pci 0000:00:02.4: PCI bridge to [bus 03]
[    0.575845] pci 0000:00:02.4:   bridge window [io  0x3000-0x3fff]
[    0.575866] pci 0000:00:02.4:   bridge window [mem 0xfe800000-0xfe8fffff]
[    0.575908] pci_bus 0000:00: on NUMA node 0
[    0.580595] ACPI: PCI Interrupt Link [INTA] (IRQs *3 5 7 10 11 12 15)
[    0.587275] ACPI: PCI Interrupt Link [INTB] (IRQs *3 5 7 10 11 12 15)
[    0.590243] ACPI: PCI Interrupt Link [INTC] (IRQs 3 *5 7 10 11 12 15)
[    0.600270] ACPI: PCI Interrupt Link [INTD] (IRQs 3 5 *7 10 11 12 15)
[    0.606945] ACPI: PCI Interrupt Link [INTE] (IRQs 3 5 7 10 *11 12 15)
[    0.610274] ACPI: PCI Interrupt Link [INTF] (IRQs 3 5 7 *10 11 12 15)
[    0.621101] SCSI subsystem initialized
[    0.625009] libata version 3.00 loaded.
[    0.625023] ACPI: bus type USB registered
[    0.629168] usbcore: registered new interface driver usbfs
[    0.630079] usbcore: registered new interface driver hub
[    0.640095] usbcore: registered new device driver usb
[    0.645488] PCI: Using ACPI for IRQ routing
[    0.650009] PCI: pci_cache_line_size set to 64 bytes
[    0.650156] e820: reserve RAM buffer [mem 0x0009f800-0x0009ffff]
[    0.650161] e820: reserve RAM buffer [mem 0x77fae000-0x77ffffff]
[    0.651112] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.656014] hpet0: 3 comparators, 32-bit 14.318180 MHz counter
[    0.662169] clocksource: Switched to clocksource hpet
[    0.667489] pnp: PnP ACPI init
[    0.669125] system 00:00: [mem 0xfec10002-0xfec11001] has been reserved
[    0.675801] system 00:00: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.675921] pnp 00:01: Plug and Play ACPI device, IDs PNP0b00 (active)
[    0.676107] pnp 00:02: Plug and Play ACPI device, IDs PNP0501 (active)
[    0.676584] pnp: PnP ACPI: found 3 devices
[    0.689931] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.698931] pci 0000:00:02.2: PCI bridge to [bus 01]
[    0.703925] pci 0000:00:02.2:   bridge window [io  0x1000-0x1fff]
[    0.710061] pci 0000:00:02.2:   bridge window [mem 0xfe600000-0xfe6fffff]
[    0.716880] pci 0000:00:02.3: PCI bridge to [bus 02]
[    0.721885] pci 0000:00:02.3:   bridge window [io  0x2000-0x2fff]
[    0.727987] pci 0000:00:02.3:   bridge window [mem 0xfe700000-0xfe7fffff]
[    0.734806] pci 0000:00:02.4: PCI bridge to [bus 03]
[    0.739807] pci 0000:00:02.4:   bridge window [io  0x3000-0x3fff]
[    0.745945] pci 0000:00:02.4:   bridge window [mem 0xfe800000-0xfe8fffff]
[    0.752810] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[    0.752816] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[    0.752822] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff]
[    0.752827] pci_bus 0000:00: resource 7 [mem 0x000c0000-0x000dffff]
[    0.752832] pci_bus 0000:00: resource 8 [mem 0x7f000000-0xffffffff]
[    0.752838] pci_bus 0000:01: resource 0 [io  0x1000-0x1fff]
[    0.752844] pci_bus 0000:01: resource 1 [mem 0xfe600000-0xfe6fffff]
[    0.752849] pci_bus 0000:02: resource 0 [io  0x2000-0x2fff]
[    0.752854] pci_bus 0000:02: resource 1 [mem 0xfe700000-0xfe7fffff]
[    0.752860] pci_bus 0000:03: resource 0 [io  0x3000-0x3fff]
[    0.752865] pci_bus 0000:03: resource 1 [mem 0xfe800000-0xfe8fffff]
[    0.753064] NET: Registered protocol family 2
[    0.758015] TCP established hash table entries: 16384 (order: 5, 131072 bytes)
[    0.765366] TCP bind hash table entries: 16384 (order: 6, 262144 bytes)
[    0.772196] TCP: Hash tables configured (established 16384 bind 16384)
[    0.778899] UDP hash table entries: 1024 (order: 3, 32768 bytes)
[    0.784978] UDP-Lite hash table entries: 1024 (order: 3, 32768 bytes)
[    0.791619] NET: Registered protocol family 1
[    0.797097] pci 0000:00:13.0: PME# does not work under D3, disabling it
[    0.803850] PCI: CLS 64 bytes, default 64
[    0.804078] Unpacking initramfs...
[    0.807845] Freeing initrd memory: 28K
[    0.812044] amd_uncore: AMD NB counters detected
[    0.816691] amd_uncore: AMD LLC counters detected
[    0.821797] LVT offset 0 assigned for vector 0x400
[    0.826712] perf: AMD IBS detected (0x000000ff)
[    0.834264] workingset: timestamp_bits=62 max_order=19 bucket_order=0
[    0.845491] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.853125] io scheduler noop registered
[    0.857062] io scheduler deadline registered (default)
[    0.862733] gpio_it87: no device
[    0.867425] hv_vmbus: registering driver hv_pci
[    0.872074] hv_vmbus: registering driver hyperv_fb
[    0.877202] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0
[    0.885673] ACPI: Power Button [PWRB]
[    0.889581] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1
[    0.897081] ACPI: Power Button [PWRF]
[    0.903336] Serial: 8250/16550 driver, 2 ports, IRQ sharing disabled
[    0.930616] 00:02: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    0.958988] serial8250: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[    0.967428] Non-volatile memory driver v1.3
[    0.976252] loop: module loaded
[    0.979549] Guest personality initialized and is inactive
[    0.985110] VMCI host device registered (name=vmci, major=10, minor=63)
[    0.991800] Initialized host personality
[    0.996109] VMware PVSCSI driver - version 1.0.7.0-k
[    1.001173] hv_vmbus: registering driver hv_storvsc
[    1.006238] ahci 0000:00:11.0: version 3.0
[    1.006855] ahci 0000:00:11.0: AHCI 0001.0300 32 slots 2 ports 6 Gbps 0x3 impl SATA mode
[    1.015031] ahci 0000:00:11.0: flags: 64bit ncq sntf ilck pm led clo pmp fbs pio slum part 
[    1.024595] scsi host0: ahci
[    1.027889] scsi host1: ahci
[    1.031116] ata1: SATA max UDMA/133 abar m1024@0xfeb25000 port 0xfeb25100 irq 19
[    1.038527] ata2: SATA max UDMA/133 abar m1024@0xfeb25000 port 0xfeb25180 irq 19
[    1.046694] VMware vmxnet3 virtual NIC driver - version 1.4.a.0-k-NAPI
[    1.053280] hv_vmbus: registering driver hv_netvsc
[    1.058081] Fusion MPT base driver 3.04.20
[    1.062194] Copyright (c) 1999-2008 LSI Corporation
[    1.067115] Fusion MPT SPI Host driver 3.04.20
[    1.071630] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    1.078175] ehci-pci: EHCI PCI platform driver
[    1.083005] ehci-pci 0000:00:13.0: EHCI Host Controller
[    1.088287] ehci-pci 0000:00:13.0: new USB bus registered, assigned bus number 1
[    1.095727] ehci-pci 0000:00:13.0: applying AMD SB700/SB800/Hudson-2/3 EHCI dummy qh workaround
[    1.104453] ehci-pci 0000:00:13.0: debug port 2
[    1.109112] ehci-pci 0000:00:13.0: irq 18, io mem 0xfeb25400
[    1.140049] ehci-pci 0000:00:13.0: USB 2.0 started, EHCI 1.00
[    1.146582] hub 1-0:1.0: USB hub found
[    1.150406] hub 1-0:1.0: 2 ports detected
[    1.155001] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    1.161288] ohci-pci: OHCI PCI platform driver
[    1.165798] ohci-platform: OHCI generic platform driver
[    1.171336] xhci_hcd 0000:00:10.0: xHCI Host Controller
[    1.176596] xhci_hcd 0000:00:10.0: new USB bus registered, assigned bus number 2
[    1.184368] xhci_hcd 0000:00:10.0: hcc params 0x014040c3 hci version 0x100 quirks 0x00000410
[    1.193820] hub 2-0:1.0: USB hub found
[    1.197620] hub 2-0:1.0: 2 ports detected
[    1.202201] xhci_hcd 0000:00:10.0: xHCI Host Controller
[    1.207446] xhci_hcd 0000:00:10.0: new USB bus registered, assigned bus number 3
[    1.214903] xhci_hcd 0000:00:10.0: Host supports USB 3.0  SuperSpeed
[    1.221408] usb usb3: We don't know the algorithms for LPM for this host, disabling LPM.
[    1.230168] hub 3-0:1.0: USB hub found
[    1.234041] hub 3-0:1.0: 2 ports detected
[    1.238805] usbcore: registered new interface driver usb-storage
[    1.244983] i8042: PNP: No PS/2 controller found.
[    1.249755] hv_vmbus: registering driver hyperv_keyboard
[    1.255270] rtc_cmos 00:01: RTC can wake from S4
[    1.260156] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[    1.266296] rtc_cmos 00:01: alarms up to one day, 114 bytes nvram, hpet irqs
[    1.274022] sdhci: Secure Digital Host Controller Interface driver
[    1.280225] sdhci: Copyright(c) Pierre Ossman
[    1.284662] sdhci-pci 0000:00:14.7: SDHCI controller found [1022:7813] (rev 1)
[    1.292686] mmc0: SDHCI controller on PCI [0000:00:14.7] using ADMA 64-bit
[    1.299870] hidraw: raw HID events driver (C) Jiri Kosina
[    1.305417] hv_vmbus: registering driver hid_hyperv
[    1.310449] usbcore: registered new interface driver usbhid
[    1.316032] usbhid: USB HID core driver
[    1.319886] hv_utils: Registering HyperV Utility Driver
[    1.325143] hv_vmbus: registering driver hv_util
[    1.329767] hv_vmbus: registering driver hv_balloon
[    1.335414] NET: Registered protocol family 10
[    1.340764] Segment Routing with IPv6
[    1.344514] NET: Registered protocol family 17
[    1.349033] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[    1.362012] 8021q: 802.1Q VLAN Support v1.8
[    1.366326] NET: Registered protocol family 40
[    1.371931] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    1.371954] microcode: CPU0: patch_level=0x07030105
[    1.371992] microcode: CPU1: patch_level=0x07030105
[    1.378151] microcode: CPU2: patch_level=0x07030105
[    1.378171] microcode: CPU3: patch_level=0x07030105
[    1.378223] microcode: Microcode Update Driver: v2.2.
[    1.378270] AVX version of gcm_enc/dec engaged.
[    1.378271] AES CTR mode by8 optimization enabled
[    1.381170] sched_clock: Marking stable (1380106465, 0)->(1505080630, -124974165)
[    1.383123] rtc_cmos 00:01: setting system clock to 2018-08-05 12:56:57 UTC (1533473817)
[    1.427883] ata2: SATA link down (SStatus 0 SControl 300)
[    1.433479] ata1.00: ATA-10: SATA SSD, S9FM02.5, max UDMA/133
[    1.433574] acpi_cpufreq: overriding BIOS provided _PSD data
[    1.444961] ata1.00: 31277232 sectors, multi 16: LBA48 NCQ (depth 31/32), AA
[    1.452393] ata1.00: configured for UDMA/133
[    1.457227] scsi 0:0:0:0: Direct-Access     ATA      SATA SSD         02.5 PQ: 0 ANSI: 5
[    1.466794] sd 0:0:0:0: [sda] 31277232 512-byte logical blocks: (16.0 GB/14.9 GiB)
[    1.474549] sd 0:0:0:0: [sda] Write Protect is off
[    1.479590] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    1.479678] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    1.490540]  sda: sda1 sda2
[    1.494554] sd 0:0:0:0: [sda] Attached SCSI disk
[    1.501958] VFS: Mounted root (squashfs filesystem) readonly on device 8:2.
[    1.513546] Freeing unused kernel memory: 1048K
[    1.520074] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    1.560098] Write protecting the kernel read-only data: 12288k
[    1.568817] Freeing unused kernel memory: 2024K
[    1.584813] Freeing unused kernel memory: 760K
[    1.730901] hub 1-1:1.0: USB hub found
[    1.735001] hub 1-1:1.0: 4 ports detected
[    1.896513] init: Console is alive
[    1.910049] tsc: Refined TSC clocksource calibration: 998.114 MHz
[    1.916462] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x1cc642e9cf1, max_idle_ns: 881590508309 ns
[    2.400116] kmodloader: loading kernel modules from /etc/modules-boot.d/*
[    2.482922] pps_core: LinuxPPS API ver. 1 registered
[    2.488060] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    2.498374] PTP clock support registered
[    2.503099] Button Hotplug driver version 0.4.1
[    2.509460] gpio-nct5104d: Found nct5104d at 0x2e chip id 0xc452
[    2.515789] gpio-nct5104d: platform_driver_register
[    2.521504] gpio-nct5104d: Device added
[    2.526159] ehci-platform: EHCI generic platform driver
[    2.532358] leds-apu2: load APU2/LED GPIO driver module
[    2.537977] leds-apu2: PCI Revision ID: 0x42
[    2.542598] leds-apu2: APU2 GPIO/LED driver module loaded
[    2.549376] sp5100_tco: SP5100/SB800 TCO WatchDog Timer Driver v0.05
[    2.556138] sp5100_tco: PCI Vendor ID: 0x1022, Device ID: 0x780b, Revision ID: 0x42
[    2.564274] sp5100_tco: Using 0xfeb00000 for watchdog MMIO address
[    2.570868] sp5100_tco: Last reboot was not triggered by watchdog.
[    2.577392] sp5100_tco: initialized (0xffffc9000006d000). heartbeat=60 sec (nowayout=0)
[    2.587353] sdhci-pltfm: SDHCI platform and OF driver helper
[    2.593464] kmodloader: done loading kernel modules from /etc/modules-boot.d/*
[    2.603488] init: - preinit -
[    2.945408] clocksource: Switched to clocksource tsc
[    3.077303] random: jshn: uninitialized urandom read (4 bytes read)
[    3.164676] random: jshn: uninitialized urandom read (4 bytes read)
[    3.194649] random: jshn: uninitialized urandom read (4 bytes read)
[    6.301966] urandom_read: 3 callbacks suppressed
[    6.301971] random: jshn: uninitialized urandom read (4 bytes read)
[    6.564037] F2FS-fs (loop0): Mounted with checkpoint version = 6786c005
[    6.571856] mount_root: switching to f2fs overlay
[    6.677159] EXT4-fs (sda1): mounted filesystem without journal. Opts: (null)
[    6.688211] urandom-seed: Seeding with /etc/urandom.seed
[    6.796501] procd: - early -
[    7.464627] procd: - watchdog -
[    7.468008] procd: - ubus -
[    7.526265] random: ubusd: uninitialized urandom read (4 bytes read)
[    7.533805] random: ubusd: uninitialized urandom read (4 bytes read)
[    7.540630] random: ubusd: uninitialized urandom read (4 bytes read)
[    7.547612] procd: - init -
[    7.742560] kmodloader: loading kernel modules from /etc/modules.d/*
[    7.758445] ccp 0000:00:08.0: BAR 0: can't reserve [mem 0xfeb00000-0xfeb1ffff 64bit pref]
[    7.766931] ccp 0000:00:08.0: pcim_iomap_regions failed (-16)
[    7.772883] ccp 0000:00:08.0: initialization failed
[    7.777858] ccp: probe of 0000:00:08.0 failed with error -16
[    8.371281] tun: Universal TUN/TAP device driver, 1.6
[    9.202781] e1000: Intel(R) PRO/1000 Network Driver - version 7.3.21-k8-NAPI
[    9.209866] e1000: Copyright (c) 1999-2006 Intel Corporation.
[    9.382779] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    9.389775] igb: Copyright (c) 2007-2014 Intel Corporation.
[    9.626874] pps pps0: new PPS source ptp0
[    9.630974] igb 0000:01:00.0: added PHC on eth0
[    9.635538] igb 0000:01:00.0: Intel(R) Gigabit Ethernet Network Connection
[    9.642594] igb 0000:01:00.0: eth0: (PCIe:2.5Gb/s:Width x1) 00:0d:b9:41:45:60
[    9.650329] igb 0000:01:00.0: eth0: PBA No: FFFFFF-0FF
[    9.655826] igb 0000:01:00.0: Using MSI-X interrupts. 2 rx queue(s), 2 tx queue(s)
[    9.894838] pps pps1: new PPS source ptp1
[    9.898898] igb 0000:02:00.0: added PHC on eth1
[    9.903494] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
[    9.910481] igb 0000:02:00.0: eth1: (PCIe:2.5Gb/s:Width x1) 00:0d:b9:41:45:61
[    9.917777] igb 0000:02:00.0: eth1: PBA No: FFFFFF-0FF
[    9.923319] igb 0000:02:00.0: Using MSI-X interrupts. 2 rx queue(s), 2 tx queue(s)
[   10.162101] pps pps2: new PPS source ptp2
[   10.166146] igb 0000:03:00.0: added PHC on eth2
[   10.170762] igb 0000:03:00.0: Intel(R) Gigabit Ethernet Network Connection
[   10.177694] igb 0000:03:00.0: eth2: (PCIe:2.5Gb/s:Width x1) 00:0d:b9:41:45:62
[   10.185280] igb 0000:03:00.0: eth2: PBA No: FFFFFF-0FF
[   10.190629] igb 0000:03:00.0: Using MSI-X interrupts. 2 rx queue(s), 2 tx queue(s)
[   10.461024] ip6_tables: (C) 2000-2006 Netfilter Core Team
[   11.720932] Netfilter messages via NETLINK v0.30.
[   11.801580] ip_set: protocol 6
[   15.200778] i2c /dev entries driver
[   15.370850] piix4_smbus 0000:00:14.0: SMBus base address index region 0xcd6 already in use!
[   15.379235] piix4_smbus: probe of 0000:00:14.0 failed with error -16
[   17.300747] u32 classifier
[   17.303489]     input device check on
[   17.307163]     Actions configured
[   17.570760] Mirror/redirect action on
[   17.975659] nf_conntrack version 0.5.0 (16384 buckets, 65536 max)
[   21.387579] arp_tables: arp_tables: (C) 2002 David S. Miller
[   21.570900] Bridge firewalling registered
[   21.691084] Ebtables v2.0 registered
[   21.696996] ip_tables: (C) 2000-2006 Netfilter Core Team
[   22.318398] wireguard: WireGuard 0.0.20180718 loaded. See www.wireguard.com for information.
[   22.327356] wireguard: Copyright (C) 2015-2018 Jason A. Donenfeld <Jason@zx2c4.com>. All Rights Reserved.
[   22.355622] xt_time: kernel timezone is -0000
[   22.481431] usbcore: registered new interface driver cdc_ether
[   22.933991] PPP generic driver version 2.4.2
[   22.939396] NET: Registered protocol family 24
[   22.945424] usbcore: registered new interface driver rndis_host
[   23.150298] kmodloader: 1 module could not be probed
[   23.155354] kmodloader: - ccp-crypto - 0
[   27.587907] IPv6: ADDRCONF(NETDEV_UP): lo: link is not ready
[   27.630365] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[   27.637541] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[   27.745724] 8021q: adding VLAN 0 to HW filter on device eth1
[   27.753196] br-lan: port 1(eth1) entered blocking state
[   27.758593] br-lan: port 1(eth1) entered disabled state
[   27.764293] device eth1 entered promiscuous mode
[   27.774152] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready
[   27.835756] 8021q: adding VLAN 0 to HW filter on device eth2
[   27.842926] br-lan: port 2(eth2) entered blocking state
[   27.848510] br-lan: port 2(eth2) entered disabled state
[   27.854591] device eth2 entered promiscuous mode
[   27.917379] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[   27.923561] 8021q: adding VLAN 0 to HW filter on device eth0
[   30.770664] igb 0000:03:00.0 eth2: igb: eth2 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   30.790679] igb 0000:02:00.0 eth1: igb: eth1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   30.900437] br-lan: port 2(eth2) entered blocking state
[   30.900689] igb 0000:01:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
[   30.915404] br-lan: port 2(eth2) entered forwarding state
[   30.921475] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   30.930326] br-lan: port 1(eth1) entered blocking state
[   30.935770] br-lan: port 1(eth1) entered forwarding state
[   33.111257] random: fast init done
[   36.691776] pppoe-wan: renamed from ppp0
[   93.616225] random: crng init done

And the partitions and file systems:

Filesystem           Type       1K-blocks      Used Available Use% Mounted on
/dev/root            squashfs        7424      7424         0 100% /rom
tmpfs                tmpfs         960116       200    959916   0% /tmp
/dev/loop0           f2fs          246656     15644    161380   9% /overlay
overlayfs:/overlay   overlay       246656     15644    161380   9% /
/dev/sda1            ext4            8048      3200      4688  41% /boot
/dev/sda1            ext4            8048      3200      4688  41% /boot
tmpfs                tmpfs            512         0       512   0% /dev```

the ext4 image could suffer from this:

but then the squashfs+f2fs should not have the same issues.

There's no metadata appended to any x86 images yet. So this message can it ignored (for now).

1 Like

Yeah I thought the ext4 issue might be playing here as well, but I am on 4.14.60, which has a fix integrated. And the overlay is F2FS.

Is there a way I can debug F2FS? Nothing sticks out from dmesg, just grepped logread but nothing about F2FS there.

Bump. I'm still running into this, unfortunately. I was told sysupgrade saves the backup tarball to /boot and works from there, I have integrated some x86/64 patches to load microcode during boot, but all they do is push microcode, they don't strip anything from the boot scripts.

If anyone has some pointers on how to investigate, I'd be happy to. Thanks!

To be honest, I don't understand the issue you're having.

:open_mouth:

I wasn't aware that you could sysupgrade an x86...I don't even see sysupgrade files in the x86 folders on the downloads site.

I've always understood to upgrade an x86:

  • Backup configs
  • redo drive in the same manner as first install
  • reboot
  • upload configs

Eh? Sure you can :smile:. You just flash the default images with sysupgrade (notice how there's no factory or sysupgrade images for x86 e.g.).

1 Like

How do you sysupgrade x86 files, if there is no sysupgrade file available after upgrade?

Did you read this thread here: Upgrading an x86 router vm [solved] - #2 by lleachii

Got it. Thank you.