Upgrade path with AUC from 23.05.5 > 24.10.0

Installing and Using OpenWrt
1

I'm trying to figure out the best upgrade path for my current installation on my RaspberryPi 4 which is seeing a bunch of ASU errors. Currently, 23.05.5 is installed, and was last updated using ASU.

I know that ASU has been replaced by OWUT, but the latter isn't available on 23.05.5, so I was hoping that I could get to 24.10.0 with ASU, and then install OWUT once there. I'm also aware of the security issue that was found with with sysupgrade server (and quickly resolved)... am I dealing with an issue that stems from the changes made there?

FWIW, I totally understand that at least one package appears to have been dropped (shadowsocks), so if I have to manually remove one or two packages in that context, I'd understand. However, it seems that there are deeper errors here... most of them seem to be related to LuCI -- do I just remove the offending packages and then reinstall LuCI once the upgrade is complete? Or is there something else I should do? (or just start from scratch)?

Here's an example of the ASU error (repeated for multiple packages):

 * opkg_install_cmd: Cannot install package liblucihttp.
 * opkg_install_pkg: Checksum or size mismatch for package liblucihttp-ucode. Either the opkg or the package index are corrupt. Try 'opkg update'.

And of course, the full output log:

23.05.5 > 24.10.0 Request Data 
{
    "url": "https://sysupgrade.openwrt.org",
    "revision": "r24106-10cc5fcd00",
    "advanced_mode": "1",
    "sha256_unsigned": "",
    "branch": "23.05",
    "efi": null,
    "request_hash": "b981411bac5454485228351827ef2e47c1d9821783f2da6c859ef6766f656dcb",
    "profile": "raspberrypi,4-model-b",
    "target": "bcm27xx/bcm2711",
    "version": "24.10.0",
    "packages": [
        "attendedsysupgrade-common",
        "auc",
        "avahi-dbus-daemon",
        "base-files",
        "bcm27xx-gpu-fw",
        "bcm27xx-userland",
        "bind-host",
        "brcmfmac-nvram-43455-sdio",
        "busybox",
        "ca-bundle",
        "cgi-io",
        "curl",
        "cypress-firmware-43455-sdio",
        "ddns-scripts",
        "dnsmasq",
        "dropbear",
        "e2fsprogs",
        "etherwake",
        "firewall4",
        "fstools",
        "fwtool",
        "getrandom",
        "iperf3",
        "iwinfo",
        "jansson",
        "jshn",
        "jsonfilter",
        "kernel",
        "kmod-brcmfmac",
        "kmod-crypto-acompress",
        "kmod-crypto-crc32c",
        "kmod-crypto-hash",
        "kmod-fs-vfat",
        "kmod-hid",
        "kmod-hid-generic",
        "kmod-input-core",
        "kmod-input-evdev",
        "kmod-lib-crc-ccitt",
        "kmod-lib-crc32c",
        "kmod-lib-lzo",
        "kmod-nf-conntrack",
        "kmod-nf-conntrack6",
        "kmod-nf-flow",
        "kmod-nf-log",
        "kmod-nf-log6",
        "kmod-nf-nat",
        "kmod-nf-reject",
        "kmod-nf-reject6",
        "kmod-nfnetlink",
        "kmod-nft-core",
        "kmod-nft-fib",
        "kmod-nft-nat",
        "kmod-nft-offload",
        "kmod-nls-base",
        "kmod-nls-cp437",
        "kmod-nls-iso8859-1",
        "kmod-nls-utf8",
        "kmod-ppp",
        "kmod-pppoe",
        "kmod-pppox",
        "kmod-r8169",
        "kmod-slhc",
        "kmod-sound-arm-bcm2835",
        "kmod-sound-core",
        "kmod-usb-core",
        "kmod-usb-hid",
        "kmod-usb-net-lan78xx",
        "kmod-wireguard",
        "libblkid",
        "libblobmsg-json",
        "libc",
        "libcomerr",
        "libext2fs",
        "libf2fs",
        "libiwinfo",
        "libiwinfo-data",
        "libjson-c",
        "libjson-script",
        "liblucihttp",
        "liblucihttp-ucode",
        "libmbedtls",
        "libmnl",
        "libnftnl",
        "libnl-tiny",
        "libsmartcols",
        "libss",
        "libubox",
        "libubus",
        "libuci",
        "libuclient",
        "libucode",
        "libustream-mbedtls",
        "libuuid",
        "logd",
        "luci",
        "luci-app-attendedsysupgrade",
        "luci-app-ddns",
        "luci-app-firewall",
        "luci-app-nut",
        "luci-app-openvpn",
        "luci-app-opkg",
        "luci-app-shadowsocks-libev",
        "luci-app-wol",
        "luci-base",
        "luci-light",
        "luci-mod-admin-full",
        "luci-mod-network",
        "luci-mod-status",
        "luci-mod-system",
        "luci-proto-ipv6",
        "luci-proto-ppp",
        "luci-proto-wireguard",
        "luci-ssl",
        "luci-theme-bootstrap",
        "mkf2fs",
        "mtd",
        "netifd",
        "nftables-json",
        "nut",
        "nut-common",
        "nut-driver-usbhid-ups",
        "nut-server",
        "nut-upsc",
        "nut-upscmd",
        "nut-upslog",
        "nut-upsmon",
        "nut-web-cgi",
        "odhcp6c",
        "odhcpd-ipv6only",
        "openvpn-openssl",
        "openwrt-keyring",
        "opkg",
        "partx-utils",
        "ppp",
        "ppp-mod-pppoe",
        "procd",
        "procd-seccomp",
        "procd-ujail",
        "px5g-mbedtls",
        "qrencode",
        "rpcd",
        "rpcd-mod-file",
        "rpcd-mod-iwinfo",
        "rpcd-mod-luci",
        "rpcd-mod-rrdns",
        "rpcd-mod-ucode",
        "shadowsocks-libev-ss-server",
        "sslh",
        "stunnel",
        "ubox",
        "ubus",
        "ubusd",
        "uci",
        "uclient-fetch",
        "ucode",
        "ucode-mod-fs",
        "ucode-mod-html",
        "ucode-mod-math",
        "ucode-mod-ubus",
        "ucode-mod-uci",
        "uhttpd",
        "uhttpd-mod-ubus",
        "urandom-seed",
        "usign",
        "wireguard-tools",
        "wpad-basic-mbedtls"
    ],
    "diff_packages": true,
    "filesystem": "ext4",
    "client": "luci/git-23.339.51123-138595a"
}
23.05.5 > 24.10.0 stderr 
Generate local signing keys...
Generate local certificate...
Package list missing or not up-to-date, generating it.

Building package index...
Downloading http://downloads.openwrt.org/releases/24.10.0/targets/bcm27xx/bcm2711/packages/Packages.gz
Updated list of available packages in /builder/build_dir/target-aarch64_cortex-a72_musl/root-bcm27xx/../../../../builder/dl/openwrt_core
Downloading http://downloads.openwrt.org/releases/24.10.0/targets/bcm27xx/bcm2711/packages/Packages.sig
Signature check passed.
Downloading http://downloads.openwrt.org/releases/24.10.0/packages/aarch64_cortex-a72/base/Packages.gz
Updated list of available packages in /builder/build_dir/target-aarch64_cortex-a72_musl/root-bcm27xx/../../../../builder/dl/openwrt_base
Downloading http://downloads.openwrt.org/releases/24.10.0/packages/aarch64_cortex-a72/base/Packages.sig
Signature check passed.
Downloading http://downloads.openwrt.org/releases/24.10.0/targets/bcm27xx/bcm2711/kmods/6.6.73-1-2577896cea679d46fe670142cc9703c1/Packages.gz
Updated list of available packages in /builder/build_dir/target-aarch64_cortex-a72_musl/root-bcm27xx/../../../../builder/dl/openwrt_kmods
Downloading http://downloads.openwrt.org/releases/24.10.0/targets/bcm27xx/bcm2711/kmods/6.6.73-1-2577896cea679d46fe670142cc9703c1/Packages.sig
Signature check passed.
Downloading http://downloads.openwrt.org/releases/24.10.0/packages/aarch64_cortex-a72/luci/Packages.gz
Updated list of available packages in /builder/build_dir/target-aarch64_cortex-a72_musl/root-bcm27xx/../../../../builder/dl/openwrt_luci
Downloading http://downloads.openwrt.org/releases/24.10.0/packages/aarch64_cortex-a72/luci/Packages.sig
Signature check passed.
Downloading http://downloads.openwrt.org/releases/24.10.0/packages/aarch64_cortex-a72/packages/Packages.gz
Updated list of available packages in /builder/build_dir/target-aarch64_cortex-a72_musl/root-bcm27xx/../../../../builder/dl/openwrt_packages
Downloading http://downloads.openwrt.org/releases/24.10.0/packages/aarch64_cortex-a72/packages/Packages.sig
Signature check passed.
Downloading http://downloads.openwrt.org/releases/24.10.0/packages/aarch64_cortex-a72/routing/Packages.gz
Updated list of available packages in /builder/build_dir/target-aarch64_cortex-a72_musl/root-bcm27xx/../../../../builder/dl/openwrt_routing
Downloading http://downloads.openwrt.org/releases/24.10.0/packages/aarch64_cortex-a72/routing/Packages.sig
Signature check passed.
Downloading http://downloads.openwrt.org/releases/24.10.0/packages/aarch64_cortex-a72/telephony/Packages.gz
Updated list of available packages in /builder/build_dir/target-aarch64_cortex-a72_musl/root-bcm27xx/../../../../builder/dl/openwrt_telephony
Downloading http://downloads.openwrt.org/releases/24.10.0/packages/aarch64_cortex-a72/telephony/Packages.sig
Signature check passed.
Downloading file:packages/Packages
Updated list of available packages in /builder/build_dir/target-aarch64_cortex-a72_musl/root-bcm27xx/../../../../builder/dl/imagebuilder
Downloading file:packages/Packages.sig
Signature check passed.
Collected errors:
 * opkg_install_pkg: Checksum or size mismatch for package liblucihttp0. Either the opkg or the package index are corrupt. Try 'opkg update'.
 * opkg_install_cmd: Cannot install package liblucihttp.
 * opkg_install_pkg: Checksum or size mismatch for package liblucihttp-ucode. Either the opkg or the package index are corrupt. Try 'opkg update'.
 * opkg_install_cmd: Cannot install package liblucihttp-ucode.
 * opkg_install_pkg: Checksum or size mismatch for package rpcd-mod-luci. Either the opkg or the package index are corrupt. Try 'opkg update'.
 * opkg_install_cmd: Cannot install package luci.
 * opkg_install_pkg: Checksum or size mismatch for package liblucihttp0. Either the opkg or the package index are corrupt. Try 'opkg update'.
 * opkg_install_cmd: Cannot install package luci-app-openvpn.
 * opkg_install_cmd: Cannot install package luci-app-shadowsocks-libev.
 * opkg_install_pkg: Checksum or size mismatch for package rpcd-mod-luci. Either the opkg or the package index are corrupt. Try 'opkg update'.
 * opkg_install_cmd: Cannot install package rpcd-mod-luci.
 * opkg_install_pkg: Checksum or size mismatch for package rpcd-mod-rrdns. Either the opkg or the package index are corrupt. Try 'opkg update'.
 * opkg_install_cmd: Cannot install package rpcd-mod-rrdns.
 * opkg_install_cmd: Cannot install package shadowsocks-libev-ss-server.
 * opkg_install_pkg: Checksum or size mismatch for package ucode-mod-html. Either the opkg or the package index are corrupt. Try 'opkg update'.
 * opkg_install_cmd: Cannot install package ucode-mod-html.
make[2]: *** [Makefile:234: package_install] Error 255
make[1]: *** [Makefile:171: _call_manifest] Error 2
make: *** [Makefile:349: manifest] Error 2

Interestingly, I can't even generate a new 23.05.5 image without it throwing errors. The errors are largely similar, but a few differences.

23.05.5 > 23.05.5 Request Data 
{
    "url": "https://sysupgrade.openwrt.org",
    "revision": "r24106-10cc5fcd00",
    "advanced_mode": "1",
    "sha256_unsigned": "",
    "branch": "23.05",
    "efi": null,
    "request_hash": "6b0e9931cacd07a0d7d7623b6ebad4d69101779043ae592850651475569b2558",
    "profile": "raspberrypi,4-model-b",
    "target": "bcm27xx/bcm2711",
    "version": "23.05.5",
    "packages": [
        "attendedsysupgrade-common",
        "auc",
        "avahi-dbus-daemon",
        "base-files",
        "bcm27xx-gpu-fw",
        "bcm27xx-userland",
        "bind-host",
        "brcmfmac-nvram-43455-sdio",
        "busybox",
        "ca-bundle",
        "cgi-io",
        "curl",
        "cypress-firmware-43455-sdio",
        "ddns-scripts",
        "dnsmasq",
        "dropbear",
        "e2fsprogs",
        "etherwake",
        "firewall4",
        "fstools",
        "fwtool",
        "getrandom",
        "iperf3",
        "iwinfo",
        "jansson",
        "jshn",
        "jsonfilter",
        "kernel",
        "kmod-brcmfmac",
        "kmod-crypto-acompress",
        "kmod-crypto-crc32c",
        "kmod-crypto-hash",
        "kmod-fs-vfat",
        "kmod-hid",
        "kmod-hid-generic",
        "kmod-input-core",
        "kmod-input-evdev",
        "kmod-lib-crc-ccitt",
        "kmod-lib-crc32c",
        "kmod-lib-lzo",
        "kmod-nf-conntrack",
        "kmod-nf-conntrack6",
        "kmod-nf-flow",
        "kmod-nf-log",
        "kmod-nf-log6",
        "kmod-nf-nat",
        "kmod-nf-reject",
        "kmod-nf-reject6",
        "kmod-nfnetlink",
        "kmod-nft-core",
        "kmod-nft-fib",
        "kmod-nft-nat",
        "kmod-nft-offload",
        "kmod-nls-base",
        "kmod-nls-cp437",
        "kmod-nls-iso8859-1",
        "kmod-nls-utf8",
        "kmod-ppp",
        "kmod-pppoe",
        "kmod-pppox",
        "kmod-r8169",
        "kmod-slhc",
        "kmod-sound-arm-bcm2835",
        "kmod-sound-core",
        "kmod-usb-core",
        "kmod-usb-hid",
        "kmod-usb-net-lan78xx",
        "kmod-wireguard",
        "libblkid",
        "libblobmsg-json",
        "libc",
        "libcomerr",
        "libext2fs",
        "libf2fs",
        "libiwinfo",
        "libiwinfo-data",
        "libjson-c",
        "libjson-script",
        "liblucihttp",
        "liblucihttp-ucode",
        "libmbedtls",
        "libmnl",
        "libnftnl",
        "libnl-tiny",
        "libsmartcols",
        "libss",
        "libubox",
        "libubus",
        "libuci",
        "libuclient",
        "libucode",
        "libustream-mbedtls",
        "libuuid",
        "logd",
        "luci",
        "luci-app-attendedsysupgrade",
        "luci-app-ddns",
        "luci-app-firewall",
        "luci-app-nut",
        "luci-app-openvpn",
        "luci-app-opkg",
        "luci-app-shadowsocks-libev",
        "luci-app-wol",
        "luci-base",
        "luci-light",
        "luci-mod-admin-full",
        "luci-mod-network",
        "luci-mod-status",
        "luci-mod-system",
        "luci-proto-ipv6",
        "luci-proto-ppp",
        "luci-proto-wireguard",
        "luci-ssl",
        "luci-theme-bootstrap",
        "mkf2fs",
        "mtd",
        "netifd",
        "nftables-json",
        "nut",
        "nut-common",
        "nut-driver-usbhid-ups",
        "nut-server",
        "nut-upsc",
        "nut-upscmd",
        "nut-upslog",
        "nut-upsmon",
        "nut-web-cgi",
        "odhcp6c",
        "odhcpd-ipv6only",
        "openvpn-openssl",
        "openwrt-keyring",
        "opkg",
        "partx-utils",
        "ppp",
        "ppp-mod-pppoe",
        "procd",
        "procd-seccomp",
        "procd-ujail",
        "px5g-mbedtls",
        "qrencode",
        "rpcd",
        "rpcd-mod-file",
        "rpcd-mod-iwinfo",
        "rpcd-mod-luci",
        "rpcd-mod-rrdns",
        "rpcd-mod-ucode",
        "shadowsocks-libev-ss-server",
        "sslh",
        "stunnel",
        "ubox",
        "ubus",
        "ubusd",
        "uci",
        "uclient-fetch",
        "ucode",
        "ucode-mod-fs",
        "ucode-mod-html",
        "ucode-mod-math",
        "ucode-mod-ubus",
        "ucode-mod-uci",
        "uhttpd",
        "uhttpd-mod-ubus",
        "urandom-seed",
        "usign",
        "wireguard-tools",
        "wpad-basic-mbedtls"
    ],
    "diff_packages": true,
    "filesystem": "ext4",
    "client": "luci/git-23.339.51123-138595a"
}
23.05.5 > 23.05.5 stderr 
Generate local signing keys...
Generate local certificate...
Package list missing or not up-to-date, generating it.

Building package index...
Downloading http://downloads.openwrt.org/releases/23.05.5/targets/bcm27xx/bcm2711/packages/Packages.gz
Updated list of available packages in /builder/build_dir/target-aarch64_cortex-a72_musl/root-bcm27xx/../../../../builder/dl/openwrt_core
Downloading http://downloads.openwrt.org/releases/23.05.5/targets/bcm27xx/bcm2711/packages/Packages.sig
Signature check passed.
Downloading http://downloads.openwrt.org/releases/23.05.5/packages/aarch64_cortex-a72/base/Packages.gz
Updated list of available packages in /builder/build_dir/target-aarch64_cortex-a72_musl/root-bcm27xx/../../../../builder/dl/openwrt_base
Downloading http://downloads.openwrt.org/releases/23.05.5/packages/aarch64_cortex-a72/base/Packages.sig
Signature check passed.
Downloading http://downloads.openwrt.org/releases/23.05.5/packages/aarch64_cortex-a72/luci/Packages.gz
Updated list of available packages in /builder/build_dir/target-aarch64_cortex-a72_musl/root-bcm27xx/../../../../builder/dl/openwrt_luci
Downloading http://downloads.openwrt.org/releases/23.05.5/packages/aarch64_cortex-a72/luci/Packages.sig
Signature check passed.
Downloading http://downloads.openwrt.org/releases/23.05.5/packages/aarch64_cortex-a72/packages/Packages.gz
Updated list of available packages in /builder/build_dir/target-aarch64_cortex-a72_musl/root-bcm27xx/../../../../builder/dl/openwrt_packages
Downloading http://downloads.openwrt.org/releases/23.05.5/packages/aarch64_cortex-a72/packages/Packages.sig
Signature check passed.
Downloading http://downloads.openwrt.org/releases/23.05.5/packages/aarch64_cortex-a72/routing/Packages.gz
Updated list of available packages in /builder/build_dir/target-aarch64_cortex-a72_musl/root-bcm27xx/../../../../builder/dl/openwrt_routing
Downloading http://downloads.openwrt.org/releases/23.05.5/packages/aarch64_cortex-a72/routing/Packages.sig
Signature check passed.
Downloading http://downloads.openwrt.org/releases/23.05.5/packages/aarch64_cortex-a72/telephony/Packages.gz
Updated list of available packages in /builder/build_dir/target-aarch64_cortex-a72_musl/root-bcm27xx/../../../../builder/dl/openwrt_telephony
Downloading http://downloads.openwrt.org/releases/23.05.5/packages/aarch64_cortex-a72/telephony/Packages.sig
Signature check passed.
Downloading file:packages/Packages
Updated list of available packages in /builder/build_dir/target-aarch64_cortex-a72_musl/root-bcm27xx/../../../../builder/dl/imagebuilder
Downloading file:packages/Packages.sig
Signature check passed.
Collected errors:
 * opkg_install_pkg: Checksum or size mismatch for package liblucihttp0. Either the opkg or the package index are corrupt. Try 'opkg update'.
 * opkg_install_cmd: Cannot install package liblucihttp.
 * opkg_install_pkg: Checksum or size mismatch for package liblucihttp-ucode. Either the opkg or the package index are corrupt. Try 'opkg update'.
 * opkg_install_cmd: Cannot install package liblucihttp-ucode.
 * opkg_install_pkg: Checksum or size mismatch for package rpcd-mod-luci. Either the opkg or the package index are corrupt. Try 'opkg update'.
 * opkg_install_cmd: Cannot install package luci.
 * opkg_install_pkg: Checksum or size mismatch for package liblucihttp0. Either the opkg or the package index are corrupt. Try 'opkg update'.
 * opkg_install_cmd: Cannot install package luci-app-nut.
 * opkg_install_pkg: Checksum or size mismatch for package rpcd-mod-luci. Either the opkg or the package index are corrupt. Try 'opkg update'.
 * opkg_install_cmd: Cannot install package rpcd-mod-luci.
 * opkg_install_pkg: Checksum or size mismatch for package rpcd-mod-rrdns. Either the opkg or the package index are corrupt. Try 'opkg update'.
 * opkg_install_cmd: Cannot install package rpcd-mod-rrdns.
 * opkg_install_pkg: Checksum or size mismatch for package ucode-mod-html. Either the opkg or the package index are corrupt. Try 'opkg update'.
 * opkg_install_cmd: Cannot install package ucode-mod-html.
make[2]: *** [Makefile:189: package_install] Error 255
make[1]: *** [Makefile:154: _call_manifest] Error 2
make: *** [Makefile:274: manifest] Error 2

@aparcar -- any thoughts?

2

Try again later?

3

Not sure why time would change this one... but just tried again (+2h from the last attempt). Same errors.

I did not have this issue with my GL-MT3000 which upgraded (via ASU) without issue except for the shadowsocks packages that had to be omitted.

1 Like
4

Looks like desynchronized mirrors.
Try firmware selector adding "broken" packages,

5

Well, time heals all wounds. We're now +12h since my last attempt, and it worked properly this time (aside from the need to remove shadowsocks, but that was expected).

1 Like
6

This happens like every time new release is out. Probably gets better next time.

7

This was the first time I ran into issues with AUC, but I've only been using it since I started using a Pi4 for my VPN endpoint at home and an MT3000 for my travel router (both during the 23.05 series).

8

So AUC to 24.10.0 then future upgrades with OWUT, correct?

1 Like
9

Yes... although AUC still exists in 24.10 so it's possible to continue using it. owut is installed, though (IIUC, it installed automatically as part of the AUC process).

1 Like
10

It is automatic package substitutions done by sysupgrade server like wolfssl->mbedtls between 22.x to 23.x and now auc to owut

1 Like
11

When you upgrade with auc, it will apply the package changes in https://sysupgrade.openwrt.org/json/v1/overview.json and auto-install owut in place of auc (and luci-app-opkg gets replaced by luci-app-packagemanager and ...). Likewise, owut also applies the package_changes, but...

The LuCI Attended Sysupgrade app does not presently do this (yet), so you usually just get errors about missing packages during the "Checking manifest" phase.

I just wrote something about that this morning, second part of Owut: OpenWrt Upgrade Tool - #535 by efahl

2 Likes
12

But what about the 1001th eager beaver??? :slight_smile:

Earlier in the day (yesterday) I had been getting a complete failure of ASU -- can't remember the exact error message, but that cleared up more rapidly. It does seem, though, that the ASU servers were heavily burdened and, as you explain, there was a lag between some of the packages and the index.

Thanks!

13

That earlier fail was probably the "Error 500: Internal server error" which was due to the disk being full, then it crashed altogether and the server would not even respond.

Once sysupgrade got fixed, now we're running into issues on the buildbots, mostly with the package updates. This may also be due to heavy ASU server use: it's downloading the package index, sigs and packages as fast as it can to run the builds...

We just need infrastructure with infinite capacity and bandwidth, we'd be all set!

1 Like
14

Yes, that perfectly describes what I experienced.

No problem.... we've got nearly infinite resources to invest in the infinite capacity.... oh wait :frowning:

I know there are discussions every so often about how to increase the OpenWrt server compute and storage capacity... these events certainly shine a light onto why this is important. Hopefully there are some resources to put towards the infrastructure. But, that's for another thread.

Thanks for the additional info/insight!

2 Likes
15

This topic was automatically closed 10 days after the last reply. New replies are no longer allowed.