Hmm. Looking at the Wiki article for the TL-WR841ND, there is quite confusing information about it. (Edit: Wiki article has been updated to clarify the below findings since posting this.)
This device is NOT RECOMMENDED for future use with OpenWrt due to low flash/ram.
DO NOT BUY DEVICES WITH 4MB FLASH / 32MB RAM if you intend to flash an up-to-date and secure OpenWrt version onto it! See 4/32 warning for details.
1) This device does not have sufficient resources (flash and/or RAM) to provide secure and reliable operation.
This means that even setting a password or changing simple network settings might not be possible any more, rendering the device effectively useless. See OpenWrt on 4/32 devices what you can do now.
2) OpenWrt support for this device has ended in 2022.
19.07.10 was the last official build for 4/32 devices.
Yet, the techdata for TL-WR841N v13 does claim that it supports 25.12.2 and firmware is still being made for it, as seen in the firmware downloader, as it is an 8/64 device, not a 4/32 device.
Regardless, as said on the Supported devices Wiki:
DO NOT BUY DEVICES WITH 8MB FLASH / 64MB RAM if you intend to flash an up-to-date and secure OpenWrt version onto it! See 8/64 warning for details.
8/64 devices do not have sufficient resources (flash and/or RAM) to provide secure and reliable operation. See OpenWrt on 8/64 devices what you can do now.
Based on what I'm seeing, it's not too surprising to see a difference with OpenWrt 21.X and OpenWrt 25.X, with releases four years apart, on a very low spec device. As to why exactly there is a big difference for boot time on that device though, I'm not sure myself.
Perhaps someone else who knows OpenWrt like the back of their hand could chime in, instead.
Side note, the Wiki states that "the TL-WR841NDv13 is leaking LAN traffic through WAN port during boot, due to lack of port isolation". Just relaying that information in case you weren't aware of it and might be of concern.