Just bind the necessary devices into LXC container and it'll be fine. At least that's the case for me with OpenConnect which needs access to /dev/net/tun and optionally /dev/vhost-net.
Yes mapping devices works fine.. the only issue which put me off lxc is how to upgrade openwrt? in my case i need to backup config.. deploy new lxc and update restored config.. Whilst in a vm i can just do sysupgrade..
As well as the ARM options already given, various Intel N100 or N95 etc. fanless systems with 2.5Gbps Ethernet are available on Aliexpress etc. at around €100. Sticking with ARM, you could also add a single or dual 2.5G Ethernet NIC to a suitably equipped ARM board (even a Raspberry Pi 5) via an m.2 slot (€10 to €30).
For a Wifi 6 (2.4GHz and 5GHz only) dedicated access point, the Zyxel NWA50AX PRO is worth considering (I use them at home and also with professional clients), they're good value and has a well supported (and open source friendly) Mediatek chipset, 2.5Gbps Ethernet, POE, and an externally available serial uart.
If you need 6GHz, then I don't know of any great off-the-shelf choices at the moment, but you could something with an m.2 (or mini-pcie) slot and an AW7916-AED (or -NPD) card.
I don't recommend Ubiquiti Unifi because they repeatedly violate the GPL.