I've upgraded my PC-Engines APU-3 router from 19.07.7 to 21.02.1 (both x86-64) and I'm seeing a major performance regression.
On the old version I could get to 1Gbps line-speed, but on the new version I can't even make half that.
Also tried upgrading to 19.07.8 and even that small upgrade shows a performance regression, though not as bad: I can no longer reach line-speed but at most up to 900Mbps.
I'm seeing just a single CPU loaded on the new version, while on the old version the load is distributed over multiple CPUs.
My internet is on a VLAN.
I have a few forwarded ports.
I've tried many many things, even setting all CPUs to the performance govenor, but I've gotten no further.
Also in 19.x? Well then I can only guess that maybe some kernel issue crept in. The fact that only one core is utilized compared to all cores on 19.x sounds like a kernel misconfiguration or something.
Just found out that the regression is in Firefox, not in OpenWRT (luckily, but still strange).
When I run the bandwidth check in Google Chrome everything is fine.