Raspberry Pi 5 alternatives?

Since you've listed the most performant ARM based SBCs: R6S and Pi 5, and ruled out the Intel N100, the only other I can think of is the new BPI-R4. It has a MediaTek Filogic 880 (4x A73s) at 1.8GHz, might be able to hit your performance needs.