APU2E2 not reaching known WAN/LAN speeds

Been trying to get OpenWRT working with a PCEngines APU2E2 board that only handles wired connections through a switch ( no wireless cards installed, that's handled by a wireless AP ). With OpenWRT installed either with prebuilt images, images from the image builder, and images built from source, WAN speeds will not exceed 90Mbps down. With IPFire installed I manage to get anywhere from 400-500Mbps down using the same cables/layout.
iperf3 connection between two wired devices:

Accepted connection from 192.168.1.50, port 58242
[  5] local 192.168.1.223 port 5201 connected to 192.168.1.50 port 58243
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.03   sec  6.33 MBytes  51.4 Mbits/sec                  
[  5]   1.03-2.02   sec  6.50 MBytes  55.0 Mbits/sec                  
[  5]   2.02-3.04   sec  6.50 MBytes  53.8 Mbits/sec                  
[  5]   3.04-4.10   sec  2.88 MBytes  22.8 Mbits/sec                  
[  5]   4.10-5.03   sec  4.38 MBytes  39.3 Mbits/sec                  
[  5]   5.03-6.04   sec  4.62 MBytes  38.3 Mbits/sec                  
[  5]   6.04-7.05   sec  3.67 MBytes  30.8 Mbits/sec                  
[  5]   7.05-8.09   sec  2.49 MBytes  20.0 Mbits/sec                  
[  5]   8.09-9.05   sec  3.75 MBytes  32.8 Mbits/sec                  
[  5]   9.05-10.03  sec  3.13 MBytes  26.6 Mbits/sec                  
[  5]  10.03-10.07  sec  84.1 KBytes  21.5 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
        Sent 44.3 MByte / 44.3 MByte (100%) of debian-10.3.0-amd64-DVD-1.iso
[  5]   0.00-10.07  sec  44.3 MBytes  36.9 Mbits/sec                  receiver

Not sure what settings to be looking for as IPFire worked out of the box but would much rather be running OpenWRT. Searching for APU2 on the forum doesn't really lead to people having the same issue which makes me wonder if this new model of board may have some differences that default image settings don't mesh with.

Edit: have tried OpenWRT 18.06.08 and 19.07.02

Which Image did you installed?

Which packages did you included when building your own image?

I've tried the x86-64-combined-ext4 and combined-squashfs. As for packages when building, I pretty much just copy and pasted from a guide on someone's GitHub for building for the APU2.

adblock block-mount ca-bundle collectd collectd-mod-sensors flashrom fstools hostapd kmod-crypto-hw-ccp kmod-fs-vfat kmod-gpio-button-hotplug kmod-gpio-nct5104d kmod-leds-gpio kmod-pcspkr kmod-rt2800-lib kmod-rt2800-usb kmod-rt2x00-lib kmod-rt2x00-usb kmod-sound-core kmod-sp5100_tco kmod-usb-ohci kmod-usb-storage kmod-usb-storage-uas kmod-usb2 kmod-usb3 luci luci-app-statistics rt2800-usb-firmware tcpdump sysfsutils usbutils wget

did you have kmod-e1000e and kmod-e1000 installed.

also please send the output of cat /etc/config/network

I did not install those if they were not selected by default no.
Edit: I'm retarded, those do appear to be installed on a fresh install of 19.07.02 combined-squashfs

root@OpenWrt:~# cat /etc/config/network 

config interface 'loopback'
	option ifname 'lo'
	option proto 'static'
	option ipaddr '127.0.0.1'
	option netmask '255.0.0.0'

config globals 'globals'
	option ula_prefix 'fd8d:c98c:d968::/48'

config interface 'lan'
	option type 'bridge'
	option ifname 'eth1 eth2'
	option proto 'static'
	option ipaddr '192.168.1.1'
	option netmask '255.255.255.0'
	option ip6assign '60'

config interface 'wan'
	option ifname 'eth0'
	option proto 'dhcp'

config interface 'wan6'
	option ifname 'eth0'
	option proto 'dhcpv6'

root@OpenWrt:~#

The default choosen packages are only the must have to get it running..
But drivers are not included because when choosing x86/64 target you only get packages for x86 but no drivers for APU2 specific..