A Wireguard comparison DB

Sorry for the delayed reply. But yeah, that's what caught my attention as I'd noticed that for the Asus TUF-AX6000 you used the receiver result from the test in reverse mode. But if you're taking the smaller number then the TUF-AX6000 should be 761 Mbps instead of 786 Mbps and the GL-MT6000 should be 806 Mbps instead of 807 Mbps.

./benchmark.sh (TUF-AX6000):

[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   909 MBytes   763 Mbits/sec    0             sender
[  5]   0.00-10.00  sec   908 MBytes   761 Mbits/sec                  receiver

./benchmark.sh (GL-MT6000):

[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   962 MBytes   807 Mbits/sec    0             sender
[  5]   0.00-10.00  sec   960 MBytes   806 Mbits/sec                  receiver

./benchmark.sh -R (TUF-AX6000):

[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   940 MBytes   788 Mbits/sec    0             sender
[  5]   0.00-10.00  sec   937 MBytes   786 Mbits/sec                  receiver

./benchmark.sh -R (GL-MT6000):

[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   975 MBytes   817 Mbits/sec    0             sender
[  5]   0.00-10.00  sec   972 MBytes   816 Mbits/sec                  receiver

That or for consistency you could change the GL-MT6000's result to 816 Mbps, so both are using the results from the test in reverse mode.

1 Like

Good catch, I just updated both of them.

|MikroTik RB5009 | Marvell Armada 7040
(Quad Core A72, 1.4GHz) | Snapshot 6.1.79 | 986 Mbps|

root@RB5009UG:/tmp# ubus call system board
{
        "kernel": "6.1.79",
        "hostname": "RB5009UG",
        "system": "ARMv8 Processor rev 1",
        "model": "MikroTik RB5009",
        "board_name": "mikrotik,rb5009",
        "rootfs_type": "squashfs",
        "release": {
                "distribution": "OpenWrt",
                "version": "SNAPSHOT",
                "revision": "r25360-7777921aa0",
                "target": "mvebu/cortexa72",
                "description": "OpenWrt SNAPSHOT r25360-7777921aa0"
        }
}

root@RB5009UG:/tmp# ./benchmark.sh
Connecting to host 169.254.200.2, port 5201
[  5] local 169.254.200.1 port 46390 connected to 169.254.200.2 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   126 MBytes  1.05 Gbits/sec    0    961 KBytes
[  5]   1.00-2.00   sec   123 MBytes  1.03 Gbits/sec    0   1.04 MBytes
[  5]   2.00-3.00   sec   125 MBytes  1.05 Gbits/sec    0   1.37 MBytes
[  5]   3.00-4.00   sec   122 MBytes  1.02 Gbits/sec    0   1.44 MBytes
[  5]   4.00-5.00   sec   125 MBytes  1.05 Gbits/sec    0   1.80 MBytes
[  5]   5.00-6.00   sec   122 MBytes  1.02 Gbits/sec    0   1.89 MBytes
[  5]   6.00-7.00   sec   125 MBytes  1.05 Gbits/sec    0   2.00 MBytes
[  5]   7.00-8.00   sec   124 MBytes  1.04 Gbits/sec    0   2.47 MBytes
[  5]   8.00-9.00   sec   122 MBytes  1.03 Gbits/sec    0   2.47 MBytes
[  5]   9.00-10.00  sec   121 MBytes  1.02 Gbits/sec    0   2.47 MBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  1.21 GBytes  1.04 Gbits/sec    0             sender
[  5]   0.00-10.01  sec  1.20 GBytes  1.03 Gbits/sec                  receiver

iperf Done.
root@RB5009UG:/tmp# ./benchmark.sh -R
Connecting to host 169.254.200.2, port 5201
Reverse mode, remote host 169.254.200.2 is sending
[  5] local 169.254.200.1 port 53410 connected to 169.254.200.2 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec   114 MBytes   956 Mbits/sec
[  5]   1.00-2.00   sec   118 MBytes   986 Mbits/sec
[  5]   2.00-3.00   sec   122 MBytes  1.02 Gbits/sec
[  5]   3.00-4.00   sec   117 MBytes   978 Mbits/sec
[  5]   4.00-5.00   sec   120 MBytes  1.01 Gbits/sec
[  5]   5.00-6.00   sec   118 MBytes   989 Mbits/sec
[  5]   6.00-7.00   sec   116 MBytes   969 Mbits/sec
[  5]   7.00-8.00   sec   118 MBytes   989 Mbits/sec
[  5]   8.00-9.00   sec   118 MBytes   987 Mbits/sec
[  5]   9.00-10.00  sec   116 MBytes   973 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  1.15 GBytes   988 Mbits/sec    0             sender
[  5]   0.00-10.00  sec  1.15 GBytes   986 Mbits/sec                  receiver

iperf Done.

If you want me to test anything else, I haven't cleaned up yet.
I've run several consecutive tests. They were the same ballpark.
Here are pure iperf3 test results.

iperf3 results

OpenWrt SNAPSHOT, r25360-7777921aa0

root@RB5009UG:~# iperf3 -s -D && iperf3 -c 127.0.0.1
Connecting to host 127.0.0.1, port 5201
[ 5] local 127.0.0.1 port 59828 connected to 127.0.0.1 port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 1.12 GBytes 9.64 Gbits/sec 0 1.12 MBytes
[ 5] 1.00-2.00 sec 1.05 GBytes 9.02 Gbits/sec 0 1.12 MBytes
[ 5] 2.00-3.00 sec 1.11 GBytes 9.51 Gbits/sec 0 1.19 MBytes
[ 5] 3.00-4.00 sec 1.03 GBytes 8.84 Gbits/sec 0 1.19 MBytes
[ 5] 4.00-5.00 sec 1.09 GBytes 9.39 Gbits/sec 0 1.19 MBytes
[ 5] 5.00-6.00 sec 1.08 GBytes 9.31 Gbits/sec 0 1.19 MBytes
[ 5] 6.00-7.00 sec 1.07 GBytes 9.23 Gbits/sec 0 1.19 MBytes
[ 5] 7.00-8.00 sec 1.07 GBytes 9.20 Gbits/sec 0 1.19 MBytes
[ 5] 8.00-9.00 sec 1.07 GBytes 9.22 Gbits/sec 0 1.19 MBytes
[ 5] 9.00-10.00 sec 1.07 GBytes 9.19 Gbits/sec 0 1.19 MBytes


[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 10.8 GBytes 9.26 Gbits/sec 0 sender
[ 5] 0.00-10.00 sec 10.8 GBytes 9.25 Gbits/sec receiver

iperf Done.

2 Likes

|QNAP QHora-301W | Qualcomm IPQ8072A
(Quad Core A53, 2.2GHz) | Snapshot 6.1.79 NSS | 479 Mbps|
This was tested on custom compiled build based on the @qosmio repo with NSS wifi offloading support.

root@QNAP:/tmp# ubus call system board
{
        "kernel": "6.1.79",
        "hostname": "QNAP",
        "system": "ARMv8 Processor rev 4",
        "model": "QNAP 301w",
        "board_name": "qnap,301w",
        "rootfs_type": "squashfs",
        "release": {
                "distribution": "OpenWrt",
                "version": "SNAPSHOT",
                "revision": "r25515+3-ccaf824f86",
                "target": "qualcommax/ipq807x",
                "description": "OpenWrt SNAPSHOT r25515+3-ccaf824f86"
        }
}

root@QNAP:/tmp# ./benchmark.sh
Connecting to host 169.254.200.2, port 5201
[  5] local 169.254.200.1 port 39778 connected to 169.254.200.2 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  60.8 MBytes   509 Mbits/sec    0    310 KBytes
[  5]   1.00-2.00   sec  61.1 MBytes   513 Mbits/sec    0    310 KBytes
[  5]   2.00-3.00   sec  60.4 MBytes   507 Mbits/sec    0    323 KBytes
[  5]   3.00-4.00   sec  61.1 MBytes   513 Mbits/sec    0    378 KBytes
[  5]   4.00-5.00   sec  60.1 MBytes   504 Mbits/sec    0    378 KBytes
[  5]   5.00-6.00   sec  59.9 MBytes   502 Mbits/sec    0    395 KBytes
[  5]   6.00-7.00   sec  59.9 MBytes   502 Mbits/sec    0    395 KBytes
[  5]   7.00-8.00   sec  59.5 MBytes   499 Mbits/sec    0    395 KBytes
[  5]   8.00-9.00   sec  59.6 MBytes   500 Mbits/sec    0    414 KBytes
[  5]   9.00-10.00  sec  60.8 MBytes   509 Mbits/sec    0    414 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   603 MBytes   506 Mbits/sec    0             sender
[  5]   0.00-10.00  sec   602 MBytes   505 Mbits/sec                  receiver

iperf Done.

root@QNAP:/tmp# ./benchmark.sh -R
Connecting to host 169.254.200.2, port 5201
Reverse mode, remote host 169.254.200.2 is sending
[  5] local 169.254.200.1 port 45994 connected to 169.254.200.2 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  58.0 MBytes   486 Mbits/sec
[  5]   1.00-2.00   sec  58.1 MBytes   488 Mbits/sec
[  5]   2.00-3.00   sec  56.5 MBytes   474 Mbits/sec
[  5]   3.00-4.00   sec  57.6 MBytes   484 Mbits/sec
[  5]   4.00-5.00   sec  56.5 MBytes   474 Mbits/sec
[  5]   5.00-6.00   sec  56.9 MBytes   477 Mbits/sec
[  5]   6.00-7.00   sec  56.5 MBytes   474 Mbits/sec
[  5]   7.00-8.00   sec  57.2 MBytes   480 Mbits/sec
[  5]   8.00-9.00   sec  57.2 MBytes   480 Mbits/sec
[  5]   9.00-10.00  sec  56.6 MBytes   475 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   573 MBytes   480 Mbits/sec    0             sender
[  5]   0.00-10.00  sec   571 MBytes   479 Mbits/sec                  receiver

iperf Done.

Does anyone know why there is such a big performance difference compared to the Mikrotik RB5009 wg-bench (my previous post above)? Maybe CPU difference - A53 vs A72.

No, if you look at the table, Xiaomi AX6 is there, it's the same family as 301W which an even slower clock speed than yours, so that's very strange. I hope someone with like Dynalink DL-WRX36 can do the same test and see how it looks like.

EDIT: @sppmaster I just noticed that you are running NSS build, not sure if that might be one issue, any chance you can run a non-NSS build to compare with? It can be official 23.05.2 or snapshot from official master, in case the official one has higher performance, then we need to bring this back to NSS build discussion thread.

2 Likes

| Xiaomi AX3600 | Qualcomm IPQ8071A (Quad Core A53, 1.4GHz) | Snapshot (6.1.80) | 569 Mbps |

ubus call system board

root@router-despacho:~# ubus call system board
{
"kernel": "6.1.80",
"hostname": "router-despacho",
"system": "ARMv8 Processor rev 4",
"model": "Xiaomi AX3600",
"board_name": "xiaomi,ax3600",
"rootfs_type": "squashfs",
"release": {
"distribution": "OpenWrt",
"version": "SNAPSHOT",
"revision": "r25402-5b1d6d4607",
"target": "qualcommax/ipq807x",
"description": "OpenWrt SNAPSHOT r25402-5b1d6d4607"
}
}

./benchmark.sh

root@router-despacho:/tmp/wg-bench-master# ./benchmark.sh
Connecting to host 169.254.200.2, port 5201
[ 5] local 169.254.200.1 port 33590 connected to 169.254.200.2 port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 68.6 MBytes 575 Mbits/sec 0 375 KBytes
[ 5] 1.00-2.00 sec 67.5 MBytes 566 Mbits/sec 0 375 KBytes
[ 5] 2.00-3.00 sec 68.0 MBytes 570 Mbits/sec 0 391 KBytes
[ 5] 3.00-4.00 sec 67.8 MBytes 568 Mbits/sec 0 411 KBytes
[ 5] 4.00-5.00 sec 68.0 MBytes 570 Mbits/sec 0 430 KBytes
[ 5] 5.00-6.00 sec 67.9 MBytes 569 Mbits/sec 0 450 KBytes
[ 5] 6.00-7.00 sec 68.1 MBytes 572 Mbits/sec 0 450 KBytes
[ 5] 7.00-8.00 sec 68.0 MBytes 570 Mbits/sec 0 450 KBytes
[ 5] 8.00-9.00 sec 67.9 MBytes 569 Mbits/sec 0 490 KBytes
[ 5] 9.00-10.00 sec 67.4 MBytes 565 Mbits/sec 0 490 KBytes


[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 679 MBytes 570 Mbits/sec 0 sender
[ 5] 0.00-10.00 sec 678 MBytes 569 Mbits/sec receiver

iperf Done.

./benchmark.sh -R

root@router-despacho:/tmp/wg-bench-master# ./benchmark.sh -R
Connecting to host 169.254.200.2, port 5201
Reverse mode, remote host 169.254.200.2 is sending
[ 5] local 169.254.200.1 port 55942 connected to 169.254.200.2 port 5201
[ ID] Interval Transfer Bitrate
[ 5] 0.00-1.00 sec 65.8 MBytes 551 Mbits/sec
[ 5] 1.00-2.00 sec 66.9 MBytes 561 Mbits/sec
[ 5] 2.00-3.00 sec 66.2 MBytes 556 Mbits/sec
[ 5] 3.00-4.00 sec 66.5 MBytes 558 Mbits/sec
[ 5] 4.00-5.00 sec 67.4 MBytes 565 Mbits/sec
[ 5] 5.00-6.00 sec 67.0 MBytes 562 Mbits/sec
[ 5] 6.00-7.00 sec 67.4 MBytes 565 Mbits/sec
[ 5] 7.00-8.00 sec 67.1 MBytes 563 Mbits/sec
[ 5] 8.00-9.00 sec 67.1 MBytes 563 Mbits/sec
[ 5] 9.00-10.00 sec 66.6 MBytes 559 Mbits/sec


[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 669 MBytes 561 Mbits/sec 0 sender
[ 5] 0.00-10.00 sec 668 MBytes 560 Mbits/sec receiver

iperf Done.

Confirmed, but see important details added at the end of the post.
|QNAP QHora-301W | Qualcomm IPQ8072A
(Quad Core A53, 2.2GHz) | Snapshot 6.1.80 | 772 Mbps|

root@QNAP:/tmp# ubus call system board
{
        "kernel": "6.1.80",
        "hostname": "QNAP",
        "system": "ARMv8 Processor rev 4",
        "model": "QNAP 301w",
        "board_name": "qnap,301w",
        "rootfs_type": "squashfs",
        "release": {
                "distribution": "OpenWrt",
                "version": "SNAPSHOT",
                "revision": "r25402-5b1d6d4607",
                "target": "qualcommax/ipq807x",
                "description": "OpenWrt SNAPSHOT r25402-5b1d6d4607"
        }
}

root@QNAP:/tmp# ./benchmark.sh
Connecting to host 169.254.200.2, port 5201
[  5] local 169.254.200.1 port 40726 connected to 169.254.200.2 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  99.2 MBytes   832 Mbits/sec    0    448 KBytes
[  5]   1.00-2.00   sec  97.0 MBytes   814 Mbits/sec    0    448 KBytes
[  5]   2.00-3.00   sec  96.4 MBytes   808 Mbits/sec    0    530 KBytes
[  5]   3.00-4.00   sec  98.0 MBytes   822 Mbits/sec    0    530 KBytes
[  5]   4.00-5.00   sec  97.2 MBytes   816 Mbits/sec    0    530 KBytes
[  5]   5.00-6.00   sec  96.6 MBytes   811 Mbits/sec    0    530 KBytes
[  5]   6.00-7.00   sec  97.2 MBytes   816 Mbits/sec    0    530 KBytes
[  5]   7.00-8.00   sec  95.6 MBytes   802 Mbits/sec    0    619 KBytes
[  5]   8.00-9.00   sec  96.4 MBytes   808 Mbits/sec    0    619 KBytes
[  5]   9.00-10.00  sec  98.1 MBytes   823 Mbits/sec    0    619 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   972 MBytes   815 Mbits/sec    0             sender
[  5]   0.00-10.00  sec   970 MBytes   814 Mbits/sec                  receiver

iperf Done.


root@QNAP:/tmp# ./benchmark.sh -R
Connecting to host 169.254.200.2, port 5201
Reverse mode, remote host 169.254.200.2 is sending
[  5] local 169.254.200.1 port 57852 connected to 169.254.200.2 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  91.5 MBytes   767 Mbits/sec
[  5]   1.00-2.00   sec  91.4 MBytes   767 Mbits/sec
[  5]   2.00-3.00   sec  92.0 MBytes   772 Mbits/sec
[  5]   3.00-4.00   sec  92.5 MBytes   776 Mbits/sec
[  5]   4.00-5.00   sec  92.2 MBytes   774 Mbits/sec
[  5]   5.00-6.00   sec  92.1 MBytes   773 Mbits/sec
[  5]   6.00-7.00   sec  92.1 MBytes   773 Mbits/sec
[  5]   7.00-8.00   sec  91.9 MBytes   771 Mbits/sec
[  5]   8.00-9.00   sec  92.0 MBytes   771 Mbits/sec
[  5]   9.00-10.00  sec  93.0 MBytes   781 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   923 MBytes   774 Mbits/sec    0             sender
[  5]   0.00-10.00  sec   921 MBytes   772 Mbits/sec                  receiver

iperf Done.

Edit - I've just made another very important test - simultaneous wg-bench & WAN Speedtest.
While running WAN Speedtest (1Gbps ISP plan), wg-bench only gives the following results. See the drop from 800 to 600 Mbps occurring while Speedtest reaches only 500Mbps (with 1Gbps ISP line).

root@QNAP:/tmp# ./benchmark.sh -R
Connecting to host 169.254.200.2, port 5201
Reverse mode, remote host 169.254.200.2 is sending
[  5] local 169.254.200.1 port 35514 connected to 169.254.200.2 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  94.9 MBytes   795 Mbits/sec
[  5]   1.00-2.00   sec  83.6 MBytes   701 Mbits/sec
[  5]   2.00-3.00   sec  70.0 MBytes   587 Mbits/sec
[  5]   3.00-4.00   sec  67.1 MBytes   563 Mbits/sec
[  5]   4.00-5.00   sec  66.1 MBytes   555 Mbits/sec
[  5]   5.00-6.00   sec  68.0 MBytes   570 Mbits/sec
[  5]   6.00-7.00   sec  66.6 MBytes   559 Mbits/sec
[  5]   7.00-8.00   sec  65.8 MBytes   552 Mbits/sec
[  5]   8.00-9.00   sec  67.0 MBytes   562 Mbits/sec
[  5]   9.00-10.00  sec  66.6 MBytes   559 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   719 MBytes   603 Mbits/sec   35             sender
[  5]   0.00-10.00  sec   716 MBytes   600 Mbits/sec                  receiver

iperf Done.

As you can see the performance was reduced and most importantly the Speedtest WAN download speed was reduced to 500Mbps (half of the regular ISP 1Gbps line).
Using NSS enabled build, the speedtest download speed keeps going at full 1Gbps with ~500Mbps wg-bench.
So the total combined throughput of Speedtest WAN & Wg-bench is 1Gbps + 500Mbps for the NSS build versus 500Mbps + ~600Mbps for non NSS build.
@fakemanhk
So obviously this should be stated somewhere in the results too.
Probably most devices will not be able to keep their full wireguard speeds while donloading/uploading to WAN at high (Gigabit) speeds as properly stated on the first post about the real world VPN use.

2 Likes

Probably most devices will not be able to keep their full wireguard speeds while donloading/uploading to WAN at high (Gigabit) speeds as properly stated on the first post about the real world VPN use.

Sure. This script only gives a way to test wireguard performance locally as I noticed it in the readme of my repo. Not everyone has another machine and high-speed LAN to have a benchmark in real scenarios. I just found this way simple and the difference from the real scenarios benchmark is very small for MT7621, MT7981.

1 Like

Asus TUF-AX4200, OpenWRT 23.05.2 (5.15.137)

./benchmark.sh & ./benchmark.sh -R
root@OpenWrt:/tmp/wg-bench# ./benchmark.sh
Connecting to host 169.254.200.2, port 5201
[  5] local 169.254.200.1 port 39718 connected to 169.254.200.2 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   103 MBytes   860 Mbits/sec    0    601 KBytes
[  5]   1.00-2.00   sec   101 MBytes   846 Mbits/sec    0    601 KBytes
[  5]   2.00-3.00   sec   100 MBytes   841 Mbits/sec    0    601 KBytes
[  5]   3.00-4.00   sec   100 MBytes   843 Mbits/sec    0    657 KBytes
[  5]   4.00-5.00   sec  99.6 MBytes   836 Mbits/sec    0    657 KBytes
[  5]   5.00-6.00   sec   101 MBytes   844 Mbits/sec    0    657 KBytes
[  5]   6.00-7.00   sec   100 MBytes   842 Mbits/sec    0    657 KBytes
[  5]   7.00-8.00   sec  99.8 MBytes   837 Mbits/sec    0    688 KBytes
[  5]   8.00-9.00   sec   100 MBytes   840 Mbits/sec    0    688 KBytes
[  5]   9.00-10.00  sec  99.2 MBytes   832 Mbits/sec    0    721 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  1005 MBytes   843 Mbits/sec    0             sender
[  5]   0.00-10.00  sec  1003 MBytes   841 Mbits/sec                  receiver

iperf Done.

root@OpenWrt:/tmp/wg-bench# ./benchmark.sh -R
PWD=/tmp/wg-bench
Connecting to host 169.254.200.2, port 5201
Reverse mode, remote host 169.254.200.2 is sending
[  5] local 169.254.200.1 port 44922 connected to 169.254.200.2 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  95.8 MBytes   802 Mbits/sec
[  5]   1.00-2.00   sec  97.6 MBytes   819 Mbits/sec
[  5]   2.00-3.00   sec  98.1 MBytes   823 Mbits/sec
[  5]   3.00-4.00   sec  97.0 MBytes   814 Mbits/sec
[  5]   4.00-5.00   sec  98.4 MBytes   825 Mbits/sec
[  5]   5.00-6.00   sec  97.4 MBytes   817 Mbits/sec
[  5]   6.00-7.00   sec  99.2 MBytes   833 Mbits/sec
[  5]   7.00-8.00   sec  97.0 MBytes   813 Mbits/sec
[  5]   8.00-9.00   sec  99.1 MBytes   832 Mbits/sec
[  5]   9.00-10.00  sec  98.1 MBytes   823 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   982 MBytes   824 Mbits/sec    0             sender
[  5]   0.00-10.00  sec   978 MBytes   820 Mbits/sec                  receiver

iperf Done.

Asus TUF-AX4200, OpenWRT SNAPSHOT r25402-012be0468c 240304 (6.1.79)

./benchmark.sh & ./benchmark.sh -R
root@OpenWrt:/tmp/wg-bench# ./benchmark.sh
Connecting to host 169.254.200.2, port 5201
[  5] local 169.254.200.1 port 42188 connected to 169.254.200.2 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  95.9 MBytes   803 Mbits/sec    0    457 KBytes
[  5]   1.00-2.00   sec  93.9 MBytes   787 Mbits/sec    0    457 KBytes
[  5]   2.00-3.00   sec  95.0 MBytes   797 Mbits/sec    0    478 KBytes
[  5]   3.00-4.00   sec  94.0 MBytes   789 Mbits/sec    0    557 KBytes
[  5]   4.00-5.00   sec  94.6 MBytes   794 Mbits/sec    0    557 KBytes
[  5]   5.00-6.00   sec  96.1 MBytes   806 Mbits/sec    0    557 KBytes
[  5]   6.00-7.00   sec  95.1 MBytes   798 Mbits/sec    0    557 KBytes
[  5]   7.00-8.00   sec  96.4 MBytes   808 Mbits/sec    0    557 KBytes
[  5]   8.00-9.00   sec  93.6 MBytes   785 Mbits/sec    0    557 KBytes
[  5]   9.00-10.00  sec  95.4 MBytes   800 Mbits/sec    0    557 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   950 MBytes   797 Mbits/sec    0             sender
[  5]   0.00-10.00  sec   949 MBytes   795 Mbits/sec                  receiver

iperf Done.
root@OpenWrt:/tmp/wg-bench# ./benchmark.sh -R
Connecting to host 169.254.200.2, port 5201
Reverse mode, remote host 169.254.200.2 is sending
[  5] local 169.254.200.1 port 59340 connected to 169.254.200.2 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  93.5 MBytes   783 Mbits/sec
[  5]   1.00-2.00   sec  97.6 MBytes   819 Mbits/sec
[  5]   2.00-3.00   sec  99.6 MBytes   836 Mbits/sec
[  5]   3.00-4.00   sec  98.5 MBytes   824 Mbits/sec
[  5]   4.00-5.00   sec  98.9 MBytes   831 Mbits/sec
[  5]   5.00-6.00   sec  93.9 MBytes   787 Mbits/sec
[  5]   6.00-7.00   sec  96.8 MBytes   812 Mbits/sec
[  5]   7.00-8.00   sec  96.8 MBytes   812 Mbits/sec
[  5]   8.00-9.00   sec  94.4 MBytes   792 Mbits/sec
[  5]   9.00-10.00  sec  97.4 MBytes   817 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   971 MBytes   815 Mbits/sec    0             sender
[  5]   0.00-10.00  sec   968 MBytes   812 Mbits/sec                  receiver

iperf Done.

Asus TX-AX6000, OpenWRT 23.05.2 (5.15.137)

./benchmark.sh & ./benchmark.sh -R
root@OpenWrt:/tmp/wg-bench# ./benchmark.sh
Connecting to host 169.254.200.2, port 5201
[  5] local 169.254.200.1 port 53722 connected to 169.254.200.2 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   100 MBytes   842 Mbits/sec    0    538 KBytes
[  5]   1.00-2.00   sec  99.5 MBytes   835 Mbits/sec    0    593 KBytes
[  5]   2.00-3.00   sec   100 MBytes   841 Mbits/sec    0    593 KBytes
[  5]   3.00-4.00   sec  99.2 MBytes   833 Mbits/sec    0    593 KBytes
[  5]   4.00-5.00   sec   101 MBytes   844 Mbits/sec    0    593 KBytes
[  5]   5.00-6.00   sec   100 MBytes   840 Mbits/sec    0    593 KBytes
[  5]   6.00-7.00   sec   100 MBytes   840 Mbits/sec    0    624 KBytes
[  5]   7.00-8.00   sec   101 MBytes   844 Mbits/sec    0    624 KBytes
[  5]   8.00-9.00   sec   100 MBytes   843 Mbits/sec    0    653 KBytes
[  5]   9.00-10.00  sec   101 MBytes   846 Mbits/sec    0    684 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  1002 MBytes   841 Mbits/sec    0             sender
[  5]   0.00-10.00  sec  1001 MBytes   839 Mbits/sec                  receiver

iperf Done.

root@OpenWrt:/tmp/wg-bench# ./benchmark.sh -R
Connecting to host 169.254.200.2, port 5201
Reverse mode, remote host 169.254.200.2 is sending
[  5] local 169.254.200.1 port 42972 connected to 169.254.200.2 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  95.4 MBytes   799 Mbits/sec
[  5]   1.00-2.00   sec  96.8 MBytes   812 Mbits/sec
[  5]   2.00-3.00   sec  97.8 MBytes   820 Mbits/sec
[  5]   3.00-4.00   sec  99.1 MBytes   832 Mbits/sec
[  5]   4.00-5.00   sec  97.5 MBytes   818 Mbits/sec
[  5]   5.00-6.00   sec  98.4 MBytes   825 Mbits/sec
[  5]   6.00-7.00   sec  96.8 MBytes   811 Mbits/sec
[  5]   7.00-8.00   sec  99.1 MBytes   831 Mbits/sec
[  5]   8.00-9.00   sec  97.9 MBytes   821 Mbits/sec
[  5]   9.00-10.00  sec  98.0 MBytes   822 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   981 MBytes   823 Mbits/sec    0             sender
[  5]   0.00-10.00  sec   977 MBytes   819 Mbits/sec                  receiver

iperf Done.

Asus TX-AX6000, OpenWRT SNAPSHOT r25402-012be0468c 240304 (6.1.79)

./benchmark.sh & ./benchmark.sh -R
root@OpenWrt:/tmp/wg-bench# ./benchmark.sh
Connecting to host 169.254.200.2, port 5201
[  5] local 169.254.200.1 port 38720 connected to 169.254.200.2 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   118 MBytes   991 Mbits/sec    0    957 KBytes
[  5]   1.00-2.00   sec   119 MBytes   995 Mbits/sec    0   1003 KBytes
[  5]   2.00-3.00   sec   115 MBytes   964 Mbits/sec    0   1.03 MBytes
[  5]   3.00-4.00   sec   116 MBytes   974 Mbits/sec    0   1.15 MBytes
[  5]   4.00-5.00   sec   114 MBytes   953 Mbits/sec    0   1.21 MBytes
[  5]   5.00-6.00   sec   116 MBytes   974 Mbits/sec    0   1.27 MBytes
[  5]   6.00-7.00   sec   115 MBytes   963 Mbits/sec    0   1.27 MBytes
[  5]   7.00-8.00   sec   116 MBytes   969 Mbits/sec    0   1.27 MBytes
[  5]   8.00-9.00   sec   118 MBytes   987 Mbits/sec    0   1.33 MBytes
[  5]   9.00-10.00  sec   115 MBytes   962 Mbits/sec    0   1.33 MBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  1.13 GBytes   973 Mbits/sec    0             sender
[  5]   0.00-10.00  sec  1.13 GBytes   970 Mbits/sec                  receiver

iperf Done.

root@OpenWrt:/tmp/wg-bench# ./benchmark.sh -R
Connecting to host 169.254.200.2, port 5201
Reverse mode, remote host 169.254.200.2 is sending
[  5] local 169.254.200.1 port 60094 connected to 169.254.200.2 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec   109 MBytes   915 Mbits/sec
[  5]   1.00-2.00   sec   113 MBytes   945 Mbits/sec
[  5]   2.00-3.00   sec   114 MBytes   958 Mbits/sec
[  5]   3.00-4.00   sec   113 MBytes   949 Mbits/sec
[  5]   4.00-5.00   sec   112 MBytes   941 Mbits/sec
[  5]   5.00-6.00   sec   114 MBytes   952 Mbits/sec
[  5]   6.00-7.00   sec   114 MBytes   952 Mbits/sec
[  5]   7.00-8.00   sec   116 MBytes   969 Mbits/sec
[  5]   8.00-9.00   sec   113 MBytes   946 Mbits/sec
[  5]   9.00-10.00  sec   114 MBytes   956 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.01  sec  1.11 GBytes   951 Mbits/sec    1             sender
[  5]   0.00-10.00  sec  1.10 GBytes   948 Mbits/sec                  receiver

iperf Done.

TX-AX6000 = China version of TUF-AX6000 (details)
Photos: Asus TUF Gaming AX6000 support - #628 by remittor

3 Likes

But TUF-AX6000 doesn't have OpenWrt 23.05.2 support right? Did you make a mistake here?

P.S. How do you flash your China version? Also using same TFTP method?

These are exactly the same routers (TUF-AX6000 and TX-AX6000). They have completely identical official firmware.
The bodies are just different.

I did the same as for TUF-AX4200 and TUF-AX6000 (w/o TFTP method).

1 Like

I mean the 23.05.2, I know that TUF-AX6000 has no support official 23.05.2 support yet.

I personally build OpenWRT images for it that are fully compatible with official firmware (vermagic is the same):

You can download these images here: https://drive.google.com/drive/folders/1c10G1LZuTiCo8dOItq3FV6A3-XK7-QfV

1 Like

TUF-AX6000:

[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   909 MBytes   763 Mbits/sec    0             sender
[  5]   0.00-10.00  sec   908 MBytes   761 Mbits/sec                  receiver

TX-AX6000:

[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  1.13 GBytes   973 Mbits/sec    0             sender
[  5]   0.00-10.00  sec  1.13 GBytes   970 Mbits/sec                  receiver

That's a big difference for what should be the same product. And it's weird that reverse mode is slower for you when it's normally faster with this SoC. I can only assume it's got something to do with your firmware and it's config options.

{
	"kernel": "5.15.137",
	"hostname": "OpenWrt",
	"system": "Intel(R) N100",
	"model": "Default string Default string",
	"board_name": "default-string-default-string",
	"rootfs_type": "ext4",
	"release": {
		"distribution": "OpenWrt",
		"version": "23.05.2",
		"revision": "r23630-842932a63d",
		"target": "x86/64",
		"description": "OpenWrt 23.05.2 r23630-842932a63d"
	}
}
Connecting to host 169.254.200.2, port 5201
[  5] local 169.254.200.1 port 57676 connected to 169.254.200.2 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   542 MBytes  4.54 Gbits/sec  1177    860 KBytes
[  5]   1.00-2.00   sec   566 MBytes  4.75 Gbits/sec    0   1.07 MBytes
[  5]   2.00-3.00   sec   555 MBytes  4.66 Gbits/sec    0   1.33 MBytes
[  5]   3.00-4.00   sec   561 MBytes  4.71 Gbits/sec    2   1.17 MBytes
[  5]   4.00-5.00   sec   564 MBytes  4.73 Gbits/sec    0   1.42 MBytes
[  5]   5.00-6.00   sec   562 MBytes  4.71 Gbits/sec   60    935 KBytes
[  5]   6.00-7.00   sec   558 MBytes  4.68 Gbits/sec    0   1.19 MBytes
[  5]   7.00-8.00   sec   555 MBytes  4.65 Gbits/sec    0   1.40 MBytes
[  5]   8.00-9.00   sec   559 MBytes  4.69 Gbits/sec   48   1.20 MBytes
[  5]   9.00-10.00  sec   568 MBytes  4.76 Gbits/sec    0   1.45 MBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  5.46 GBytes  4.69 Gbits/sec  1287             sender
[  5]   0.00-10.00  sec  5.46 GBytes  4.69 Gbits/sec                  receiver```

I just downloaded a fresh image from the OpenWRT update server and ran a test after setting up the Internet.

ubus call system board
{
        "kernel": "6.1.80",
        "hostname": "OpenWrt",
        "system": "ARMv8 Processor rev 4",
        "model": "ASUS TUF-AX6000",
        "board_name": "asus,tuf-ax6000",
        "rootfs_type": "squashfs",
        "release": {
                "distribution": "OpenWrt",
                "version": "SNAPSHOT",
                "revision": "r25433-1f5fd5cb97",
                "target": "mediatek/filogic",
                "description": "OpenWrt SNAPSHOT r25433-1f5fd5cb97"
        }
}
benchmark
root@OpenWrt:/tmp/wg-bench# ./benchmark.sh
Connecting to host 169.254.200.2, port 5201
[  5] local 169.254.200.1 port 53996 connected to 169.254.200.2 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  96.9 MBytes   812 Mbits/sec    0    473 KBytes
[  5]   1.00-2.00   sec  96.1 MBytes   806 Mbits/sec    0    520 KBytes
[  5]   2.00-3.00   sec  96.0 MBytes   805 Mbits/sec    0    520 KBytes
[  5]   3.00-4.00   sec  95.9 MBytes   804 Mbits/sec    0    520 KBytes
[  5]   4.00-5.00   sec  94.6 MBytes   794 Mbits/sec    0    705 KBytes
[  5]   5.00-6.00   sec  95.8 MBytes   803 Mbits/sec    0    705 KBytes
[  5]   6.00-7.00   sec  96.5 MBytes   810 Mbits/sec    0    705 KBytes
[  5]   7.00-8.00   sec  95.9 MBytes   804 Mbits/sec    0    705 KBytes
[  5]   8.00-9.00   sec  96.0 MBytes   805 Mbits/sec    0    705 KBytes
[  5]   9.00-10.00  sec  93.9 MBytes   787 Mbits/sec    0    745 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   958 MBytes   803 Mbits/sec    0             sender
[  5]   0.00-10.00  sec   956 MBytes   801 Mbits/sec                  receiver

iperf Done.
root@OpenWrt:/tmp/wg-bench# ./benchmark.sh -R
Connecting to host 169.254.200.2, port 5201
Reverse mode, remote host 169.254.200.2 is sending
[  5] local 169.254.200.1 port 38384 connected to 169.254.200.2 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  98.6 MBytes   826 Mbits/sec
[  5]   1.00-2.00   sec  99.9 MBytes   838 Mbits/sec
[  5]   2.00-3.00   sec  99.0 MBytes   830 Mbits/sec
[  5]   3.00-4.00   sec   101 MBytes   847 Mbits/sec
[  5]   4.00-5.00   sec  97.8 MBytes   820 Mbits/sec
[  5]   5.00-6.00   sec   100 MBytes   841 Mbits/sec
[  5]   6.00-7.00   sec   101 MBytes   847 Mbits/sec
[  5]   7.00-8.00   sec  99.2 MBytes   832 Mbits/sec
[  5]   8.00-9.00   sec  99.2 MBytes   833 Mbits/sec
[  5]   9.00-10.00  sec  98.0 MBytes   822 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   996 MBytes   835 Mbits/sec    0             sender
[  5]   0.00-10.00  sec   994 MBytes   834 Mbits/sec                  receiver

iperf Done.

Here is the configuration of my custom builds:

I only add additional packages to the firmware without changing any parameters.

maybe it would be better to download it this way:

wget --no-check-certificate https://github.com/cyyself/wg-bench/archive/refs/heads/master.tar.gz -O - | tar -xz
cd ./wg-bench-master
3 Likes

|Linksys E8450 (UBI)|MediaTek MT7622BV (Dual Core A53, 1.35 GHz)|23.05.2|302 Mbps|

ubus call system board
{
	"kernel": "5.15.137",
	"hostname": "OpenWrt",
	"system": "ARMv8 Processor rev 4",
	"model": "Linksys E8450 (UBI)",
	"board_name": "linksys,e8450-ubi",
	"rootfs_type": "squashfs",
	"release": {
		"distribution": "OpenWrt",
		"version": "23.05.2",
		"revision": "r23630-842932a63d",
		"target": "mediatek/mt7622",
		"description": "OpenWrt 23.05.2 r23630-842932a63d"
	}
}
./benchmark.sh

Connecting to host 169.254.200.2, port 5201
[ 5] local 169.254.200.1 port 39762 connected to 169.254.200.2 port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 39.0 MBytes 327 Mbits/sec 0 735 KBytes
[ 5] 1.00-2.00 sec 36.9 MBytes 309 Mbits/sec 0 1.20 MBytes
[ 5] 2.00-3.00 sec 35.9 MBytes 301 Mbits/sec 0 1.28 MBytes
[ 5] 3.00-4.00 sec 35.1 MBytes 295 Mbits/sec 3 1.07 MBytes
[ 5] 4.00-5.00 sec 37.2 MBytes 312 Mbits/sec 0 1.17 MBytes
[ 5] 5.00-6.00 sec 38.4 MBytes 322 Mbits/sec 0 1.21 MBytes
[ 5] 6.00-7.00 sec 37.0 MBytes 311 Mbits/sec 0 1.33 MBytes
[ 5] 7.00-8.00 sec 34.1 MBytes 286 Mbits/sec 1 998 KBytes
[ 5] 8.00-9.00 sec 34.2 MBytes 287 Mbits/sec 0 1.01 MBytes
[ 5] 9.00-10.00 sec 35.4 MBytes 296 Mbits/sec 0 1.09 MBytes


[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 363 MBytes 305 Mbits/sec 4 sender
[ 5] 0.00-10.02 sec 361 MBytes 302 Mbits/sec receiver

iperf Done.

This is on my new toy.

root@ARMORG5:/usb/wg-bench# ubus call system board

Summary

{
"kernel": "6.1.80",
"hostname": "ARMORG5",
"system": "ARMv8 Processor rev 4",
"model": "Zyxel NBG7815",
"board_name": "zyxel,nbg7815",
"rootfs_type": "squashfs",
"release": {
"distribution": "KONG",
"version": "24",
"revision": "r25417-a2f370f5b2",
"target": "qualcommax/ipq807x",
"description": "KONG 24 r25417-a2f370f5b2"
}
}

Standard build:

root@ARMORG5:/usb/wg-bench# ./benchmark.sh

Summary

Connecting to host 169.254.200.2, port 5201
[ 5] local 169.254.200.1 port 35142 connected to 169.254.200.2 port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 96.2 MBytes 807 Mbits/sec 0 492 KBytes
[ 5] 1.00-2.00 sec 93.0 MBytes 780 Mbits/sec 0 492 KBytes
[ 5] 2.00-3.00 sec 93.5 MBytes 784 Mbits/sec 0 492 KBytes
[ 5] 3.00-4.00 sec 93.6 MBytes 786 Mbits/sec 0 492 KBytes
[ 5] 4.00-5.00 sec 92.2 MBytes 774 Mbits/sec 0 492 KBytes
[ 5] 5.00-6.00 sec 93.9 MBytes 788 Mbits/sec 0 492 KBytes
[ 5] 6.00-7.00 sec 92.4 MBytes 775 Mbits/sec 0 492 KBytes
[ 5] 7.00-8.00 sec 93.1 MBytes 781 Mbits/sec 0 513 KBytes
[ 5] 8.00-9.00 sec 93.0 MBytes 780 Mbits/sec 0 513 KBytes
[ 5] 9.00-10.00 sec 94.0 MBytes 788 Mbits/sec 0 513 KBytes


[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 936 MBytes 785 Mbits/sec 0 sender
[ 5] 0.00-10.00 sec 935 MBytes 784 Mbits/sec receiver

iperf Done.

Kong special:

root@ARMORG5:/usb/wg-bench# ./benchmark.sh

Summary

Connecting to host 169.254.200.2, port 5201
[ 5] local 169.254.200.1 port 44356 connected to 169.254.200.2 port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 113 MBytes 943 Mbits/sec 0 600 KBytes
[ 5] 1.00-2.00 sec 109 MBytes 911 Mbits/sec 0 600 KBytes
[ 5] 2.00-3.00 sec 108 MBytes 907 Mbits/sec 0 600 KBytes
[ 5] 3.00-4.00 sec 109 MBytes 914 Mbits/sec 0 600 KBytes
[ 5] 4.00-5.00 sec 109 MBytes 915 Mbits/sec 0 600 KBytes
[ 5] 5.00-6.00 sec 108 MBytes 907 Mbits/sec 0 600 KBytes
[ 5] 6.00-7.00 sec 108 MBytes 907 Mbits/sec 0 631 KBytes
[ 5] 7.00-8.00 sec 109 MBytes 912 Mbits/sec 0 631 KBytes
[ 5] 8.00-9.00 sec 108 MBytes 905 Mbits/sec 0 631 KBytes
[ 5] 9.00-10.00 sec 109 MBytes 916 Mbits/sec 0 631 KBytes


[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 1.06 GBytes 914 Mbits/sec 0 sender
[ 5] 0.00-10.01 sec 1.06 GBytes 912 Mbits/sec receiver

iperf Done.

Interesting. Can you provide the details on how you modified the firmware from the standard? If you can, showing a git branch will be better.