How can we make the lantiq xrx200 devices faster

So trying to fix the above crash I made two changes to the patches. In the vanilla backport I increased the TX timeout to 40 * HZ where it was 30 and probably OpenWrt uses 10. Next in the dma descriptors patch there was a comment that there were 192 descriptors per channel but the hex value was 0x80 which meant it was 128 and not 192 so I changed it to C0 and after compiling and flashing the TX side from the router seems to be stable for about 20 seconds at full speed and then it crashes. While before at least for me it wouldn't last 3 seconds.

On the other hand, something seems broken in the tx_housekeeping function because most of the time the crash happens in this but sometimes it also happens with napicomplete function. I am not sure if the last function name is correct but anyway I wanted to understand how it was working and how I could improve it.

One last thing that I want to know is there any way I can load these changes without flashing the firmware to the flash? I know there is a initramfs image available in the config and it's around same size as sysupgrade but how do I use it? I have serial access of course but I personally think that too much flashing may deteriorate the flash chip on my HH5A. Any thoughts?

FYI I re-flashed my HH5a ~100 times with snapshots and do not see any issues with nand yet.

1 Like

@ahmar16
On easybox 904x i use

tftpboot $(loadaddr) IMAGE; bootm $(loadaddr)

for the initramfs-image

2 Likes

I understand but I think it's better to use initramfs image for bricking issues. For instance while making changes above I wasn't able to use the lan ports for a little while and even static IP was not working. Then I connected it with my main wifi through WDS and transferred the image. After all I will have to flash it pnce the patch is stable enough.

Gonna go for these patches tomorrow. Just play with wifi for now.

OK a new set, including IRQ balancing. There are debug leftovers and dead code, but it should work. I did the whole wave300 wifi development with this ethernet driver version. The IRQ balancing is 2 days old, but it seems to work (better than my previous version). I didn't test the both patchsets separated (as it don't have reason to have slow ethernet on 2 VPEs), altought I did test the updated ethernet driver on a single VPE (nosmp kernel parameter). If you want to test it yourself, it should be possible just by splitting the patchsets into 901-903 and 904-906.

BTW All older patches from me are obsolete by this. The patchset is for (older) kernel 4.14.99. Apply them by copying into target/linux/lantiq/patches-4.14 and by recompiling the kernel.

If you got some kernel warnings/oopses, please send the debug log (IRQ has this thread, but I guess it doesn't matter that much).

I didn't test the compatibility of IRQ driver with those devices, which requires one VPE to be disabled (and later some proprietary driver runs on it). If you have these, PLEASE test. Same it seems (from device-tree) the IRQ driver is used by Danube, AR9, AmazonSE and Falcon devices. These won't work with patched device-tree for IRQ patchset (you can test them by changing the "reg" field accordingly) or contact me (I don't know about its hardware specs).

The benchmark is in the tarball. But it seems the ethernet is over 350 Mbps (host to xrx200) and over 260 Mbps (xrx200 to host) (iperf3, TCP traffic). The vanilla kernel has only 178/81 Mbps.

P.S. I didn't use the irqbalancer before (it would bring a nondeterminism into the debug setup), but it seems it may not even work o_O. So I've changed the IRQ driver to autobalance IRQ itself (the code is actually cleaner :smiley: ). Even with this, you can still limit the VPEs by /proc/irq/X/smp_affinity.

Patchset: https://turbo.to/rtnkmlreltcf.html
Mirror: https://ufile.io/dbw67

4 Likes

Well I was gong to post some exceptions related to last patches because there were errors in the tx_housekeeping function related to napi_complete_done and also in rx_poll function. Well rx_poll function would randomly crash at boot sometimes although there were no errors in transferring data. But with these new patches, time for more tests. Will report back later.

Edit: I ran some tests using iperf3 and also ran your script. Although your log says otherwise I am getting some packet loss around 20% when transferring from Router -> Client. On the other side, Client -> Router seems okay with only 0.5% packet loss at times.

Test log
+ : ':::::::[' configuration 1552552149 ']:::::::' :
+ iperf3 -c 192.168.1.254
Connecting to host 192.168.1.254, port 5201
[  5] local 192.168.1.196 port 37538 connected to 192.168.1.254 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  11.7 MBytes  97.9 Mbits/sec    0   99.0 KBytes       
[  5]   1.00-2.00   sec  11.2 MBytes  93.8 Mbits/sec    0    103 KBytes       
[  5]   2.00-3.00   sec  11.2 MBytes  93.8 Mbits/sec    0    103 KBytes       
[  5]   3.00-4.00   sec  11.2 MBytes  93.8 Mbits/sec    0    103 KBytes       
[  5]   4.00-5.00   sec  11.2 MBytes  93.8 Mbits/sec    0    103 KBytes       
[  5]   5.00-6.00   sec  11.2 MBytes  93.8 Mbits/sec    0    103 KBytes       
[  5]   6.00-7.00   sec  11.4 MBytes  95.9 Mbits/sec    0    103 KBytes       
[  5]   7.00-8.00   sec  11.2 MBytes  93.8 Mbits/sec    0    103 KBytes       
[  5]   8.00-9.00   sec  11.2 MBytes  93.8 Mbits/sec    0    103 KBytes       
[  5]   9.00-10.00  sec  11.2 MBytes  93.8 Mbits/sec    0    103 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   113 MBytes  94.4 Mbits/sec    0             sender
[  5]   0.00-10.04  sec   112 MBytes  93.7 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.254 -R
Connecting to host 192.168.1.254, port 5201
Reverse mode, remote host 192.168.1.254 is sending
[  5] local 192.168.1.196 port 37544 connected to 192.168.1.254 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  10.8 MBytes  90.9 Mbits/sec                  
[  5]   1.00-2.00   sec  11.0 MBytes  92.0 Mbits/sec                  
[  5]   2.00-3.00   sec  11.0 MBytes  91.9 Mbits/sec                  
[  5]   3.00-4.00   sec  11.0 MBytes  92.3 Mbits/sec                  
[  5]   4.00-5.00   sec  10.9 MBytes  91.7 Mbits/sec                  
[  5]   5.00-6.00   sec  11.1 MBytes  92.7 Mbits/sec                  
[  5]   6.00-7.00   sec  10.9 MBytes  91.4 Mbits/sec                  
[  5]   7.00-8.00   sec  11.0 MBytes  92.5 Mbits/sec                  
[  5]   8.00-9.00   sec  11.0 MBytes  92.2 Mbits/sec                  
[  5]   9.00-10.00  sec  11.0 MBytes  92.0 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.03  sec   110 MBytes  91.9 Mbits/sec  116             sender
[  5]   0.00-10.00  sec   110 MBytes  92.0 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.254 -u -b 150M
Connecting to host 192.168.1.254, port 5201
[  5] local 192.168.1.196 port 46587 connected to 192.168.1.254 port 5201
[ ID] Interval           Transfer     Bitrate         Total Datagrams
[  5]   0.00-1.00   sec  11.5 MBytes  96.1 Mbits/sec  8297  
[  5]   1.00-2.00   sec  11.4 MBytes  95.6 Mbits/sec  8256  
[  5]   2.00-3.00   sec  11.4 MBytes  95.6 Mbits/sec  8256  
[  5]   3.00-4.00   sec  11.4 MBytes  95.6 Mbits/sec  8257  
[  5]   4.00-5.00   sec  11.4 MBytes  95.6 Mbits/sec  8256  
[  5]   5.00-6.00   sec  11.4 MBytes  95.6 Mbits/sec  8252  
[  5]   6.00-7.00   sec  11.4 MBytes  95.6 Mbits/sec  8256  
[  5]   7.00-8.00   sec  11.4 MBytes  95.6 Mbits/sec  8257  
[  5]   8.00-9.00   sec  11.4 MBytes  95.6 Mbits/sec  8256  
[  5]   9.00-10.00  sec  11.4 MBytes  95.6 Mbits/sec  8256  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-10.00  sec   114 MBytes  95.7 Mbits/sec  0.000 ms  0/82599 (0%)  sender
[  5]   0.00-10.05  sec  90.4 MBytes  75.5 Mbits/sec  0.054 ms  17083/82525 (21%)  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.254 -u -b 150M -R
Connecting to host 192.168.1.254, port 5201
Reverse mode, remote host 192.168.1.254 is sending
[  5] local 192.168.1.196 port 58358 connected to 192.168.1.254 port 5201
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-1.00   sec  5.64 MBytes  47.3 Mbits/sec  0.023 ms  57/4144 (1.4%)  
[  5]   1.00-2.00   sec  5.51 MBytes  46.2 Mbits/sec  0.024 ms  0/3988 (0%)  
[  5]   2.00-3.00   sec  5.51 MBytes  46.2 Mbits/sec  0.048 ms  0/3987 (0%)  
[  5]   3.00-4.00   sec  5.51 MBytes  46.2 Mbits/sec  0.016 ms  0/3990 (0%)  
[  5]   4.00-5.00   sec  5.51 MBytes  46.2 Mbits/sec  0.023 ms  0/3987 (0%)  
[  5]   5.00-6.00   sec  5.50 MBytes  46.2 Mbits/sec  0.033 ms  0/3986 (0%)  
[  5]   6.00-7.00   sec  4.55 MBytes  38.2 Mbits/sec  0.030 ms  0/3294 (0%)  
[  5]   7.00-8.00   sec  4.01 MBytes  33.7 Mbits/sec  0.026 ms  0/2907 (0%)  
[  5]   8.00-9.00   sec  4.25 MBytes  35.6 Mbits/sec  0.034 ms  0/3077 (0%)  
[  5]   9.00-10.00  sec  4.51 MBytes  37.8 Mbits/sec  0.026 ms  0/3265 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-10.04  sec  50.6 MBytes  42.3 Mbits/sec  0.000 ms  0/36628 (0%)  sender
[  5]   0.00-10.00  sec  50.5 MBytes  42.4 Mbits/sec  0.026 ms  57/36625 (0.16%)  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.254 -u -b 500M
Connecting to host 192.168.1.254, port 5201
[  5] local 192.168.1.196 port 48251 connected to 192.168.1.254 port 5201
[ ID] Interval           Transfer     Bitrate         Total Datagrams
[  5]   0.00-1.00   sec  11.5 MBytes  96.1 Mbits/sec  8297  
[  5]   1.00-2.00   sec  11.4 MBytes  95.6 Mbits/sec  8256  
[  5]   2.00-3.00   sec  11.4 MBytes  95.6 Mbits/sec  8256  
[  5]   3.00-4.00   sec  11.4 MBytes  95.6 Mbits/sec  8253  
[  5]   4.00-5.00   sec  11.4 MBytes  95.6 Mbits/sec  8257  
[  5]   5.00-6.00   sec  11.4 MBytes  95.6 Mbits/sec  8256  
[  5]   6.00-7.00   sec  11.4 MBytes  95.6 Mbits/sec  8256  
[  5]   7.00-8.00   sec  11.4 MBytes  95.6 Mbits/sec  8252  
[  5]   8.00-9.00   sec  11.4 MBytes  95.6 Mbits/sec  8257  
[  5]   9.00-10.00  sec  11.4 MBytes  95.6 Mbits/sec  8256  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-10.00  sec   114 MBytes  95.7 Mbits/sec  0.000 ms  0/82596 (0%)  sender
[  5]   0.00-10.05  sec  88.7 MBytes  74.1 Mbits/sec  0.058 ms  18285/82522 (22%)  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.254 -u -b 500M -R
Connecting to host 192.168.1.254, port 5201
Reverse mode, remote host 192.168.1.254 is sending
[  5] local 192.168.1.196 port 52269 connected to 192.168.1.254 port 5201
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-1.00   sec  5.64 MBytes  47.3 Mbits/sec  0.026 ms  56/4139 (1.4%)  
[  5]   1.00-2.00   sec  5.50 MBytes  46.1 Mbits/sec  0.016 ms  0/3981 (0%)  
[  5]   2.00-3.00   sec  5.51 MBytes  46.2 Mbits/sec  0.022 ms  0/3988 (0%)  
[  5]   3.00-4.00   sec  5.51 MBytes  46.2 Mbits/sec  0.013 ms  0/3988 (0%)  
[  5]   4.00-5.00   sec  5.50 MBytes  46.2 Mbits/sec  0.013 ms  0/3986 (0%)  
[  5]   5.00-6.00   sec  5.51 MBytes  46.2 Mbits/sec  0.015 ms  0/3989 (0%)  
[  5]   6.00-7.00   sec  5.51 MBytes  46.2 Mbits/sec  0.020 ms  0/3988 (0%)  
[  5]   7.00-8.00   sec  5.50 MBytes  46.2 Mbits/sec  0.016 ms  0/3985 (0%)  
[  5]   8.00-9.00   sec  5.51 MBytes  46.2 Mbits/sec  0.015 ms  0/3990 (0%)  
[  5]   9.00-10.00  sec  5.49 MBytes  46.0 Mbits/sec  0.015 ms  0/3972 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-10.04  sec  55.2 MBytes  46.2 Mbits/sec  0.000 ms  0/40009 (0%)  sender
[  5]   0.00-10.00  sec  55.2 MBytes  46.3 Mbits/sec  0.015 ms  56/40006 (0.14%)  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.254 -u -b 1000M
Connecting to host 192.168.1.254, port 5201
[  5] local 192.168.1.196 port 42558 connected to 192.168.1.254 port 5201
[ ID] Interval           Transfer     Bitrate         Total Datagrams
[  5]   0.00-1.00   sec  11.5 MBytes  96.1 Mbits/sec  8296  
[  5]   1.00-2.00   sec  11.4 MBytes  95.6 Mbits/sec  8257  
[  5]   2.00-3.00   sec  11.4 MBytes  95.6 Mbits/sec  8256  
[  5]   3.00-4.00   sec  11.4 MBytes  95.4 Mbits/sec  8235  
[  5]   4.00-5.00   sec  11.4 MBytes  95.6 Mbits/sec  8256  
[  5]   5.00-6.00   sec  11.4 MBytes  95.6 Mbits/sec  8256  
[  5]   6.00-7.00   sec  11.4 MBytes  95.6 Mbits/sec  8256  
[  5]   7.00-8.00   sec  11.4 MBytes  95.6 Mbits/sec  8257  
[  5]   8.00-9.00   sec  11.4 MBytes  95.6 Mbits/sec  8256  
[  5]   9.00-10.00  sec  11.4 MBytes  95.6 Mbits/sec  8256  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-10.00  sec   114 MBytes  95.7 Mbits/sec  0.000 ms  0/82581 (0%)  sender
[  5]   0.00-10.05  sec  92.6 MBytes  77.3 Mbits/sec  0.063 ms  15450/82509 (19%)  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.254 -u -b 1000M -R
Connecting to host 192.168.1.254, port 5201
Reverse mode, remote host 192.168.1.254 is sending
[  5] local 192.168.1.196 port 52681 connected to 192.168.1.254 port 5201
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-1.00   sec  5.64 MBytes  47.3 Mbits/sec  0.019 ms  55/4139 (1.3%)  
[  5]   1.00-2.00   sec  5.51 MBytes  46.2 Mbits/sec  0.015 ms  0/3988 (0%)  
[  5]   2.00-3.00   sec  5.51 MBytes  46.2 Mbits/sec  0.022 ms  0/3990 (0%)  
[  5]   3.00-4.00   sec  5.50 MBytes  46.1 Mbits/sec  0.038 ms  0/3984 (0%)  
[  5]   4.00-5.00   sec  5.51 MBytes  46.2 Mbits/sec  0.012 ms  0/3991 (0%)  
[  5]   5.00-6.00   sec  5.51 MBytes  46.2 Mbits/sec  0.026 ms  0/3988 (0%)  
[  5]   6.00-7.00   sec  5.50 MBytes  46.2 Mbits/sec  0.024 ms  0/3984 (0%)  
[  5]   7.00-8.00   sec  5.51 MBytes  46.2 Mbits/sec  0.027 ms  0/3990 (0%)  
[  5]   8.00-9.00   sec  5.51 MBytes  46.2 Mbits/sec  0.030 ms  0/3991 (0%)  
[  5]   9.00-10.00  sec  5.51 MBytes  46.2 Mbits/sec  0.017 ms  0/3987 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-10.04  sec  55.3 MBytes  46.2 Mbits/sec  0.000 ms  0/40034 (0%)  sender
[  5]   0.00-10.00  sec  55.2 MBytes  46.3 Mbits/sec  0.017 ms  55/40032 (0.14%)  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.254 -P3
Connecting to host 192.168.1.254, port 5201
[  5] local 192.168.1.196 port 37562 connected to 192.168.1.254 port 5201
[  7] local 192.168.1.196 port 37564 connected to 192.168.1.254 port 5201
[  9] local 192.168.1.196 port 37566 connected to 192.168.1.254 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  4.28 MBytes  35.9 Mbits/sec    3   53.7 KBytes       
[  7]   0.00-1.00   sec  4.09 MBytes  34.3 Mbits/sec    2   50.9 KBytes       
[  9]   0.00-1.00   sec  2.97 MBytes  24.9 Mbits/sec    3   33.9 KBytes       
[SUM]   0.00-1.00   sec  11.3 MBytes  95.1 Mbits/sec    8             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  4.29 MBytes  36.0 Mbits/sec    0   53.7 KBytes       
[  7]   1.00-2.00   sec  4.29 MBytes  36.0 Mbits/sec    0   50.9 KBytes       
[  9]   1.00-2.00   sec  2.61 MBytes  21.9 Mbits/sec    0   33.9 KBytes       
[SUM]   1.00-2.00   sec  11.2 MBytes  93.8 Mbits/sec    0             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  4.47 MBytes  37.5 Mbits/sec    0   53.7 KBytes       
[  7]   2.00-3.00   sec  4.10 MBytes  34.4 Mbits/sec    0   50.9 KBytes       
[  9]   2.00-3.00   sec  2.61 MBytes  21.9 Mbits/sec    0   33.9 KBytes       
[SUM]   2.00-3.00   sec  11.2 MBytes  93.8 Mbits/sec    0             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  4.47 MBytes  37.5 Mbits/sec    0   53.7 KBytes       
[  7]   3.00-4.00   sec  4.29 MBytes  36.0 Mbits/sec    0   50.9 KBytes       
[  9]   3.00-4.00   sec  2.42 MBytes  20.3 Mbits/sec    0   33.9 KBytes       
[SUM]   3.00-4.00   sec  11.2 MBytes  93.8 Mbits/sec    0             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  4.47 MBytes  37.5 Mbits/sec    0   53.7 KBytes       
[  7]   4.00-5.00   sec  4.29 MBytes  36.0 Mbits/sec    0   50.9 KBytes       
[  9]   4.00-5.00   sec  2.61 MBytes  21.9 Mbits/sec    0   33.9 KBytes       
[SUM]   4.00-5.00   sec  11.4 MBytes  95.4 Mbits/sec    0             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   5.00-6.00   sec  4.47 MBytes  37.5 Mbits/sec    0   53.7 KBytes       
[  7]   5.00-6.00   sec  4.10 MBytes  34.4 Mbits/sec    0   50.9 KBytes       
[  9]   5.00-6.00   sec  2.42 MBytes  20.3 Mbits/sec    0   33.9 KBytes       
[SUM]   5.00-6.00   sec  11.0 MBytes  92.3 Mbits/sec    0             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   6.00-7.00   sec  4.47 MBytes  37.5 Mbits/sec    0   53.7 KBytes       
[  7]   6.00-7.00   sec  4.29 MBytes  36.0 Mbits/sec    0   50.9 KBytes       
[  9]   6.00-7.00   sec  2.61 MBytes  21.9 Mbits/sec    0   33.9 KBytes       
[SUM]   6.00-7.00   sec  11.4 MBytes  95.4 Mbits/sec    0             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   7.00-8.00   sec  4.29 MBytes  36.0 Mbits/sec    0   53.7 KBytes       
[  7]   7.00-8.00   sec  4.29 MBytes  36.0 Mbits/sec    0   50.9 KBytes       
[  9]   7.00-8.00   sec  2.61 MBytes  21.9 Mbits/sec    0   33.9 KBytes       
[SUM]   7.00-8.00   sec  11.2 MBytes  93.8 Mbits/sec    0             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   8.00-9.00   sec  4.47 MBytes  37.5 Mbits/sec    0   53.7 KBytes       
[  7]   8.00-9.00   sec  4.10 MBytes  34.4 Mbits/sec    0   50.9 KBytes       
[  9]   8.00-9.00   sec  2.61 MBytes  21.9 Mbits/sec    0   33.9 KBytes       
[SUM]   8.00-9.00   sec  11.2 MBytes  93.8 Mbits/sec    0             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   9.00-10.00  sec  3.98 MBytes  33.4 Mbits/sec   40   60.8 KBytes       
[  7]   9.00-10.00  sec  4.23 MBytes  35.4 Mbits/sec   27   65.0 KBytes       
[  9]   9.00-10.00  sec  2.98 MBytes  25.0 Mbits/sec   18   59.4 KBytes       
[SUM]   9.00-10.00  sec  11.2 MBytes  93.8 Mbits/sec   85             
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  43.7 MBytes  36.6 Mbits/sec   43             sender
[  5]   0.00-10.02  sec  43.0 MBytes  36.0 Mbits/sec                  receiver
[  7]   0.00-10.00  sec  42.1 MBytes  35.3 Mbits/sec   29             sender
[  7]   0.00-10.02  sec  41.4 MBytes  34.7 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  26.5 MBytes  22.2 Mbits/sec   21             sender
[  9]   0.00-10.02  sec  26.1 MBytes  21.9 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec   112 MBytes  94.1 Mbits/sec   93             sender
[SUM]   0.00-10.02  sec   111 MBytes  92.6 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.254 -P3 -R
Connecting to host 192.168.1.254, port 5201
Reverse mode, remote host 192.168.1.254 is sending
[  5] local 192.168.1.196 port 37570 connected to 192.168.1.254 port 5201
[  7] local 192.168.1.196 port 37572 connected to 192.168.1.254 port 5201
[  9] local 192.168.1.196 port 37574 connected to 192.168.1.254 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  2.97 MBytes  24.9 Mbits/sec                  
[  7]   0.00-1.00   sec  4.74 MBytes  39.7 Mbits/sec                  
[  9]   0.00-1.00   sec  3.24 MBytes  27.1 Mbits/sec                  
[SUM]   0.00-1.00   sec  10.9 MBytes  91.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  4.12 MBytes  34.5 Mbits/sec                  
[  7]   1.00-2.00   sec  3.79 MBytes  31.8 Mbits/sec                  
[  9]   1.00-2.00   sec  2.97 MBytes  24.9 Mbits/sec                  
[SUM]   1.00-2.00   sec  10.9 MBytes  91.3 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  4.18 MBytes  35.0 Mbits/sec                  
[  7]   2.00-3.00   sec  4.32 MBytes  36.2 Mbits/sec                  
[  9]   2.00-3.00   sec  2.32 MBytes  19.5 Mbits/sec                  
[SUM]   2.00-3.00   sec  10.8 MBytes  90.8 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  4.51 MBytes  37.9 Mbits/sec                  
[  7]   3.00-4.00   sec  2.76 MBytes  23.2 Mbits/sec                  
[  9]   3.00-4.00   sec  3.62 MBytes  30.3 Mbits/sec                  
[SUM]   3.00-4.00   sec  10.9 MBytes  91.4 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  4.55 MBytes  38.1 Mbits/sec                  
[  7]   4.00-5.00   sec  3.10 MBytes  26.0 Mbits/sec                  
[  9]   4.00-5.00   sec  3.30 MBytes  27.7 Mbits/sec                  
[SUM]   4.00-5.00   sec  11.0 MBytes  91.9 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   5.00-6.00   sec  3.95 MBytes  33.2 Mbits/sec                  
[  7]   5.00-6.00   sec  3.09 MBytes  25.9 Mbits/sec                  
[  9]   5.00-6.00   sec  3.81 MBytes  31.9 Mbits/sec                  
[SUM]   5.00-6.00   sec  10.8 MBytes  91.0 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   6.00-7.00   sec  4.27 MBytes  35.8 Mbits/sec                  
[  7]   6.00-7.00   sec  3.38 MBytes  28.4 Mbits/sec                  
[  9]   6.00-7.00   sec  3.25 MBytes  27.2 Mbits/sec                  
[SUM]   6.00-7.00   sec  10.9 MBytes  91.4 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   7.00-8.00   sec  4.45 MBytes  37.3 Mbits/sec                  
[  7]   7.00-8.00   sec  3.02 MBytes  25.3 Mbits/sec                  
[  9]   7.00-8.00   sec  3.39 MBytes  28.4 Mbits/sec                  
[SUM]   7.00-8.00   sec  10.9 MBytes  91.1 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   8.00-9.00   sec  5.18 MBytes  43.4 Mbits/sec                  
[  7]   8.00-9.00   sec  2.47 MBytes  20.7 Mbits/sec                  
[  9]   8.00-9.00   sec  3.23 MBytes  27.1 Mbits/sec                  
[SUM]   8.00-9.00   sec  10.9 MBytes  91.2 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   9.00-10.00  sec  4.46 MBytes  37.4 Mbits/sec                  
[  7]   9.00-10.00  sec  2.72 MBytes  22.8 Mbits/sec                  
[  9]   9.00-10.00  sec  3.78 MBytes  31.7 Mbits/sec                  
[SUM]   9.00-10.00  sec  11.0 MBytes  91.9 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.02  sec  42.8 MBytes  35.8 Mbits/sec  121             sender
[  5]   0.00-10.00  sec  42.6 MBytes  35.8 Mbits/sec                  receiver
[  7]   0.00-10.02  sec  33.6 MBytes  28.1 Mbits/sec  122             sender
[  7]   0.00-10.00  sec  33.4 MBytes  28.0 Mbits/sec                  receiver
[  9]   0.00-10.02  sec  33.0 MBytes  27.6 Mbits/sec  119             sender
[  9]   0.00-10.00  sec  32.9 MBytes  27.6 Mbits/sec                  receiver
[SUM]   0.00-10.02  sec   109 MBytes  91.6 Mbits/sec  362             sender
[SUM]   0.00-10.00  sec   109 MBytes  91.4 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.254 -P3 -u -b 800M
Connecting to host 192.168.1.254, port 5201
[  5] local 192.168.1.196 port 46712 connected to 192.168.1.254 port 5201
[  7] local 192.168.1.196 port 49130 connected to 192.168.1.254 port 5201
[  9] local 192.168.1.196 port 58384 connected to 192.168.1.254 port 5201
[ ID] Interval           Transfer     Bitrate         Total Datagrams
[  5]   0.00-1.00   sec  3.89 MBytes  32.7 Mbits/sec  2820  
[  7]   0.00-1.00   sec  3.89 MBytes  32.7 Mbits/sec  2820  
[  9]   0.00-1.00   sec  3.89 MBytes  32.7 Mbits/sec  2819  
[SUM]   0.00-1.00   sec  11.7 MBytes  98.0 Mbits/sec  8459  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  3.91 MBytes  32.8 Mbits/sec  2828  
[  7]   1.00-2.00   sec  3.90 MBytes  32.8 Mbits/sec  2827  
[  9]   1.00-2.00   sec  3.91 MBytes  32.8 Mbits/sec  2828  
[SUM]   1.00-2.00   sec  11.7 MBytes  98.3 Mbits/sec  8483  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  3.98 MBytes  33.4 Mbits/sec  2880  
[  7]   2.00-3.00   sec  3.98 MBytes  33.4 Mbits/sec  2881  
[  9]   2.00-3.00   sec  3.98 MBytes  33.4 Mbits/sec  2880  
[SUM]   2.00-3.00   sec  11.9 MBytes   100 Mbits/sec  8641  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  4.05 MBytes  33.9 Mbits/sec  2930  
[  7]   3.00-4.00   sec  4.05 MBytes  33.9 Mbits/sec  2930  
[  9]   3.00-4.00   sec  4.05 MBytes  33.9 Mbits/sec  2930  
[SUM]   3.00-4.00   sec  12.1 MBytes   102 Mbits/sec  8790  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  4.12 MBytes  34.5 Mbits/sec  2981  
[  7]   4.00-5.00   sec  4.12 MBytes  34.5 Mbits/sec  2980  
[  9]   4.00-5.00   sec  4.12 MBytes  34.5 Mbits/sec  2981  
[SUM]   4.00-5.00   sec  12.3 MBytes   104 Mbits/sec  8942  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   5.00-6.00   sec  4.18 MBytes  35.1 Mbits/sec  3030  
[  7]   5.00-6.00   sec  4.18 MBytes  35.1 Mbits/sec  3030  
[  9]   5.00-6.00   sec  4.18 MBytes  35.1 Mbits/sec  3030  
[SUM]   5.00-6.00   sec  12.6 MBytes   105 Mbits/sec  9090  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   6.00-7.00   sec  4.25 MBytes  35.7 Mbits/sec  3080  
[  7]   6.00-7.00   sec  4.25 MBytes  35.7 Mbits/sec  3081  
[  9]   6.00-7.00   sec  4.25 MBytes  35.7 Mbits/sec  3080  
[SUM]   6.00-7.00   sec  12.8 MBytes   107 Mbits/sec  9241  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   7.00-8.00   sec  4.32 MBytes  36.3 Mbits/sec  3131  
[  7]   7.00-8.00   sec  4.32 MBytes  36.3 Mbits/sec  3130  
[  9]   7.00-8.00   sec  4.32 MBytes  36.3 Mbits/sec  3131  
[SUM]   7.00-8.00   sec  13.0 MBytes   109 Mbits/sec  9392  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   8.00-9.00   sec  4.32 MBytes  36.3 Mbits/sec  3131  
[  7]   8.00-9.00   sec  4.33 MBytes  36.3 Mbits/sec  3132  
[  9]   8.00-9.00   sec  4.32 MBytes  36.3 Mbits/sec  3131  
[SUM]   8.00-9.00   sec  13.0 MBytes   109 Mbits/sec  9394  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   9.00-10.00  sec  4.45 MBytes  37.4 Mbits/sec  3225  
[  7]   9.00-10.00  sec  4.45 MBytes  37.4 Mbits/sec  3225  
[  9]   9.00-10.00  sec  4.45 MBytes  37.4 Mbits/sec  3225  
[SUM]   9.00-10.00  sec  13.4 MBytes   112 Mbits/sec  9675  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-10.00  sec  41.5 MBytes  34.8 Mbits/sec  0.000 ms  0/30036 (0%)  sender
[  5]   0.00-10.04  sec  38.0 MBytes  31.7 Mbits/sec  0.111 ms  2483/30005 (8.3%)  receiver
[  7]   0.00-10.00  sec  41.5 MBytes  34.8 Mbits/sec  0.000 ms  0/30036 (0%)  sender
[  7]   0.00-10.04  sec  38.0 MBytes  31.7 Mbits/sec  0.079 ms  2483/30004 (8.3%)  receiver
[  9]   0.00-10.00  sec  41.5 MBytes  34.8 Mbits/sec  0.000 ms  0/30035 (0%)  sender
[  9]   0.00-10.04  sec  38.0 MBytes  31.7 Mbits/sec  0.099 ms  2483/30004 (8.3%)  receiver
[SUM]   0.00-10.00  sec   124 MBytes   104 Mbits/sec  0.000 ms  0/90107 (0%)  sender
[SUM]   0.00-10.04  sec   114 MBytes  95.2 Mbits/sec  0.096 ms  7449/90013 (8.3%)  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.254 -P3 -R -u -b 800M
Connecting to host 192.168.1.254, port 5201
Reverse mode, remote host 192.168.1.254 is sending
[  5] local 192.168.1.196 port 53946 connected to 192.168.1.254 port 5201
[  7] local 192.168.1.196 port 42308 connected to 192.168.1.254 port 5201
[  9] local 192.168.1.196 port 34841 connected to 192.168.1.254 port 5201
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-1.00   sec  2.09 MBytes  17.5 Mbits/sec  0.027 ms  0/1515 (0%)  
[  7]   0.00-1.00   sec  2.09 MBytes  17.5 Mbits/sec  0.014 ms  0/1515 (0%)  
[  9]   0.00-1.00   sec  2.09 MBytes  17.5 Mbits/sec  0.018 ms  0/1513 (0%)  
[SUM]   0.00-1.00   sec  6.27 MBytes  52.6 Mbits/sec  0.020 ms  0/4543 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  2.02 MBytes  17.0 Mbits/sec  0.022 ms  0/1464 (0%)  
[  7]   1.00-2.00   sec  2.02 MBytes  16.9 Mbits/sec  0.017 ms  0/1463 (0%)  
[  9]   1.00-2.00   sec  2.02 MBytes  17.0 Mbits/sec  0.021 ms  0/1464 (0%)  
[SUM]   1.00-2.00   sec  6.06 MBytes  50.9 Mbits/sec  0.020 ms  0/4391 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  2.02 MBytes  16.9 Mbits/sec  0.017 ms  0/1462 (0%)  
[  7]   2.00-3.00   sec  2.02 MBytes  16.9 Mbits/sec  0.023 ms  0/1463 (0%)  
[  9]   2.00-3.00   sec  2.02 MBytes  16.9 Mbits/sec  0.026 ms  0/1462 (0%)  
[SUM]   2.00-3.00   sec  6.06 MBytes  50.8 Mbits/sec  0.022 ms  0/4387 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  2.02 MBytes  17.0 Mbits/sec  0.021 ms  0/1465 (0%)  
[  7]   3.00-4.00   sec  2.02 MBytes  17.0 Mbits/sec  0.023 ms  0/1465 (0%)  
[  9]   3.00-4.00   sec  2.02 MBytes  17.0 Mbits/sec  0.022 ms  0/1465 (0%)  
[SUM]   3.00-4.00   sec  6.07 MBytes  50.9 Mbits/sec  0.022 ms  0/4395 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  2.02 MBytes  17.0 Mbits/sec  0.012 ms  0/1464 (0%)  
[  7]   4.00-5.00   sec  2.02 MBytes  17.0 Mbits/sec  0.017 ms  0/1464 (0%)  
[  9]   4.00-5.00   sec  2.02 MBytes  17.0 Mbits/sec  0.015 ms  0/1464 (0%)  
[SUM]   4.00-5.00   sec  6.07 MBytes  50.9 Mbits/sec  0.015 ms  0/4392 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   5.00-6.00   sec  2.02 MBytes  16.9 Mbits/sec  0.012 ms  0/1463 (0%)  
[  7]   5.00-6.00   sec  2.02 MBytes  16.9 Mbits/sec  0.020 ms  0/1463 (0%)  
[  9]   5.00-6.00   sec  2.02 MBytes  17.0 Mbits/sec  0.016 ms  0/1464 (0%)  
[SUM]   5.00-6.00   sec  6.06 MBytes  50.9 Mbits/sec  0.016 ms  0/4390 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   6.00-7.00   sec  2.02 MBytes  17.0 Mbits/sec  0.022 ms  0/1465 (0%)  
[  7]   6.00-7.00   sec  2.02 MBytes  17.0 Mbits/sec  0.018 ms  0/1465 (0%)  
[  9]   6.00-7.00   sec  2.02 MBytes  17.0 Mbits/sec  0.015 ms  0/1465 (0%)  
[SUM]   6.00-7.00   sec  6.07 MBytes  50.9 Mbits/sec  0.019 ms  0/4395 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   7.00-8.00   sec  2.02 MBytes  17.0 Mbits/sec  0.019 ms  0/1465 (0%)  
[  7]   7.00-8.00   sec  2.02 MBytes  17.0 Mbits/sec  0.018 ms  0/1465 (0%)  
[  9]   7.00-8.00   sec  2.02 MBytes  17.0 Mbits/sec  0.039 ms  0/1465 (0%)  
[SUM]   7.00-8.00   sec  6.07 MBytes  50.9 Mbits/sec  0.025 ms  0/4395 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   8.00-9.00   sec  2.01 MBytes  16.9 Mbits/sec  0.015 ms  0/1456 (0%)  
[  7]   8.00-9.00   sec  2.01 MBytes  16.9 Mbits/sec  0.019 ms  0/1456 (0%)  
[  9]   8.00-9.00   sec  2.01 MBytes  16.9 Mbits/sec  0.027 ms  0/1455 (0%)  
[SUM]   8.00-9.00   sec  6.03 MBytes  50.6 Mbits/sec  0.020 ms  0/4367 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   9.00-10.00  sec  2.02 MBytes  17.0 Mbits/sec  0.026 ms  0/1465 (0%)  
[  7]   9.00-10.00  sec  2.02 MBytes  17.0 Mbits/sec  0.024 ms  0/1464 (0%)  
[  9]   9.00-10.00  sec  2.02 MBytes  17.0 Mbits/sec  0.022 ms  0/1465 (0%)  
[SUM]   9.00-10.00  sec  6.07 MBytes  50.9 Mbits/sec  0.024 ms  0/4394 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-10.04  sec  20.3 MBytes  16.9 Mbits/sec  0.000 ms  0/14684 (0%)  sender
[  5]   0.00-10.00  sec  20.3 MBytes  17.0 Mbits/sec  0.026 ms  0/14684 (0%)  receiver
[  7]   0.00-10.04  sec  20.3 MBytes  16.9 Mbits/sec  0.000 ms  0/14684 (0%)  sender
[  7]   0.00-10.00  sec  20.3 MBytes  17.0 Mbits/sec  0.024 ms  0/14683 (0%)  receiver
[  9]   0.00-10.04  sec  20.3 MBytes  16.9 Mbits/sec  0.000 ms  0/14683 (0%)  sender
[  9]   0.00-10.00  sec  20.3 MBytes  17.0 Mbits/sec  0.022 ms  0/14682 (0%)  receiver
[SUM]   0.00-10.04  sec  60.8 MBytes  50.8 Mbits/sec  0.000 ms  0/44051 (0%)  sender
[SUM]   0.00-10.00  sec  60.8 MBytes  51.0 Mbits/sec  0.024 ms  0/44049 (0%)  receiver

iperf Done.

I am not sure if my Laptop port is faulty because I tried two different wires. As my laptop only has one 100M port, I am not able to test more but I used one 100M cabe (4 wires) and 1G cable (8 wires) with same results as above. If there are any more tests I am happy to help.

2 Likes

I also ran some tests on WiFi and I am actually really happy with the overall performance on 2.4GHz but I have some concerns because while downloading data the speed kind of gets dropped very low and then goes up and keeps repeating this behavior. Is it because of CPU limit?

This behavior is also observable from iperf but I also copied a file from HDD to my Laptop and I was able to get around 11mb/s but it would drop to around 1mb/s after a few seconds and then would go back up. Also the packet loss?

Wifi Test
PS C:\Users\pakah\Downloads\iperf-3.1.3-win64> ./iperf3 -c 192.168.1.254 -t 60 -u -b 0
Connecting to host 192.168.1.254, port 5201
[  4] local 192.168.1.101 port 56834 connected to 192.168.1.254 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  11.3 MBytes  94.7 Mbits/sec  1450
[  4]   1.00-2.00   sec  12.3 MBytes   103 Mbits/sec  1580
[  4]   2.00-3.00   sec  11.8 MBytes  99.3 Mbits/sec  1510
[  4]   3.00-4.00   sec  13.2 MBytes   111 Mbits/sec  1690
[  4]   4.00-5.00   sec  12.9 MBytes   108 Mbits/sec  1650
[  4]   5.00-6.00   sec  13.1 MBytes   110 Mbits/sec  1680
[  4]   6.00-7.00   sec  12.3 MBytes   104 Mbits/sec  1580
[  4]   7.00-8.01   sec  12.6 MBytes   105 Mbits/sec  1610
[  4]   8.01-9.01   sec  12.9 MBytes   108 Mbits/sec  1650
[  4]   9.01-10.00  sec  13.0 MBytes   110 Mbits/sec  1670
[  4]  10.00-11.00  sec  13.0 MBytes   110 Mbits/sec  1670
[  4]  11.00-12.01  sec  12.9 MBytes   107 Mbits/sec  1650
[  4]  12.01-13.00  sec  12.9 MBytes   109 Mbits/sec  1650
[  4]  13.00-14.08  sec  11.2 MBytes  86.8 Mbits/sec  1430
[  4]  14.08-15.03  sec  6.48 MBytes  57.4 Mbits/sec  830
[  4]  15.03-16.02  sec  6.95 MBytes  58.9 Mbits/sec  890
[  4]  16.02-17.02  sec  2.42 MBytes  20.3 Mbits/sec  310
[  4]  17.02-18.06  sec  2.27 MBytes  18.2 Mbits/sec  290
[  4]  18.06-19.17  sec   800 KBytes  5.94 Mbits/sec  100
[  4]  19.17-20.00  sec  3.83 MBytes  38.4 Mbits/sec  490
[  4]  20.00-21.00  sec  12.4 MBytes   105 Mbits/sec  1590
[  4]  21.00-22.01  sec  12.9 MBytes   108 Mbits/sec  1650
[  4]  22.01-23.00  sec  12.6 MBytes   106 Mbits/sec  1610
[  4]  23.00-24.00  sec  12.6 MBytes   105 Mbits/sec  1610
[  4]  24.00-25.01  sec  13.1 MBytes   110 Mbits/sec  1680
[  4]  25.01-26.00  sec  13.3 MBytes   112 Mbits/sec  1700
[  4]  26.00-27.00  sec  12.4 MBytes   104 Mbits/sec  1590
[  4]  27.00-28.00  sec  12.8 MBytes   108 Mbits/sec  1640
[  4]  28.00-29.00  sec  11.9 MBytes  99.8 Mbits/sec  1520
[  4]  29.00-30.00  sec  11.9 MBytes  99.3 Mbits/sec  1520
[  4]  30.00-31.00  sec  12.5 MBytes   105 Mbits/sec  1600
[  4]  31.00-32.00  sec  12.4 MBytes   104 Mbits/sec  1590
[  4]  32.00-33.01  sec  11.0 MBytes  91.9 Mbits/sec  1410
[  4]  33.01-34.00  sec  6.80 MBytes  57.5 Mbits/sec  870
[  4]  34.00-35.00  sec  5.08 MBytes  42.4 Mbits/sec  650
[  4]  35.00-36.00  sec  7.81 MBytes  65.6 Mbits/sec  1000
[  4]  36.00-37.01  sec  7.50 MBytes  62.5 Mbits/sec  960
[  4]  37.01-38.04  sec  6.56 MBytes  53.5 Mbits/sec  840
[  4]  38.04-39.00  sec  7.03 MBytes  61.3 Mbits/sec  900
[  4]  39.00-40.04  sec  5.94 MBytes  48.1 Mbits/sec  760
[  4]  40.04-41.00  sec  8.59 MBytes  74.8 Mbits/sec  1100
[  4]  41.00-42.01  sec  12.1 MBytes   101 Mbits/sec  1550
[  4]  42.01-43.01  sec  12.4 MBytes   104 Mbits/sec  1590
[  4]  43.01-44.00  sec  12.0 MBytes   100 Mbits/sec  1530
[  4]  44.00-45.01  sec  9.77 MBytes  81.7 Mbits/sec  1250
[  4]  45.01-46.00  sec  9.38 MBytes  79.0 Mbits/sec  1200
[  4]  46.00-47.00  sec  8.83 MBytes  74.2 Mbits/sec  1130
[  4]  47.00-48.02  sec  5.62 MBytes  46.1 Mbits/sec  720
[  4]  48.02-49.02  sec  6.88 MBytes  57.8 Mbits/sec  880
[  4]  49.02-50.00  sec  4.14 MBytes  35.3 Mbits/sec  530
[  4]  50.00-51.17  sec  6.17 MBytes  44.4 Mbits/sec  790
[  4]  51.17-52.00  sec  5.00 MBytes  50.2 Mbits/sec  640
[  4]  52.00-53.01  sec  2.97 MBytes  24.7 Mbits/sec  380
[  4]  53.01-54.11  sec  1.25 MBytes  9.58 Mbits/sec  160
[  4]  54.11-55.00  sec  2.19 MBytes  20.4 Mbits/sec  280
[  4]  55.00-56.06  sec  2.81 MBytes  22.4 Mbits/sec  360
[  4]  56.06-57.01  sec  3.52 MBytes  31.1 Mbits/sec  450
[  4]  57.01-58.06  sec  2.89 MBytes  23.1 Mbits/sec  370
[  4]  58.06-59.00  sec   240 KBytes  2.08 Mbits/sec  30
[  4]  59.00-60.00  sec  5.31 MBytes  44.6 Mbits/sec  680
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-60.00  sec   529 MBytes  73.9 Mbits/sec  0.944 ms  2168/67689 (3.2%)
[  4] Sent 67689 datagrams

iperf Done.
PS C:\Users\pakah\Downloads\iperf-3.1.3-win64> ./iperf3 -c 192.168.1.254 -t 60 -u -b 0 -R
Connecting to host 192.168.1.254, port 5201
Reverse mode, remote host 192.168.1.254 is sending
[  4] local 192.168.1.101 port 52098 connected to 192.168.1.254 port 5201
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-1.00   sec  12.5 MBytes   105 Mbits/sec  0.623 ms  41/1641 (2.5%)
[  4]   1.00-2.00   sec  12.9 MBytes   108 Mbits/sec  0.688 ms  0/1648 (0%)
[  4]   2.00-3.00   sec  12.3 MBytes   104 Mbits/sec  0.661 ms  0/1577 (0%)
[  4]   3.00-4.00   sec  12.9 MBytes   108 Mbits/sec  0.516 ms  0/1650 (0%)
[  4]   4.00-5.00   sec  12.7 MBytes   107 Mbits/sec  0.533 ms  0/1630 (0%)
[  4]   5.00-6.00   sec  12.2 MBytes   103 Mbits/sec  0.691 ms  0/1565 (0%)
[  4]   6.00-7.00   sec  12.6 MBytes   106 Mbits/sec  0.683 ms  0/1616 (0%)
[  4]   7.00-8.00   sec  12.8 MBytes   107 Mbits/sec  0.690 ms  0/1638 (0%)
[  4]   8.00-9.00   sec  12.1 MBytes   102 Mbits/sec  0.578 ms  0/1552 (0%)
[  4]   9.00-10.00  sec  12.5 MBytes   105 Mbits/sec  0.488 ms  0/1594 (0%)
[  4]  10.00-11.00  sec  12.3 MBytes   103 Mbits/sec  0.755 ms  0/1578 (0%)
[  4]  11.00-12.00  sec  12.2 MBytes   102 Mbits/sec  0.591 ms  0/1561 (0%)
[  4]  12.00-13.00  sec  12.5 MBytes   105 Mbits/sec  0.585 ms  0/1597 (0%)
[  4]  13.00-14.00  sec  12.7 MBytes   106 Mbits/sec  0.521 ms  0/1624 (0%)
[  4]  14.00-15.00  sec  12.7 MBytes   106 Mbits/sec  0.776 ms  0/1624 (0%)
[  4]  15.00-16.00  sec  12.6 MBytes   106 Mbits/sec  0.872 ms  0/1618 (0%)
[  4]  16.00-17.00  sec  12.6 MBytes   105 Mbits/sec  0.569 ms  0/1607 (0%)
[  4]  17.00-18.00  sec  12.9 MBytes   108 Mbits/sec  0.689 ms  0/1649 (0%)
[  4]  18.00-19.00  sec  12.6 MBytes   105 Mbits/sec  0.796 ms  0/1607 (0%)
[  4]  19.00-20.00  sec  12.7 MBytes   106 Mbits/sec  0.769 ms  0/1620 (0%)
[  4]  20.00-21.00  sec  12.1 MBytes   101 Mbits/sec  0.541 ms  0/1546 (0%)
[  4]  21.00-22.00  sec  12.6 MBytes   105 Mbits/sec  0.581 ms  0/1609 (0%)
[  4]  22.00-23.00  sec  12.5 MBytes   104 Mbits/sec  0.625 ms  0/1595 (0%)
[  4]  23.00-24.00  sec  12.3 MBytes   103 Mbits/sec  0.567 ms  0/1575 (0%)
[  4]  24.00-25.00  sec  12.7 MBytes   106 Mbits/sec  0.616 ms  0/1620 (0%)
[  4]  25.00-26.00  sec  12.1 MBytes   102 Mbits/sec  0.507 ms  0/1550 (0%)
[  4]  26.00-27.00  sec  12.2 MBytes   102 Mbits/sec  0.751 ms  0/1556 (0%)
[  4]  27.00-28.00  sec  12.6 MBytes   106 Mbits/sec  0.688 ms  0/1614 (0%)
[  4]  28.00-29.00  sec  12.3 MBytes   103 Mbits/sec  0.977 ms  0/1569 (0%)
[  4]  29.00-30.00  sec  12.6 MBytes   106 Mbits/sec  0.728 ms  0/1614 (0%)
[  4]  30.00-31.00  sec  12.7 MBytes   107 Mbits/sec  0.607 ms  0/1627 (0%)
[  4]  31.00-32.00  sec  12.2 MBytes   102 Mbits/sec  0.778 ms  0/1558 (0%)
[  4]  32.00-33.00  sec  11.7 MBytes  98.5 Mbits/sec  0.774 ms  0/1503 (0%)
[  4]  33.00-34.00  sec  12.7 MBytes   106 Mbits/sec  0.621 ms  0/1624 (0%)
[  4]  34.00-35.00  sec  12.1 MBytes   101 Mbits/sec  0.584 ms  0/1545 (0%)
[  4]  35.00-36.00  sec  12.7 MBytes   107 Mbits/sec  0.802 ms  0/1627 (0%)
[  4]  36.00-37.00  sec  12.3 MBytes   103 Mbits/sec  0.634 ms  0/1576 (0%)
[  4]  37.00-38.00  sec  12.3 MBytes   103 Mbits/sec  0.692 ms  0/1573 (0%)
[  4]  38.00-39.00  sec  12.6 MBytes   106 Mbits/sec  0.716 ms  0/1610 (0%)
[  4]  39.00-40.00  sec  12.2 MBytes   103 Mbits/sec  0.606 ms  0/1568 (0%)
[  4]  40.00-41.00  sec  12.7 MBytes   106 Mbits/sec  0.839 ms  0/1624 (0%)
[  4]  41.00-42.00  sec  12.7 MBytes   106 Mbits/sec  0.634 ms  0/1622 (0%)
[  4]  42.00-43.00  sec  12.7 MBytes   106 Mbits/sec  0.514 ms  0/1620 (0%)
[  4]  43.00-44.00  sec  11.5 MBytes  96.1 Mbits/sec  0.819 ms  0/1469 (0%)
[  4]  44.00-45.00  sec  12.3 MBytes   103 Mbits/sec  0.869 ms  4/1577 (0.25%)
[  4]  45.00-46.00  sec  12.1 MBytes   102 Mbits/sec  0.662 ms  0/1554 (0%)
[  4]  46.00-47.00  sec  12.4 MBytes   105 Mbits/sec  0.807 ms  0/1593 (0%)
[  4]  47.00-48.00  sec  12.2 MBytes   103 Mbits/sec  0.716 ms  0/1568 (0%)
[  4]  48.00-49.00  sec  12.7 MBytes   107 Mbits/sec  0.780 ms  0/1629 (0%)
[  4]  49.00-50.00  sec  12.7 MBytes   106 Mbits/sec  0.624 ms  0/1620 (0%)
[  4]  50.00-51.00  sec  11.1 MBytes  93.1 Mbits/sec  0.534 ms  0/1420 (0%)
[  4]  51.00-52.00  sec  12.1 MBytes   101 Mbits/sec  0.695 ms  0/1548 (0%)
[  4]  52.00-53.00  sec  11.0 MBytes  92.4 Mbits/sec  0.757 ms  0/1412 (0%)
[  4]  53.00-54.00  sec  11.7 MBytes  98.6 Mbits/sec  0.761 ms  0/1501 (0%)
[  4]  54.00-55.00  sec  12.5 MBytes   105 Mbits/sec  0.575 ms  0/1605 (0%)
[  4]  55.00-56.00  sec  12.1 MBytes   101 Mbits/sec  0.650 ms  0/1544 (0%)
[  4]  56.00-57.00  sec  11.7 MBytes  98.3 Mbits/sec  0.478 ms  0/1500 (0%)
[  4]  57.00-58.00  sec  12.5 MBytes   105 Mbits/sec  1.151 ms  0/1605 (0%)
[  4]  58.00-59.00  sec  12.2 MBytes   103 Mbits/sec  0.554 ms  0/1568 (0%)
[  4]  59.00-60.00  sec  12.2 MBytes   102 Mbits/sec  0.472 ms  0/1560 (0%)
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter    Lost/Total Datagrams
[  4]   0.00-60.00  sec   742 MBytes   104 Mbits/sec  0.542 ms  45/95010 (0.047%)
[  4] Sent 95010 datagrams

iperf Done.

Edit: I would like to say that IRQ balance is actually really good and it balances everything just perfectly between the two cores. I think with above tests and file transfers that I made, there may be still room to optimize it further but of course I dont really know for sure since I am not a C programmer myself but just saying this because there seems to be bugs and if they get sorted out maybe the performance will improve further. Btw I have transferred 78 GBs of data from my Laptop to W8980 using Samba, it took around 5-6 hours because of 100M port but I think WiFi is faster than 100M port if you force 40mhz because I was able to get 12mb/s on Wifi but only 9mb/s on ethernet.

2 Likes

47.3 Mbits/sec
That's really weird. If the CPU can supply 127 Mbits/sec on 1G ethernet even in vanilla nonpatched version. It would almost look like the DMA ring buffer is clocked from ethernet speed and the speed is not enough. You should try to borrow 1G machine somewhere if you can get similar values like me. It may be some insufficient information about hardware. Anyway IMO even pentium 1 should be able to saturate 100M ethernet (I don't want to test it though :stuck_out_tongue: ).

In my notebook the wifi is fluctuating too. You would have to make the perfect setup (no channel contention - almost impossible on 2.4GHz 11n), station next to AP, no power management on both devices (they will go into standby if no continual transmission - symptom: laggy ssh).

Well that doesn't have to mean balancing 1:1 will get you the best speed. You would need to account userspace SMP affinity and time how long it gets to handle one individual interrupt source.

You should try to restrict the interrupts in smp affinity to a single core and try to run the benchmarks again (wifi and ethernet).

Tested on 4.14.105 kernel. Weird, it seems there is about 10Mbps TCP drop in lantiq RX, 4.14.99 was better. And it is only in the kernel, I've tested on the same userspace and both without modules. But it is still faster than vanilla :smiley:.

1 Like

I tested wifi on different affinity settings, 1,2,3 etc. It turns out download is completely fine from router -> client more than 99% in my guess. But there is problem in uploading from client -> router. It shows packet loss on every transmission. Although it's minimal but I think it's one of the reasons why the speed fluctuates while uploading, it's possible there are bugs?

Yes it's faster, that's for sure (Thanks to you). I get around 110mbps on download on wifi and around 60-70mbps on uploading. I did not test the ethernet yet but it wont be much different.

1 Like

What is the latest OpenWrt build that your are running on your xrx200 device? I am running r9614-b61495409b on my TPLink-TDW8980 and r9630-a8cfef6c45 on my HH5A and the later is causing issues. It's possible something got changed in the kernel maybe.

Well the issue is that Client -> Router seems fine if I am using my laptop with LAN cable. As soon as I reverse it (Router -> Client) the router keeps sending data at 200mbps while the LAN on my laptop is 100mbps so the laptop doesnt receive anything at all and keeps showing errors. It seems HH5A (with r9630) doesnt seem to be checking the throughput link speed for some reason.

Now if possible I would like to either go back to the commit that you are using or maybe if you can update the patches so they work well with the kernel changes. Can these patches be submitted to OpenWrt for further development and integration within the build system? This way more people can contribute to it maybe and the fixes they provide can go a long way.

I am actually happy with the wifi performance with these patches. On a 5ghz I am connecting to at 433mbps and getting throughput rate of 166mbps/22mb/s UL/DL on my phone. On a 2.4ghz I'm connecting to at 150mbps (forcing 40mhz) and getting around 90-110mbps/10-12mb/s. I also did a test using your run.sh script between my W8980 and HH5A (both have gigabit ethernet and patches applied) with current situation as above and this is the log:

+ : ':::::::[' configuration 1552978503 ]::::::: :
+ iperf3 -c 192.168.1.1
Connecting to host 192.168.1.1, port 5201
[  5] local 192.168.1.254 port 55124 connected to 192.168.1.1 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  9.00 MBytes  75.4 Mbits/sec   12    167 KBytes       
[  5]   1.00-2.00   sec  8.72 MBytes  73.2 Mbits/sec    4    148 KBytes       
[  5]   2.00-3.00   sec  8.88 MBytes  74.5 Mbits/sec    6    132 KBytes       
[  5]   3.00-4.00   sec  10.7 MBytes  89.7 Mbits/sec    0    182 KBytes       
[  5]   4.00-5.00   sec  10.8 MBytes  90.2 Mbits/sec    5    178 KBytes       
[  5]   5.00-6.00   sec  11.1 MBytes  93.1 Mbits/sec    2    173 KBytes       
[  5]   6.00-7.00   sec  10.8 MBytes  90.4 Mbits/sec    3    161 KBytes       
[  5]   7.00-8.00   sec  10.6 MBytes  88.9 Mbits/sec    4    147 KBytes       
[  5]   8.00-9.00   sec  10.8 MBytes  90.4 Mbits/sec    5    134 KBytes       
[  5]   9.00-10.00  sec  11.1 MBytes  93.7 Mbits/sec    0    188 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   102 MBytes  85.9 Mbits/sec   41             sender
[  5]   0.00-10.05  sec   102 MBytes  85.4 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.1 -R
Connecting to host 192.168.1.1, port 5201
Reverse mode, remote host 192.168.1.1 is sending
[  5] local 192.168.1.254 port 55128 connected to 192.168.1.1 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  13.6 MBytes   114 Mbits/sec                  
[  5]   1.00-2.00   sec  13.9 MBytes   116 Mbits/sec                  
[  5]   2.00-3.00   sec  13.8 MBytes   116 Mbits/sec                  
[  5]   3.00-4.00   sec  13.8 MBytes   116 Mbits/sec                  
[  5]   4.00-5.01   sec  12.4 MBytes   103 Mbits/sec                  
[  5]   5.01-6.01   sec  11.4 MBytes  95.4 Mbits/sec                  
[  5]   6.01-7.01   sec  10.1 MBytes  85.2 Mbits/sec                  
[  5]   7.01-8.00   sec  11.9 MBytes   100 Mbits/sec                  
[  5]   8.00-9.00   sec  12.4 MBytes   104 Mbits/sec                  
[  5]   9.00-10.02  sec  11.7 MBytes  97.3 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.05  sec   126 MBytes   105 Mbits/sec   19             sender
[  5]   0.00-10.02  sec   125 MBytes   105 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.1 -u -b 150M
Connecting to host 192.168.1.1, port 5201
[  5] local 192.168.1.254 port 38359 connected to 192.168.1.1 port 5201
[ ID] Interval           Transfer     Bitrate         Total Datagrams
[  5]   0.00-1.00   sec  5.92 MBytes  49.7 Mbits/sec  4290  
[  5]   1.00-2.00   sec  5.96 MBytes  50.0 Mbits/sec  4313  
[  5]   2.00-3.00   sec  5.96 MBytes  50.0 Mbits/sec  4314  
[  5]   3.00-4.00   sec  5.95 MBytes  49.9 Mbits/sec  4307  
[  5]   4.00-5.00   sec  5.93 MBytes  49.7 Mbits/sec  4291  
[  5]   5.00-6.00   sec  5.91 MBytes  49.6 Mbits/sec  4282  
[  5]   6.00-7.00   sec  5.86 MBytes  49.2 Mbits/sec  4244  
[  5]   7.00-8.00   sec  5.95 MBytes  49.9 Mbits/sec  4309  
[  5]   8.00-9.00   sec  5.95 MBytes  49.9 Mbits/sec  4311  
[  5]   9.00-10.00  sec  5.94 MBytes  49.8 Mbits/sec  4304  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-10.00  sec  59.3 MBytes  49.8 Mbits/sec  0.000 ms  0/42965 (0%)  sender
[  5]   0.00-10.04  sec  53.0 MBytes  44.3 Mbits/sec  0.095 ms  4566/42964 (11%)  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.1 -u -b 150M -R
Connecting to host 192.168.1.1, port 5201
Reverse mode, remote host 192.168.1.1 is sending
[  5] local 192.168.1.254 port 46717 connected to 192.168.1.1 port 5201
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-1.00   sec  5.05 MBytes  42.4 Mbits/sec  0.104 ms  71/3729 (1.9%)  
[  5]   1.00-2.00   sec  5.11 MBytes  42.8 Mbits/sec  0.119 ms  0/3699 (0%)  
[  5]   2.00-3.00   sec  5.04 MBytes  42.3 Mbits/sec  0.150 ms  0/3651 (0%)  
[  5]   3.00-4.00   sec  4.80 MBytes  40.3 Mbits/sec  0.097 ms  0/3477 (0%)  
[  5]   4.00-5.00   sec  4.97 MBytes  41.6 Mbits/sec  0.148 ms  0/3596 (0%)  
[  5]   5.00-6.00   sec  4.92 MBytes  41.3 Mbits/sec  0.103 ms  0/3561 (0%)  
[  5]   6.00-7.00   sec  4.90 MBytes  41.1 Mbits/sec  0.166 ms  0/3548 (0%)  
[  5]   7.00-8.00   sec  4.90 MBytes  41.1 Mbits/sec  0.155 ms  0/3551 (0%)  
[  5]   8.00-9.00   sec  4.86 MBytes  40.8 Mbits/sec  0.146 ms  0/3522 (0%)  
[  5]   9.00-10.00  sec  4.82 MBytes  40.4 Mbits/sec  0.141 ms  0/3487 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-10.04  sec  49.5 MBytes  41.3 Mbits/sec  0.000 ms  0/35824 (0%)  sender
[  5]   0.00-10.00  sec  49.4 MBytes  41.4 Mbits/sec  0.141 ms  71/35821 (0.2%)  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.1 -u -b 500M
Connecting to host 192.168.1.1, port 5201
[  5] local 192.168.1.254 port 43445 connected to 192.168.1.1 port 5201
[ ID] Interval           Transfer     Bitrate         Total Datagrams
[  5]   0.00-1.00   sec  5.70 MBytes  47.8 Mbits/sec  4129  
[  5]   1.00-2.00   sec  5.69 MBytes  47.7 Mbits/sec  4121  
[  5]   2.00-3.00   sec  5.78 MBytes  48.5 Mbits/sec  4185  
[  5]   3.00-4.00   sec  5.90 MBytes  49.5 Mbits/sec  4271  
[  5]   4.00-5.00   sec  5.91 MBytes  49.6 Mbits/sec  4278  
[  5]   5.00-6.00   sec  5.91 MBytes  49.6 Mbits/sec  4277  
[  5]   6.00-7.00   sec  5.88 MBytes  49.3 Mbits/sec  4257  
[  5]   7.00-8.00   sec  5.90 MBytes  49.5 Mbits/sec  4276  
[  5]   8.00-9.00   sec  5.90 MBytes  49.5 Mbits/sec  4273  
[  5]   9.00-10.00  sec  5.91 MBytes  49.6 Mbits/sec  4279  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-10.00  sec  58.5 MBytes  49.1 Mbits/sec  0.000 ms  0/42346 (0%)  sender
[  5]   0.00-10.04  sec  50.0 MBytes  41.7 Mbits/sec  0.147 ms  6140/42314 (15%)  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.1 -u -b 500M -R
Connecting to host 192.168.1.1, port 5201
Reverse mode, remote host 192.168.1.1 is sending
[  5] local 192.168.1.254 port 45897 connected to 192.168.1.1 port 5201
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-1.00   sec  4.90 MBytes  41.1 Mbits/sec  0.073 ms  60/3608 (1.7%)  
[  5]   1.00-2.00   sec  5.16 MBytes  43.3 Mbits/sec  0.092 ms  0/3735 (0%)  
[  5]   2.00-3.00   sec  5.03 MBytes  42.2 Mbits/sec  0.093 ms  0/3642 (0%)  
[  5]   3.00-4.00   sec  5.16 MBytes  43.3 Mbits/sec  0.133 ms  0/3736 (0%)  
[  5]   4.00-5.00   sec  5.07 MBytes  42.5 Mbits/sec  0.144 ms  0/3671 (0%)  
[  5]   5.00-6.00   sec  5.13 MBytes  43.0 Mbits/sec  0.102 ms  0/3712 (0%)  
[  5]   6.00-7.00   sec  5.15 MBytes  43.2 Mbits/sec  0.127 ms  0/3732 (0%)  
[  5]   7.00-8.00   sec  5.07 MBytes  42.5 Mbits/sec  0.079 ms  0/3672 (0%)  
[  5]   8.00-9.00   sec  5.12 MBytes  42.9 Mbits/sec  0.150 ms  0/3705 (0%)  
[  5]   9.00-10.00  sec  4.97 MBytes  41.7 Mbits/sec  0.147 ms  0/3600 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-10.04  sec  50.8 MBytes  42.5 Mbits/sec  0.000 ms  0/36815 (0%)  sender
[  5]   0.00-10.00  sec  50.8 MBytes  42.6 Mbits/sec  0.147 ms  60/36813 (0.16%)  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.1 -u -b 1000M
Connecting to host 192.168.1.1, port 5201
[  5] local 192.168.1.254 port 45432 connected to 192.168.1.1 port 5201
[ ID] Interval           Transfer     Bitrate         Total Datagrams
[  5]   0.00-1.00   sec  5.94 MBytes  49.9 Mbits/sec  4304  
[  5]   1.00-2.00   sec  5.96 MBytes  50.0 Mbits/sec  4316  
[  5]   2.00-3.00   sec  5.94 MBytes  49.9 Mbits/sec  4305  
[  5]   3.00-4.00   sec  5.96 MBytes  50.0 Mbits/sec  4314  
[  5]   4.00-5.00   sec  5.95 MBytes  49.9 Mbits/sec  4308  
[  5]   5.00-6.00   sec  5.95 MBytes  49.9 Mbits/sec  4306  
[  5]   6.00-7.00   sec  5.96 MBytes  50.0 Mbits/sec  4317  
[  5]   7.00-8.00   sec  5.96 MBytes  50.0 Mbits/sec  4317  
[  5]   8.00-9.00   sec  5.94 MBytes  49.8 Mbits/sec  4298  
[  5]   9.00-10.00  sec  5.95 MBytes  49.9 Mbits/sec  4310  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-10.00  sec  59.5 MBytes  49.9 Mbits/sec  0.000 ms  0/43095 (0%)  sender
[  5]   0.00-10.04  sec  47.2 MBytes  39.4 Mbits/sec  0.355 ms  8842/43009 (21%)  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.1 -u -b 1000M -R
Connecting to host 192.168.1.1, port 5201
Reverse mode, remote host 192.168.1.1 is sending
[  5] local 192.168.1.254 port 40024 connected to 192.168.1.1 port 5201
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-1.00   sec  5.17 MBytes  43.4 Mbits/sec  0.144 ms  79/3825 (2.1%)  
[  5]   1.00-2.00   sec  4.81 MBytes  40.3 Mbits/sec  0.065 ms  0/3482 (0%)  
[  5]   2.00-3.00   sec  4.65 MBytes  39.0 Mbits/sec  0.065 ms  0/3370 (0%)  
[  5]   3.00-4.00   sec  4.74 MBytes  39.7 Mbits/sec  0.079 ms  0/3431 (0%)  
[  5]   4.00-5.00   sec  4.57 MBytes  38.3 Mbits/sec  0.045 ms  0/3309 (0%)  
[  5]   5.00-6.00   sec  4.72 MBytes  39.6 Mbits/sec  0.111 ms  0/3419 (0%)  
[  5]   6.00-7.00   sec  4.74 MBytes  39.8 Mbits/sec  0.124 ms  0/3435 (0%)  
[  5]   7.00-8.00   sec  4.83 MBytes  40.5 Mbits/sec  0.144 ms  0/3496 (0%)  
[  5]   8.00-9.00   sec  4.10 MBytes  34.4 Mbits/sec  0.440 ms  615/3581 (17%)  
[  5]   9.00-10.00  sec  3.61 MBytes  30.3 Mbits/sec  0.157 ms  1078/3693 (29%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-10.04  sec  48.4 MBytes  40.5 Mbits/sec  0.000 ms  0/35068 (0%)  sender
[  5]   0.00-10.00  sec  45.9 MBytes  38.5 Mbits/sec  0.157 ms  1772/35041 (5.1%)  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.1 -P3
Connecting to host 192.168.1.1, port 5201
[  5] local 192.168.1.254 port 55144 connected to 192.168.1.1 port 5201
[  7] local 192.168.1.254 port 55146 connected to 192.168.1.1 port 5201
[  9] local 192.168.1.254 port 55148 connected to 192.168.1.1 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  3.38 MBytes  28.3 Mbits/sec    2   76.4 KBytes       
[  7]   0.00-1.00   sec  2.73 MBytes  22.9 Mbits/sec    1   62.2 KBytes       
[  9]   0.00-1.00   sec  2.58 MBytes  21.6 Mbits/sec    4   62.2 KBytes       
[SUM]   0.00-1.00   sec  8.69 MBytes  72.8 Mbits/sec    7             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  2.55 MBytes  21.4 Mbits/sec   11   39.6 KBytes       
[  7]   1.00-2.00   sec  2.82 MBytes  23.6 Mbits/sec    1   72.1 KBytes       
[  9]   1.00-2.00   sec  3.75 MBytes  31.4 Mbits/sec    0   94.7 KBytes       
[SUM]   1.00-2.00   sec  9.11 MBytes  76.4 Mbits/sec   12             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  1.99 MBytes  16.7 Mbits/sec    6   46.7 KBytes       
[  7]   2.00-3.00   sec  3.11 MBytes  26.1 Mbits/sec    1   79.2 KBytes       
[  9]   2.00-3.00   sec  3.48 MBytes  29.2 Mbits/sec   12   67.9 KBytes       
[SUM]   2.00-3.00   sec  8.58 MBytes  72.0 Mbits/sec   19             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  2.11 MBytes  17.7 Mbits/sec    7   33.9 KBytes       
[  7]   3.00-4.00   sec  3.11 MBytes  26.1 Mbits/sec    5   55.1 KBytes       
[  9]   3.00-4.00   sec  4.04 MBytes  33.9 Mbits/sec    1   73.5 KBytes       
[SUM]   3.00-4.00   sec  9.26 MBytes  77.7 Mbits/sec   13             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  2.61 MBytes  21.9 Mbits/sec    0   67.9 KBytes       
[  7]   4.00-5.00   sec  2.86 MBytes  23.9 Mbits/sec    3   59.4 KBytes       
[  9]   4.00-5.00   sec  3.85 MBytes  32.3 Mbits/sec    1   79.2 KBytes       
[SUM]   4.00-5.00   sec  9.32 MBytes  78.1 Mbits/sec    4             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   5.00-6.00   sec  3.60 MBytes  30.3 Mbits/sec    2   66.5 KBytes       
[  7]   5.00-6.00   sec  2.73 MBytes  23.0 Mbits/sec    6   63.6 KBytes       
[  9]   5.00-6.00   sec  2.61 MBytes  21.9 Mbits/sec    2   65.0 KBytes       
[SUM]   5.00-6.00   sec  8.95 MBytes  75.2 Mbits/sec   10             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   6.00-7.00   sec  3.48 MBytes  29.1 Mbits/sec    6   66.5 KBytes       
[  7]   6.00-7.00   sec  2.87 MBytes  24.0 Mbits/sec    1   72.1 KBytes       
[  9]   6.00-7.00   sec  2.73 MBytes  22.9 Mbits/sec    7   48.1 KBytes       
[SUM]   6.00-7.00   sec  9.08 MBytes  76.0 Mbits/sec   14             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   7.00-8.00   sec  3.71 MBytes  31.2 Mbits/sec    5   65.0 KBytes       
[  7]   7.00-8.00   sec  2.81 MBytes  23.6 Mbits/sec    4   53.7 KBytes       
[  9]   7.00-8.00   sec  2.36 MBytes  19.9 Mbits/sec    9   42.4 KBytes       
[SUM]   7.00-8.00   sec  8.88 MBytes  74.6 Mbits/sec   18             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   8.00-9.00   sec  3.11 MBytes  26.1 Mbits/sec    2   63.6 KBytes       
[  7]   8.00-9.00   sec  2.49 MBytes  20.9 Mbits/sec    3   41.0 KBytes       
[  9]   8.00-9.00   sec  2.11 MBytes  17.7 Mbits/sec    4   36.8 KBytes       
[SUM]   8.00-9.00   sec  7.71 MBytes  64.6 Mbits/sec    9             
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   9.00-10.00  sec  3.23 MBytes  27.1 Mbits/sec    6   66.5 KBytes       
[  7]   9.00-10.00  sec  2.11 MBytes  17.7 Mbits/sec    5   38.2 KBytes       
[  9]   9.00-10.00  sec  2.24 MBytes  18.8 Mbits/sec    1   48.1 KBytes       
[SUM]   9.00-10.00  sec  7.58 MBytes  63.6 Mbits/sec   12             
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  29.8 MBytes  25.0 Mbits/sec   47             sender
[  5]   0.00-10.02  sec  29.6 MBytes  24.8 Mbits/sec                  receiver
[  7]   0.00-10.00  sec  27.6 MBytes  23.2 Mbits/sec   30             sender
[  7]   0.00-10.02  sec  27.5 MBytes  23.0 Mbits/sec                  receiver
[  9]   0.00-10.00  sec  29.7 MBytes  25.0 Mbits/sec   41             sender
[  9]   0.00-10.02  sec  29.6 MBytes  24.7 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec  87.2 MBytes  73.1 Mbits/sec  118             sender
[SUM]   0.00-10.02  sec  86.7 MBytes  72.5 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.1 -P3 -R
Connecting to host 192.168.1.1, port 5201
Reverse mode, remote host 192.168.1.1 is sending
[  5] local 192.168.1.254 port 55152 connected to 192.168.1.1 port 5201
[  7] local 192.168.1.254 port 55154 connected to 192.168.1.1 port 5201
[  9] local 192.168.1.254 port 55156 connected to 192.168.1.1 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  1.86 MBytes  15.6 Mbits/sec                  
[  7]   0.00-1.00   sec  3.17 MBytes  26.6 Mbits/sec                  
[  9]   0.00-1.00   sec  5.76 MBytes  48.3 Mbits/sec                  
[SUM]   0.00-1.00   sec  10.8 MBytes  90.5 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  1.98 MBytes  16.6 Mbits/sec                  
[  7]   1.00-2.00   sec  3.68 MBytes  30.9 Mbits/sec                  
[  9]   1.00-2.00   sec  5.88 MBytes  49.3 Mbits/sec                  
[SUM]   1.00-2.00   sec  11.5 MBytes  96.7 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  1.80 MBytes  15.1 Mbits/sec                  
[  7]   2.00-3.00   sec  3.61 MBytes  30.3 Mbits/sec                  
[  9]   2.00-3.00   sec  7.33 MBytes  61.5 Mbits/sec                  
[SUM]   2.00-3.00   sec  12.7 MBytes   107 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  1.49 MBytes  12.5 Mbits/sec                  
[  7]   3.00-4.00   sec  3.54 MBytes  29.7 Mbits/sec                  
[  9]   3.00-4.00   sec  7.36 MBytes  61.7 Mbits/sec                  
[SUM]   3.00-4.00   sec  12.4 MBytes   104 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  1.65 MBytes  13.9 Mbits/sec                  
[  7]   4.00-5.00   sec  3.73 MBytes  31.3 Mbits/sec                  
[  9]   4.00-5.00   sec  6.43 MBytes  54.0 Mbits/sec                  
[SUM]   4.00-5.00   sec  11.8 MBytes  99.1 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   5.00-6.00   sec  1.73 MBytes  14.5 Mbits/sec                  
[  7]   5.00-6.00   sec  3.34 MBytes  28.0 Mbits/sec                  
[  9]   5.00-6.00   sec  6.75 MBytes  56.6 Mbits/sec                  
[SUM]   5.00-6.00   sec  11.8 MBytes  99.1 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   6.00-7.00   sec  2.01 MBytes  16.8 Mbits/sec                  
[  7]   6.00-7.00   sec  3.50 MBytes  29.3 Mbits/sec                  
[  9]   6.00-7.00   sec  6.32 MBytes  52.9 Mbits/sec                  
[SUM]   6.00-7.00   sec  11.8 MBytes  99.0 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   7.00-8.00   sec  1.85 MBytes  15.6 Mbits/sec                  
[  7]   7.00-8.00   sec  3.72 MBytes  31.3 Mbits/sec                  
[  9]   7.00-8.00   sec  6.66 MBytes  56.0 Mbits/sec                  
[SUM]   7.00-8.00   sec  12.2 MBytes   103 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   8.00-9.00   sec  1.87 MBytes  15.7 Mbits/sec                  
[  7]   8.00-9.00   sec  3.81 MBytes  31.9 Mbits/sec                  
[  9]   8.00-9.00   sec  7.39 MBytes  61.9 Mbits/sec                  
[SUM]   8.00-9.00   sec  13.1 MBytes   110 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   9.00-10.00  sec  2.23 MBytes  18.7 Mbits/sec                  
[  7]   9.00-10.00  sec  3.50 MBytes  29.4 Mbits/sec                  
[  9]   9.00-10.00  sec  6.59 MBytes  55.3 Mbits/sec                  
[SUM]   9.00-10.00  sec  12.3 MBytes   103 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.03  sec  18.6 MBytes  15.5 Mbits/sec    4             sender
[  5]   0.00-10.00  sec  18.5 MBytes  15.5 Mbits/sec                  receiver
[  7]   0.00-10.03  sec  35.8 MBytes  30.0 Mbits/sec    1             sender
[  7]   0.00-10.00  sec  35.6 MBytes  29.9 Mbits/sec                  receiver
[  9]   0.00-10.03  sec  67.0 MBytes  56.0 Mbits/sec    2             sender
[  9]   0.00-10.00  sec  66.5 MBytes  55.8 Mbits/sec                  receiver
[SUM]   0.00-10.03  sec   121 MBytes   101 Mbits/sec    7             sender
[SUM]   0.00-10.00  sec   121 MBytes   101 Mbits/sec                  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.1 -P3 -u -b 800M
Connecting to host 192.168.1.1, port 5201
[  5] local 192.168.1.254 port 49553 connected to 192.168.1.1 port 5201
[  7] local 192.168.1.254 port 59365 connected to 192.168.1.1 port 5201
[  9] local 192.168.1.254 port 35834 connected to 192.168.1.1 port 5201
[ ID] Interval           Transfer     Bitrate         Total Datagrams
[  5]   0.00-1.00   sec  2.20 MBytes  18.5 Mbits/sec  1596  
[  7]   0.00-1.00   sec  2.20 MBytes  18.5 Mbits/sec  1596  
[  9]   0.00-1.00   sec  2.20 MBytes  18.5 Mbits/sec  1596  
[SUM]   0.00-1.00   sec  6.61 MBytes  55.4 Mbits/sec  4788  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  2.20 MBytes  18.5 Mbits/sec  1595  
[  7]   1.00-2.00   sec  2.20 MBytes  18.5 Mbits/sec  1595  
[  9]   1.00-2.00   sec  2.20 MBytes  18.5 Mbits/sec  1595  
[SUM]   1.00-2.00   sec  6.61 MBytes  55.4 Mbits/sec  4785  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  2.20 MBytes  18.4 Mbits/sec  1590  
[  7]   2.00-3.00   sec  2.20 MBytes  18.4 Mbits/sec  1590  
[  9]   2.00-3.00   sec  2.20 MBytes  18.4 Mbits/sec  1590  
[SUM]   2.00-3.00   sec  6.59 MBytes  55.3 Mbits/sec  4770  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  2.20 MBytes  18.5 Mbits/sec  1595  
[  7]   3.00-4.00   sec  2.20 MBytes  18.5 Mbits/sec  1595  
[  9]   3.00-4.00   sec  2.20 MBytes  18.5 Mbits/sec  1595  
[SUM]   3.00-4.00   sec  6.61 MBytes  55.4 Mbits/sec  4785  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  2.21 MBytes  18.5 Mbits/sec  1598  
[  7]   4.00-5.00   sec  2.21 MBytes  18.5 Mbits/sec  1598  
[  9]   4.00-5.00   sec  2.21 MBytes  18.5 Mbits/sec  1598  
[SUM]   4.00-5.00   sec  6.62 MBytes  55.6 Mbits/sec  4794  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   5.00-6.00   sec  2.20 MBytes  18.5 Mbits/sec  1596  
[  7]   5.00-6.00   sec  2.20 MBytes  18.5 Mbits/sec  1596  
[  9]   5.00-6.00   sec  2.20 MBytes  18.5 Mbits/sec  1596  
[SUM]   5.00-6.00   sec  6.61 MBytes  55.5 Mbits/sec  4788  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   6.00-7.00   sec  2.21 MBytes  18.6 Mbits/sec  1603  
[  7]   6.00-7.00   sec  2.21 MBytes  18.6 Mbits/sec  1603  
[  9]   6.00-7.00   sec  2.21 MBytes  18.6 Mbits/sec  1603  
[SUM]   6.00-7.00   sec  6.64 MBytes  55.7 Mbits/sec  4809  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   7.00-8.00   sec  2.21 MBytes  18.5 Mbits/sec  1597  
[  7]   7.00-8.00   sec  2.21 MBytes  18.5 Mbits/sec  1597  
[  9]   7.00-8.00   sec  2.21 MBytes  18.5 Mbits/sec  1597  
[SUM]   7.00-8.00   sec  6.62 MBytes  55.5 Mbits/sec  4791  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   8.00-9.00   sec  2.20 MBytes  18.5 Mbits/sec  1596  
[  7]   8.00-9.00   sec  2.20 MBytes  18.5 Mbits/sec  1596  
[  9]   8.00-9.00   sec  2.20 MBytes  18.5 Mbits/sec  1596  
[SUM]   8.00-9.00   sec  6.61 MBytes  55.5 Mbits/sec  4788  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   9.00-10.00  sec  2.21 MBytes  18.5 Mbits/sec  1598  
[  7]   9.00-10.00  sec  2.21 MBytes  18.5 Mbits/sec  1598  
[  9]   9.00-10.00  sec  2.21 MBytes  18.5 Mbits/sec  1598  
[SUM]   9.00-10.00  sec  6.62 MBytes  55.5 Mbits/sec  4794  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-10.00  sec  22.0 MBytes  18.5 Mbits/sec  0.000 ms  0/15964 (0%)  sender
[  5]   0.00-10.04  sec  18.9 MBytes  15.8 Mbits/sec  0.410 ms  2277/15960 (14%)  receiver
[  7]   0.00-10.00  sec  22.0 MBytes  18.5 Mbits/sec  0.000 ms  0/15964 (0%)  sender
[  7]   0.00-10.04  sec  18.9 MBytes  15.8 Mbits/sec  0.408 ms  2289/15960 (14%)  receiver
[  9]   0.00-10.00  sec  22.0 MBytes  18.5 Mbits/sec  0.000 ms  0/15964 (0%)  sender
[  9]   0.00-10.04  sec  18.9 MBytes  15.8 Mbits/sec  0.414 ms  2279/15959 (14%)  receiver
[SUM]   0.00-10.00  sec  66.1 MBytes  55.5 Mbits/sec  0.000 ms  0/47892 (0%)  sender
[SUM]   0.00-10.04  sec  56.7 MBytes  47.3 Mbits/sec  0.411 ms  6845/47879 (14%)  receiver

iperf Done.
+ sleep 10
+ iperf3 -c 192.168.1.1 -P3 -R -u -b 800M
Connecting to host 192.168.1.1, port 5201
Reverse mode, remote host 192.168.1.1 is sending
[  5] local 192.168.1.254 port 36683 connected to 192.168.1.1 port 5201
[  7] local 192.168.1.254 port 52147 connected to 192.168.1.1 port 5201
[  9] local 192.168.1.254 port 33380 connected to 192.168.1.1 port 5201
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-1.00   sec  1.77 MBytes  14.8 Mbits/sec  0.099 ms  0/1282 (0%)  
[  7]   0.00-1.00   sec  1.77 MBytes  14.8 Mbits/sec  0.113 ms  0/1282 (0%)  
[  9]   0.00-1.00   sec  1.77 MBytes  14.8 Mbits/sec  0.106 ms  0/1281 (0%)  
[SUM]   0.00-1.00   sec  5.31 MBytes  44.5 Mbits/sec  0.106 ms  0/3845 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   1.00-2.00   sec  1.75 MBytes  14.7 Mbits/sec  0.072 ms  0/1270 (0%)  
[  7]   1.00-2.00   sec  1.75 MBytes  14.7 Mbits/sec  0.102 ms  0/1270 (0%)  
[  9]   1.00-2.00   sec  1.75 MBytes  14.7 Mbits/sec  0.061 ms  0/1269 (0%)  
[SUM]   1.00-2.00   sec  5.26 MBytes  44.1 Mbits/sec  0.078 ms  0/3809 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   2.00-3.00   sec  1.71 MBytes  14.3 Mbits/sec  0.083 ms  0/1238 (0%)  
[  7]   2.00-3.00   sec  1.71 MBytes  14.3 Mbits/sec  0.101 ms  0/1238 (0%)  
[  9]   2.00-3.00   sec  1.71 MBytes  14.3 Mbits/sec  0.120 ms  0/1238 (0%)  
[SUM]   2.00-3.00   sec  5.13 MBytes  43.0 Mbits/sec  0.101 ms  0/3714 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   3.00-4.00   sec  1.76 MBytes  14.7 Mbits/sec  0.147 ms  0/1273 (0%)  
[  7]   3.00-4.00   sec  1.76 MBytes  14.7 Mbits/sec  0.217 ms  0/1272 (0%)  
[  9]   3.00-4.00   sec  1.76 MBytes  14.7 Mbits/sec  0.217 ms  0/1273 (0%)  
[SUM]   3.00-4.00   sec  5.27 MBytes  44.2 Mbits/sec  0.193 ms  0/3818 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   4.00-5.00   sec  1.76 MBytes  14.7 Mbits/sec  0.088 ms  0/1272 (0%)  
[  7]   4.00-5.00   sec  1.76 MBytes  14.7 Mbits/sec  0.114 ms  0/1272 (0%)  
[  9]   4.00-5.00   sec  1.76 MBytes  14.7 Mbits/sec  0.082 ms  0/1272 (0%)  
[SUM]   4.00-5.00   sec  5.27 MBytes  44.2 Mbits/sec  0.095 ms  0/3816 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   5.00-6.00   sec  1.72 MBytes  14.4 Mbits/sec  0.110 ms  0/1243 (0%)  
[  7]   5.00-6.00   sec  1.72 MBytes  14.4 Mbits/sec  0.118 ms  0/1244 (0%)  
[  9]   5.00-6.00   sec  1.72 MBytes  14.4 Mbits/sec  0.110 ms  0/1244 (0%)  
[SUM]   5.00-6.00   sec  5.15 MBytes  43.2 Mbits/sec  0.113 ms  0/3731 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   6.00-7.00   sec  1.83 MBytes  15.4 Mbits/sec  0.083 ms  0/1327 (0%)  
[  7]   6.00-7.00   sec  1.83 MBytes  15.4 Mbits/sec  0.117 ms  0/1327 (0%)  
[  9]   6.00-7.00   sec  1.83 MBytes  15.4 Mbits/sec  0.096 ms  0/1327 (0%)  
[SUM]   6.00-7.00   sec  5.50 MBytes  46.1 Mbits/sec  0.099 ms  0/3981 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   7.00-8.00   sec  1.71 MBytes  14.4 Mbits/sec  0.214 ms  0/1240 (0%)  
[  7]   7.00-8.00   sec  1.71 MBytes  14.4 Mbits/sec  0.199 ms  0/1240 (0%)  
[  9]   7.00-8.00   sec  1.71 MBytes  14.4 Mbits/sec  0.197 ms  0/1240 (0%)  
[SUM]   7.00-8.00   sec  5.14 MBytes  43.1 Mbits/sec  0.203 ms  0/3720 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   8.00-9.00   sec  1.88 MBytes  15.8 Mbits/sec  0.199 ms  0/1363 (0%)  
[  7]   8.00-9.00   sec  1.88 MBytes  15.8 Mbits/sec  0.188 ms  0/1363 (0%)  
[  9]   8.00-9.00   sec  1.88 MBytes  15.8 Mbits/sec  0.219 ms  0/1362 (0%)  
[SUM]   8.00-9.00   sec  5.65 MBytes  47.4 Mbits/sec  0.202 ms  0/4088 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]   9.00-10.00  sec  1.87 MBytes  15.7 Mbits/sec  0.226 ms  0/1356 (0%)  
[  7]   9.00-10.00  sec  1.87 MBytes  15.7 Mbits/sec  0.171 ms  0/1356 (0%)  
[  9]   9.00-10.00  sec  1.87 MBytes  15.7 Mbits/sec  0.215 ms  0/1357 (0%)  
[SUM]   9.00-10.00  sec  5.62 MBytes  47.1 Mbits/sec  0.204 ms  0/4069 (0%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-10.04  sec  17.8 MBytes  14.8 Mbits/sec  0.000 ms  0/12866 (0%)  sender
[  5]   0.00-10.00  sec  17.8 MBytes  14.9 Mbits/sec  0.226 ms  0/12864 (0%)  receiver
[  7]   0.00-10.04  sec  17.8 MBytes  14.8 Mbits/sec  0.000 ms  0/12866 (0%)  sender
[  7]   0.00-10.00  sec  17.8 MBytes  14.9 Mbits/sec  0.171 ms  0/12864 (0%)  receiver
[  9]   0.00-10.04  sec  17.8 MBytes  14.8 Mbits/sec  0.000 ms  0/12865 (0%)  sender
[  9]   0.00-10.00  sec  17.8 MBytes  14.9 Mbits/sec  0.215 ms  0/12863 (0%)  receiver
[SUM]   0.00-10.04  sec  53.3 MBytes  44.5 Mbits/sec  0.000 ms  0/38597 (0%)  sender
[SUM]   0.00-10.00  sec  53.3 MBytes  44.7 Mbits/sec  0.204 ms  0/38591 (0%)  receiver

iperf Done.

My patches were made on r9569-8f9155fe7a and git snapshots before that (r9228-a3ccac6b1d was 10Mbps on the average faster).

I don't know why it is slower, only thing I've noticed, the driver doesn't track the packet statistics anymore. The original API is marked as obsoleted so it maybe why it is not tracking. That may be partially responsible for some problems. Gonna update it, other than that I don't know what could be patched.

1 Like

Hmm it seems the original statistics have a problem with overflowing (only 32bit variables). So I've changed the code for the "new" 64bit API. There was some problem with crashing, so I've disabled the locks in stat function.

Try to replace the 0904-backport-vanilla-eth-driver.patch with new version https://pastebin.com/raw/WYrJGw0e ... lots of unused code there

Another change is disabling the locks in xmit and tx housekeeping functions, it seems they are not required now (I've put them there during the buggy frags rewrite and on old SMP irq version code). It seems to increase the ethernet speed.

2 Likes

Thanks for the update. The driver seems more stable than before with less transmission errors than before. But the 50mbps limit on throughput between xrx200 is still there for some reason. As a matter of fact I blame it on iperf3 because it could be a bug within iperf3. I am not able to use -b 0 with iperf3 because it gives me Segmentation fault error.

Anyway, I was able to test it and have found no issues so far and right now I think the last driver was quite good enough and we didnt need to update it anyway but glad you did and fixed any leftover-errors. In the testing I am getting as usual speeds and the speeds between the routers seems as it is. If I run a udp iperf3 test then it's capped at 50mbps and if I run a tcp test then it's around 120mbps max. It's no where near 1gbps but as I said before it could be an issue with iperf3. But throughput to client is okay and working full at 100mbps as before.

Maybe the iperf3 is miscompiled, and if the iperf3 was compiled as part of the openwrt maybe even openwrt is miscompiled. Try to run gdb on iperf3 it should show where is the problem (on my git snapshot there was no problem with -b 0).

I'm not sure going into much detail would yield any more benefits. The switch is working at a decent speed and I'm sure from such a lower end device asking for more would be a overkill. But anyways thanks for your help.

1 Like

As an interested member of public, but not a developer, can I ask a (possibly silly) question: do you intend to merge your commits into the mainline OpenWrt code, and when is it likely to happen?

1 Like

Yes I would like to, I'm just bad at making clean patches :-D.

Problem with these upgrades are they are written only from observation of the hardware behaviour and some common sense how the hardware usually works. Without documentation there may be unexpected bugs. For example I don't know why there is not full 100M in @ahmar16 case, the first implementation of IRQ SMP is fundamentally buggy (the 3.10 kernel from @paldier's repo). I have already contacted developers of openwrt, but usually you must be really sure what does the patch do (and there must be some measurable improvement) before it can be commited into main tree.

BTW You guys can join openwrt mailing list too and post your reviews (benchmarks before and after patching). Testing reports always helps.

1 Like

Another question xD:

Are there also other non-SMP-related fix in your driver? I'm asking this because my router is more stable on LEDE which does not have SMP, so I was thinking if you could add those fixes, if any, also to LEDE drivers.