AQL and the ath10k is *lovely*

I am under the impression that was un-reverted with the true fix being the multicast fix. ?

Also, I am pedantic - "lag" to me means events measured in ms. "halting" means events measured in 100s of ms.

1 Like

That fix was only for people using multicast (e.g. enabling uPnP) in their WIFI network. The horrible walkaway bug had nothing to do with multicast.

@nbd pretty please ...

1 Like

@nbd

This is the original bug filed for this issue:

1 Like

@wired

FYI, you can integrate all recent mac80211 patches from @nbd for 22.03/Master into 21.02 without any modification needed. You just need to build your own images.

sigh: SSH over wifi stops working on RT3200/E8450 with 22.03.0-rc6 - #37 by richb-hanover-priv

@dtaht, see below ath10k-ct-smallbuffers driver tests on a TP-Link RE450v2 running v22.03-rc6, it took me awhile to compile a image that fitted in this small device.

WiFi connectivity as per below (same computer, same spots for computer and AP):
macos wifi conndata

I performed a couple of RRUL_BE tests, and TBH I suspect they might be affected by the AP being CPU bounded. First one with tx_burst=2.0 and second one with tx_burst=3.0:

And after I proceeded to repeat the same download/upload test I ran with my mt76, see below:

T="v22.03-rc6 ath10k-ct-smallbuffers WLAN ECN-on loc servs off"; for i in 1 2 4 8 16; do flent -l 30 --socket-stats -x --step-size=.05 --te=upload_streams=$i -H openwrt.lan -t tcp_nup-$i-threads-$T tcp_nup; flent -l 30 --socket-stats -x --step-size=.05 --te=download_streams=$i -H openwrt.lan -t tcp_ndown-$i-threads-$T tcp_ndown; done
Starting Flent 2.0.1 using Python 3.10.4.
Starting tcp_nup test. Expected run time: 40 seconds.
Data file written to ./tcp_nup-2022-08-12T194639.109026.tcp_nup-1-threads-v22_03-rc6_ath10k-ct-smallbuffers_WLAN_ECN-on_loc_servs_off.flent.gz

Summary of tcp_nup test run from 2022-08-12 19:46:39.109026
  Title: 'tcp_nup-1-threads-v22.03-rc6 ath10k-ct-smallbuffers WLAN ECN-on loc servs off'

                                             avg       median          # data pts
 Ping (ms) ICMP                   :        39.20        45.10 ms              800
 TCP upload avg                   :       354.70          N/A Mbits/s         800
 TCP upload sum                   :       354.70          N/A Mbits/s         800
 TCP upload::1                    :       354.70       362.35 Mbits/s         800
 TCP upload::1::tcp_cwnd          :      1539.68      1543.00                 490
 TCP upload::1::tcp_delivery_rate :       330.99       331.51                 490
 TCP upload::1::tcp_pacing_rate   :       499.96       472.00                 490
 TCP upload::1::tcp_rtt           :        45.06        45.62                 490
 TCP upload::1::tcp_rtt_var       :         0.49         0.18                 490
Starting Flent 2.0.1 using Python 3.10.4.
Starting tcp_ndown test. Expected run time: 40 seconds.
Data file written to ./tcp_ndown-2022-08-12T194725.070275.tcp_ndown-1-threads-v22_03-rc6_ath10k-ct-smallbuffers_WLAN_ECN-on_loc_servs_off.flent.gz

Summary of tcp_ndown test run from 2022-08-12 19:47:25.070275
  Title: 'tcp_ndown-1-threads-v22.03-rc6 ath10k-ct-smallbuffers WLAN ECN-on loc servs off'

                             avg       median          # data pts
 Ping (ms) ICMP   :         9.95        11.35 ms              799
 TCP download avg :       283.63          N/A Mbits/s         799
 TCP download sum :       283.63          N/A Mbits/s         799
 TCP download::1  :       283.63       288.70 Mbits/s         799
Starting Flent 2.0.1 using Python 3.10.4.
Starting tcp_nup test. Expected run time: 40 seconds.
Data file written to ./tcp_nup-2022-08-12T194810.417894.tcp_nup-2-threads-v22_03-rc6_ath10k-ct-smallbuffers_WLAN_ECN-on_loc_servs_off.flent.gz

Summary of tcp_nup test run from 2022-08-12 19:48:10.417894
  Title: 'tcp_nup-2-threads-v22.03-rc6 ath10k-ct-smallbuffers WLAN ECN-on loc servs off'

                                             avg       median          # data pts
 Ping (ms) ICMP                   :        35.94        42.50 ms              798
 TCP upload avg                   :       196.17          N/A Mbits/s         799
 TCP upload sum                   :       392.34          N/A Mbits/s         799
 TCP upload::1                    :       280.62       282.92 Mbits/s         799
 TCP upload::1::tcp_cwnd          :      1176.18      1229.00                 491
 TCP upload::1::tcp_delivery_rate :       257.47       258.11                 491
 TCP upload::1::tcp_pacing_rate   :       396.56       370.02                 491
 TCP upload::1::tcp_rtt           :        43.78        44.03                 489
 TCP upload::1::tcp_rtt_var       :         0.80         0.33                 489
 TCP upload::2                    :       111.72       112.48 Mbits/s         799
 TCP upload::2::tcp_cwnd          :       472.15       473.50                 492
 TCP upload::2::tcp_delivery_rate :       103.93       103.19                 492
 TCP upload::2::tcp_pacing_rate   :       155.14       147.01                 492
 TCP upload::2::tcp_rtt           :        44.66        44.86                 491
 TCP upload::2::tcp_rtt_var       :         2.21         1.84                 491
Starting Flent 2.0.1 using Python 3.10.4.
Starting tcp_ndown test. Expected run time: 40 seconds.
Data file written to ./tcp_ndown-2022-08-12T194855.867234.tcp_ndown-2-threads-v22_03-rc6_ath10k-ct-smallbuffers_WLAN_ECN-on_loc_servs_off.flent.gz

Summary of tcp_ndown test run from 2022-08-12 19:48:55.867234
  Title: 'tcp_ndown-2-threads-v22.03-rc6 ath10k-ct-smallbuffers WLAN ECN-on loc servs off'

                             avg       median          # data pts
 Ping (ms) ICMP   :        10.80        12.40 ms              799
 TCP download avg :       140.16          N/A Mbits/s         799
 TCP download sum :       280.31          N/A Mbits/s         799
 TCP download::1  :        92.25        94.63 Mbits/s         799
 TCP download::2  :       188.06       188.11 Mbits/s         799
Starting Flent 2.0.1 using Python 3.10.4.
Starting tcp_nup test. Expected run time: 40 seconds.
Data file written to ./tcp_nup-2022-08-12T194941.312158.tcp_nup-4-threads-v22_03-rc6_ath10k-ct-smallbuffers_WLAN_ECN-on_loc_servs_off.flent.gz

Summary of tcp_nup test run from 2022-08-12 19:49:41.312158
  Title: 'tcp_nup-4-threads-v22.03-rc6 ath10k-ct-smallbuffers WLAN ECN-on loc servs off'

                                             avg       median          # data pts
 Ping (ms) ICMP                   :        37.15        44.10 ms              799
 TCP upload avg                   :        93.36          N/A Mbits/s         799
 TCP upload sum                   :       373.46          N/A Mbits/s         799
 TCP upload::1                    :        88.45        89.39 Mbits/s         799
 TCP upload::1::tcp_cwnd          :       375.93       390.00                 494
 TCP upload::1::tcp_delivery_rate :        82.99        83.60                 494
 TCP upload::1::tcp_pacing_rate   :       120.14       114.97                 494
 TCP upload::1::tcp_rtt           :        45.06        45.65                 493
 TCP upload::1::tcp_rtt_var       :         1.45         1.09                 493
 TCP upload::2                    :       128.17       128.19 Mbits/s         799
 TCP upload::2::tcp_cwnd          :       544.09       539.50                 494
 TCP upload::2::tcp_delivery_rate :       120.07       120.41                 494
 TCP upload::2::tcp_pacing_rate   :       174.69       168.15                 494
 TCP upload::2::tcp_rtt           :        45.02        45.36                 492
 TCP upload::2::tcp_rtt_var       :         1.43         1.11                 492
 TCP upload::3                    :        78.62        79.63 Mbits/s         799
 TCP upload::3::tcp_cwnd          :       334.47       344.00                 494
 TCP upload::3::tcp_delivery_rate :        73.80        74.42                 494
 TCP upload::3::tcp_pacing_rate   :       106.54       102.24                 494
 TCP upload::3::tcp_rtt           :        45.25        45.70                 491
 TCP upload::3::tcp_rtt_var       :         1.68         1.31                 491
 TCP upload::4                    :        78.22        79.12 Mbits/s         799
 TCP upload::4::tcp_cwnd          :       332.14       341.50                 494
 TCP upload::4::tcp_delivery_rate :        73.25        73.68                 494
 TCP upload::4::tcp_pacing_rate   :       106.32       101.80                 494
 TCP upload::4::tcp_rtt           :        45.20        45.80                 493
 TCP upload::4::tcp_rtt_var       :         1.56         1.27                 493
Starting Flent 2.0.1 using Python 3.10.4.
Starting tcp_ndown test. Expected run time: 40 seconds.
Data file written to ./tcp_ndown-2022-08-12T195026.986965.tcp_ndown-4-threads-v22_03-rc6_ath10k-ct-smallbuffers_WLAN_ECN-on_loc_servs_off.flent.gz

Summary of tcp_ndown test run from 2022-08-12 19:50:26.986965
  Title: 'tcp_ndown-4-threads-v22.03-rc6 ath10k-ct-smallbuffers WLAN ECN-on loc servs off'

                             avg       median          # data pts
 Ping (ms) ICMP   :        11.10        12.70 ms              799
 TCP download avg :        69.18          N/A Mbits/s         799
 TCP download sum :       276.72          N/A Mbits/s         799
 TCP download::1  :        96.15        94.24 Mbits/s         799
 TCP download::2  :        69.40        67.06 Mbits/s         799
 TCP download::3  :        68.41        67.34 Mbits/s         799
 TCP download::4  :        42.76        42.89 Mbits/s         799
Starting Flent 2.0.1 using Python 3.10.4.
Starting tcp_nup test. Expected run time: 40 seconds.
Data file written to ./tcp_nup-2022-08-12T195112.637708.tcp_nup-8-threads-v22_03-rc6_ath10k-ct-smallbuffers_WLAN_ECN-on_loc_servs_off.flent.gz

Summary of tcp_nup test run from 2022-08-12 19:51:12.637708
  Title: 'tcp_nup-8-threads-v22.03-rc6 ath10k-ct-smallbuffers WLAN ECN-on loc servs off'

                                             avg       median          # data pts
 Ping (ms) ICMP                   :        39.00        46.65 ms              796
 TCP upload avg                   :        45.08          N/A Mbits/s         799
 TCP upload sum                   :       360.66          N/A Mbits/s         799
 TCP upload::1                    :        32.49        32.91 Mbits/s         799
 TCP upload::1::tcp_cwnd          :       146.48       151.00                 492
 TCP upload::1::tcp_delivery_rate :        30.42        30.31                 492
 TCP upload::1::tcp_pacing_rate   :        42.62        41.88                 492
 TCP upload::1::tcp_rtt           :        49.03        48.98                 490
 TCP upload::1::tcp_rtt_var       :         2.46         2.14                 490
 TCP upload::2                    :        31.75        32.28 Mbits/s         799
 TCP upload::2::tcp_cwnd          :       142.98       148.00                 493
 TCP upload::2::tcp_delivery_rate :        29.54        29.69                 493
 TCP upload::2::tcp_pacing_rate   :        41.61        40.71                 493
 TCP upload::2::tcp_rtt           :        49.08        48.95                 491
 TCP upload::2::tcp_rtt_var       :         2.51         2.19                 491
 TCP upload::3                    :        89.45        89.28 Mbits/s         799
 TCP upload::3::tcp_cwnd          :       397.33       393.00                 494
 TCP upload::3::tcp_delivery_rate :        84.16        82.24                 494
 TCP upload::3::tcp_pacing_rate   :       120.01       114.33                 494
 TCP upload::3::tcp_rtt           :        47.98        48.03                 492
 TCP upload::3::tcp_rtt_var       :         1.56         1.24                 492
 TCP upload::4                    :        29.60        30.14 Mbits/s         799
 TCP upload::4::tcp_cwnd          :       133.60       139.00                 493
 TCP upload::4::tcp_delivery_rate :        27.70        28.07                 493
 TCP upload::4::tcp_pacing_rate   :        38.67        38.21                 493
 TCP upload::4::tcp_rtt           :        49.11        49.26                 493
 TCP upload::4::tcp_rtt_var       :         2.55         2.19                 493
 TCP upload::5                    :        30.47        30.61 Mbits/s         799
 TCP upload::5::tcp_cwnd          :       137.33       142.00                 493
 TCP upload::5::tcp_delivery_rate :        28.45        28.85                 493
 TCP upload::5::tcp_pacing_rate   :        39.78        39.07                 493
 TCP upload::5::tcp_rtt           :        49.16        49.08                 490
 TCP upload::5::tcp_rtt_var       :         2.56         2.26                 490
 TCP upload::6                    :        56.69        57.52 Mbits/s         799
 TCP upload::6::tcp_cwnd          :       252.87       257.00                 494
 TCP upload::6::tcp_delivery_rate :        53.06        52.68                 494
 TCP upload::6::tcp_pacing_rate   :        74.94        72.81                 494
 TCP upload::6::tcp_rtt           :        48.48        48.62                 493
 TCP upload::6::tcp_rtt_var       :         2.01         1.77                 493
 TCP upload::7                    :        44.33        44.92 Mbits/s         799
 TCP upload::7::tcp_cwnd          :       198.82       202.00                 492
 TCP upload::7::tcp_delivery_rate :        41.48        41.67                 492
 TCP upload::7::tcp_pacing_rate   :        58.42        57.00                 492
 TCP upload::7::tcp_rtt           :        48.72        48.98                 489
 TCP upload::7::tcp_rtt_var       :         2.20         1.87                 489
 TCP upload::8                    :        45.88        45.95 Mbits/s         799
 TCP upload::8::tcp_cwnd          :       204.94       205.00                 493
 TCP upload::8::tcp_delivery_rate :        42.91        42.69                 493
 TCP upload::8::tcp_pacing_rate   :        60.38        58.80                 493
 TCP upload::8::tcp_rtt           :        48.61        48.76                 489
 TCP upload::8::tcp_rtt_var       :         2.17         1.90                 489
Starting Flent 2.0.1 using Python 3.10.4.
Starting tcp_ndown test. Expected run time: 40 seconds.
Data file written to ./tcp_ndown-2022-08-12T195158.717881.tcp_ndown-8-threads-v22_03-rc6_ath10k-ct-smallbuffers_WLAN_ECN-on_loc_servs_off.flent.gz

Summary of tcp_ndown test run from 2022-08-12 19:51:58.717881
  Title: 'tcp_ndown-8-threads-v22.03-rc6 ath10k-ct-smallbuffers WLAN ECN-on loc servs off'

                             avg       median          # data pts
 Ping (ms) ICMP   :        11.60        13.70 ms              799
 TCP download avg :        34.23          N/A Mbits/s         799
 TCP download sum :       273.84          N/A Mbits/s         799
 TCP download::1  :        28.30        26.88 Mbits/s         799
 TCP download::2  :        40.94        40.12 Mbits/s         799
 TCP download::3  :        33.05        32.92 Mbits/s         799
 TCP download::4  :        27.36        27.06 Mbits/s         799
 TCP download::5  :        28.41        28.18 Mbits/s         799
 TCP download::6  :        37.60        35.01 Mbits/s         799
 TCP download::7  :        43.26        42.31 Mbits/s         799
 TCP download::8  :        34.92        34.03 Mbits/s         799
Starting Flent 2.0.1 using Python 3.10.4.
Starting tcp_nup test. Expected run time: 40 seconds.
Data file written to ./tcp_nup-2022-08-12T195244.790658.tcp_nup-16-threads-v22_03-rc6_ath10k-ct-smallbuffers_WLAN_ECN-on_loc_servs_off.flent.gz

Summary of tcp_nup test run from 2022-08-12 19:52:44.790658
  Title: 'tcp_nup-16-threads-v22.03-rc6 ath10k-ct-smallbuffers WLAN ECN-on loc servs off'

                                              avg       median          # data pts
 Ping (ms) ICMP                    :        39.56        46.70 ms              794
 TCP upload avg                    :        21.84          N/A Mbits/s         800
 TCP upload sum                    :       349.43          N/A Mbits/s         800
 TCP upload::1                     :        19.23        19.44 Mbits/s         800
 TCP upload::10                    :        32.57        33.41 Mbits/s         800
 TCP upload::10::tcp_cwnd          :       145.14       142.00                 491
 TCP upload::10::tcp_delivery_rate :        30.55        28.59                 491
 TCP upload::10::tcp_pacing_rate   :        42.97        39.46                 491
 TCP upload::10::tcp_rtt           :        49.55        49.65                 491
 TCP upload::10::tcp_rtt_var       :         2.54         2.17                 491
 TCP upload::11                    :        32.23        31.05 Mbits/s         800
 TCP upload::11::tcp_cwnd          :       144.22       138.00                 490
 TCP upload::11::tcp_delivery_rate :        30.01        27.78                 490
 TCP upload::11::tcp_pacing_rate   :        42.42        37.91                 490
 TCP upload::11::tcp_rtt           :        49.70        50.06                 488
 TCP upload::11::tcp_rtt_var       :         2.59         2.21                 488
 TCP upload::12                    :        19.69        19.73 Mbits/s         800
 TCP upload::12::tcp_cwnd          :        88.39        89.00                 490
 TCP upload::12::tcp_delivery_rate :        18.36        18.28                 490
 TCP upload::12::tcp_pacing_rate   :        25.63        24.70                 490
 TCP upload::12::tcp_rtt           :        49.58        49.78                 490
 TCP upload::12::tcp_rtt_var       :         2.98         2.64                 490
 TCP upload::13                    :        20.28        20.43 Mbits/s         800
 TCP upload::13::tcp_cwnd          :        91.09        92.00                 490
 TCP upload::13::tcp_delivery_rate :        18.85        18.87                 490
 TCP upload::13::tcp_pacing_rate   :        26.46        25.29                 490
 TCP upload::13::tcp_rtt           :        49.58        49.52                 490
 TCP upload::13::tcp_rtt_var       :         3.02         2.59                 490
 TCP upload::14                    :        17.57        18.36 Mbits/s         800
 TCP upload::14::tcp_cwnd          :        78.99        82.00                 489
 TCP upload::14::tcp_delivery_rate :        16.39        16.88                 489
 TCP upload::14::tcp_pacing_rate   :        22.80        22.86                 489
 TCP upload::14::tcp_rtt           :        49.61        49.69                 489
 TCP upload::14::tcp_rtt_var       :         3.11         2.72                 489
 TCP upload::15                    :        19.60        19.73 Mbits/s         800
 TCP upload::15::tcp_cwnd          :        88.05        89.00                 489
 TCP upload::15::tcp_delivery_rate :        18.24        18.35                 489
 TCP upload::15::tcp_pacing_rate   :        25.54        24.68                 489
 TCP upload::15::tcp_rtt           :        49.48        49.47                 488
 TCP upload::15::tcp_rtt_var       :         3.02         2.61                 488
 TCP upload::16                    :        20.85        20.88 Mbits/s         800
 TCP upload::16::tcp_cwnd          :        93.81        95.00                 489
 TCP upload::16::tcp_delivery_rate :        19.47        19.60                 489
 TCP upload::16::tcp_pacing_rate   :        27.13        26.22                 489
 TCP upload::16::tcp_rtt           :        49.65        49.72                 488
 TCP upload::16::tcp_rtt_var       :         2.94         2.46                 488
 TCP upload::1::tcp_cwnd           :        86.55        87.00                 489
 TCP upload::1::tcp_delivery_rate  :        17.88        17.96                 488
 TCP upload::1::tcp_pacing_rate    :        25.05        24.17                 489
 TCP upload::1::tcp_rtt            :        49.55        49.54                 488
 TCP upload::1::tcp_rtt_var        :         3.05         2.64                 488
 TCP upload::2                     :        30.03        29.75 Mbits/s         800
 TCP upload::2::tcp_cwnd           :       134.93       133.00                 490
 TCP upload::2::tcp_delivery_rate  :        28.04        26.82                 490
 TCP upload::2::tcp_pacing_rate    :        39.41        37.00                 490
 TCP upload::2::tcp_rtt            :        49.65        50.14                 487
 TCP upload::2::tcp_rtt_var        :         2.64         2.14                 487
 TCP upload::3                     :        19.33        19.71 Mbits/s         800
 TCP upload::3::tcp_cwnd           :        86.81        87.00                 490
 TCP upload::3::tcp_delivery_rate  :        18.00        18.08                 489
 TCP upload::3::tcp_pacing_rate    :        25.12        24.16                 490
 TCP upload::3::tcp_rtt            :        49.61        49.78                 490
 TCP upload::3::tcp_rtt_var        :         3.07         2.67                 490
 TCP upload::4                     :        19.65        19.91 Mbits/s         800
 TCP upload::4::tcp_cwnd           :        88.32        89.00                 490
 TCP upload::4::tcp_delivery_rate  :        18.30        18.28                 489
 TCP upload::4::tcp_pacing_rate    :        25.63        24.81                 490
 TCP upload::4::tcp_rtt            :        49.56        49.60                 490
 TCP upload::4::tcp_rtt_var        :         2.99         2.55                 490
 TCP upload::5                     :        19.18        19.38 Mbits/s         800
 TCP upload::5::tcp_cwnd           :        86.33        87.00                 489
 TCP upload::5::tcp_delivery_rate  :        17.97        17.96                 488
 TCP upload::5::tcp_pacing_rate    :        24.91        24.19                 489
 TCP upload::5::tcp_rtt            :        49.68        49.74                 487
 TCP upload::5::tcp_rtt_var        :         3.04         2.66                 487
 TCP upload::6                     :        19.59        19.65 Mbits/s         800
 TCP upload::6::tcp_cwnd           :        87.79        88.00                 490
 TCP upload::6::tcp_delivery_rate  :        18.20        18.18                 490
 TCP upload::6::tcp_pacing_rate    :        25.42        24.57                 490
 TCP upload::6::tcp_rtt            :        49.58        49.61                 490
 TCP upload::6::tcp_rtt_var        :         3.02         2.61                 490
 TCP upload::7                     :        19.73        19.86 Mbits/s         800
 TCP upload::7::tcp_cwnd           :        88.63        90.00                 489
 TCP upload::7::tcp_delivery_rate  :        18.41        18.47                 489
 TCP upload::7::tcp_pacing_rate    :        25.62        24.89                 489
 TCP upload::7::tcp_rtt            :        49.66        50.03                 487
 TCP upload::7::tcp_rtt_var        :         3.01         2.64                 487
 TCP upload::8                     :        19.51        19.76 Mbits/s         800
 TCP upload::8::tcp_cwnd           :        87.65        88.00                 490
 TCP upload::8::tcp_delivery_rate  :        18.21        18.34                 490
 TCP upload::8::tcp_pacing_rate    :        25.45        24.62                 490
 TCP upload::8::tcp_rtt            :        49.50        49.40                 489
 TCP upload::8::tcp_rtt_var        :         3.06         2.62                 489
 TCP upload::9                     :        20.39        20.49 Mbits/s         800
 TCP upload::9::tcp_cwnd           :        91.79        93.00                 489
 TCP upload::9::tcp_delivery_rate  :        19.03        19.17                 488
 TCP upload::9::tcp_pacing_rate    :        26.59        25.65                 489
 TCP upload::9::tcp_rtt            :        49.63        49.72                 488
 TCP upload::9::tcp_rtt_var        :         2.95         2.57                 488
Starting Flent 2.0.1 using Python 3.10.4.
Starting tcp_ndown test. Expected run time: 40 seconds.
Data file written to ./tcp_ndown-2022-08-12T195332.406689.tcp_ndown-16-threads-v22_03-rc6_ath10k-ct-smallbuffers_WLAN_ECN-on_loc_servs_off.flent.gz

Summary of tcp_ndown test run from 2022-08-12 19:53:32.406689
  Title: 'tcp_ndown-16-threads-v22.03-rc6 ath10k-ct-smallbuffers WLAN ECN-on loc servs off'

                             avg       median          # data pts
 Ping (ms) ICMP   :        12.10        14.50 ms              800
 TCP download avg :        16.64          N/A Mbits/s         800
 TCP download sum :       266.16          N/A Mbits/s         800
 TCP download::1  :        15.22        14.54 Mbits/s         800
 TCP download::10 :        18.27        18.05 Mbits/s         800
 TCP download::11 :        16.20        15.71 Mbits/s         800
 TCP download::12 :        15.41        15.10 Mbits/s         800
 TCP download::13 :        14.01        14.06 Mbits/s         800
 TCP download::14 :        19.35        19.15 Mbits/s         800
 TCP download::15 :        25.05        23.14 Mbits/s         800
 TCP download::16 :        17.00        16.45 Mbits/s         800
 TCP download::2  :        19.84        19.75 Mbits/s         800
 TCP download::3  :        17.52        16.19 Mbits/s         800
 TCP download::4  :        12.95        12.71 Mbits/s         800
 TCP download::5  :        16.84        15.42 Mbits/s         800
 TCP download::6  :        13.49        12.61 Mbits/s         800
 TCP download::7  :        15.50        15.31 Mbits/s         800
 TCP download::8  :        15.50        14.85 Mbits/s         800
 TCP download::9  :        14.01        13.72 Mbits/s         800

I did a tcpdump capture of the 1-threaded test too, and it's available with the rest of the data followin the next link:

1 Like

thx once again. I can live with this. Consistently low latency, even with lowere

The only thing keeping me awake at night are not knowing performance at distance with multiple stations.

1 Like

At distance is in my list, however, multiple stations will be a bit trickier.

I took some time off. How's rc6, everyone?

2 Likes

It is working pretty fine here. After we got Felix's latest mt76 patch which solved the SSH issue, it's very stable.

I still owe you some farther from the AP flent tests, tho'.

3 Likes

the "ssh issue" was a larger problem involving aggregation into that wifi queue much like the fq_bug was. It may turn out that a retest of the wifi queues behaves better now also. And look!! All this great historical data to compare it against! :0

1 Like

Okay, you got it. I'll try to do it during my weekend.

3 Likes

@dtaht, here you go—same test variables, MCS, rate, channel, etc. The only difference is that I did previous tests in macOS 12.5, and now they are performed in macOS 12.5.1. So I hope it won't be a big difference.

Without further ado, a flent rrul_be test with 300 s duration follows:

Following, you can see TCP download and upload ping tests results:

  • Note: I redid this test 3 times, and on all occasions, I found that a 1-threaded download provides better ping values. Not sure if this is a glitch.

And, just for completeness I did an iperf -c openwrt.lan -e -z --bounceback test:

------------------------------------------------------------
Client connecting to openwrt.lan, TCP port 5001 with pid 67119 (1 flows)
Write buffer size:  100 Byte
Bursting:  100 Byte writes 10 times every 1.00 second(s)
Bounce-back test (size= 100 Byte) (server hold req=0 usecs)
TOS set to 0x0 and nodelay (Nagle off)
TCP window size:  128 KByte (default)
------------------------------------------------------------
[  1] local 192.168.1.151%en0 port 54280 connected with 192.168.1.1 port 5001 (bb len/hold=100/0) (sock=5) (icwnd/mss/irtt=11/1448/3000) (ct=2.65 ms) on 2022-09-03 06:08:14 (AEST)
[ ID] Interval            Transfer    Bandwidth         BB cnt=avg/min/max/stdev         Rtry  Cwnd/RTT    RPS
[  1] 0.0000-1.0000 sec  1.95 KBytes  16.0 Kbits/sec    10=2.856/2.425/3.961/0.514 ms    0   12K/3000 us    350 rps
[  1] 1.0000-2.0000 sec  1.95 KBytes  16.0 Kbits/sec    10=2.794/2.447/3.750/0.380 ms    0   13K/3000 us    358 rps
[  1] 2.0000-3.0000 sec  1.95 KBytes  16.0 Kbits/sec    10=3.052/2.482/6.341/1.184 ms    0   14K/3000 us    328 rps
[  1] 3.0000-4.0000 sec  1.95 KBytes  16.0 Kbits/sec    10=2.854/2.510/4.140/0.531 ms    0   15K/2000 us    350 rps
[  1] 4.0000-5.0000 sec  1.95 KBytes  16.0 Kbits/sec    10=2.887/2.314/4.334/0.644 ms    0   16K/3000 us    346 rps
[  1] 5.0000-6.0000 sec  1.95 KBytes  16.0 Kbits/sec    10=3.175/2.522/7.153/1.435 ms    0   17K/3000 us    315 rps
[  1] 6.0000-7.0000 sec  1.95 KBytes  16.0 Kbits/sec    10=2.731/2.522/3.877/0.413 ms    0   18K/2000 us    366 rps
[  1] 7.0000-8.0000 sec  1.95 KBytes  16.0 Kbits/sec    10=2.718/2.537/3.785/0.378 ms    0   19K/3000 us    368 rps
[  1] 8.0000-9.0000 sec  1.95 KBytes  16.0 Kbits/sec    10=3.759/2.534/5.029/0.971 ms    0   20K/3000 us    266 rps
[  1] 9.0000-10.0000 sec  1.95 KBytes  16.0 Kbits/sec    10=3.208/2.517/7.084/1.401 ms    0   21K/3000 us    312 rps
[  1] 0.0000-10.0222 sec  19.7 KBytes  16.1 Kbits/sec    101=3.039/2.314/7.153/0.958 ms    0   21K/12000 us    329 rps
[  1] 0.0000-10.0222 sec BB8-PDF: bin(w=100us):cnt(101)=24:1,25:5,26:31,27:25,28:10,29:4,30:2,31:1,34:1,35:1,37:3,38:3,39:2,40:1,42:2,43:1,44:1,46:1,50:1,51:1,64:1,66:1,71:1,72:1 (5.00/95.00/99.7%=25/50/72,Outliers=0,obl/obu=0/0)

Following, you can find the link to the usual flent data files. Would you be so kind as to render the ping_cdf graph yourself? I'm not very confident my matlib is working correctly.

I want someone else with an mt76 device to perform these tests. I keep seeing a difference between 15 MiB/s and 20 MiB/s comparing upload and download bandwidth.

2 Likes

@amteza you are the king of WiFi testing at the moment! I've been so enjoying seeing your diligent test results and correspondence with @dtaht.

2 Likes

I try to help a little bit, like you, mate.

1 Like

The actual test that would test a little better for the ssh queue problem is rrul, not rrul_be. Somewhere on this thread was also a test that exercised the queues differently. Thanks as always for testing and providing full data, I will look at 'em harder in the morning, PST.

I keep thinking that putting the codel target 8ms patch back in would be good, but suspect we have some other set of buffering somewhere eating that 20ms. aql?

3 Likes

I was unhappy at seeing 350 rps, and I was wondering what was wrong and then i realized that I was thinking in terms of "rpm". 21000 RPM, (admittedly without load) is quite good..... I'm so done for the week...

2 Likes

Dave, forgive my ignorance on this matter. Are we talking about a former patchset, or are we talking about something like https://forum.openwrt.org/t/aql-and-the-ath10k-is-lovely/59002/304?page=16

If you refer to the source code, can you point me in the right direction? Is it in mac80211? Long ago (3 years ago), I recall seeing in CoDel MS2TIME defined as 20 ms. Is it what you refer to?

I don't know why AQL is even needed on the mt76, and always thought it was too high by default for the ath10k. @nbd?

Since the original patches in 2016, MSTIME(8) worked fine in testing across the board for 5ghz, and I think openwrt has mostly disabled legacy rates for 2.4.

And prior to all this keruffle I was trying to aim for a max txop under multi-station contention of ~2.5ms or less.