Poor WAN performance on BT HH5A <--> G.Fast MT992 Modem

The higher than expected SNR could indeed be a clue to an underlying problem. Did you use the tools I provided in a previous post to detect possible packet loss?
https://forum.openwrt.org/t/poor-wan-performance-on-bt-hh5a-g-fast-mt992-modem/120458/9

fwiw, if it was me, I'd complain to TT and say you didn't expect the upload to be less than half what you had previously, and demand to be returned to using VDSL. That's assuming the new VDSL connection will be as good as what you had previously.

Is 320m distance to cabinet measured direct, or by following likely paths the old telephone wires take around the roads?

Imho, unless it is less than 200m, it may be hit or miss with regards to benefits of Gfast.

https://labs.thinkbroadband.com/local/broadband-map#6/51.414/-0.641/

Out of curiosity, did you buy the R4AG from Xiaomi UK ?

1 Like

From an SQM perspective, if your uploads kill the network performance not only for the uploading computer, but for all machines in your LAN, try the following:

config queue 'eth1'
        option ingress_ecn 'ECN'
        option itarget 'auto'
        option etarget 'auto'
        option verbosity '5'
        option qdisc 'cake'
        option script 'layer_cake.qos'
        option qdisc_advanced '1'
        option squash_dscp '0'
        option squash_ingress '0'
        option qdisc_really_really_advanced '1'
        option eqdisc_opts 'nat dual-srchost'
        option linklayer 'ethernet'
        option linklayer_advanced '1'
        option tcMTU '2047'
        option tcTSIZE '128'
        option linklayer_adaptation_mechanism 'default'
        option debug_logging '1'
        option iqdisc_opts 'nat dual-dsthost ingress'
        option interface 'wan'
        option tcMPU '96'
        option enabled '1'
        option overhead '44'
        option download '94500'
        option upload '7110'

The two tricks here are a) the dual-xxxhost keywords which instruct cake to share capacity fairly between internal IP addresses, that is your GDrive uploading computer will not be able to hog all/most upload capacity if other machines want to send something (but without competition the GDrive upload should still saturate your uplink). And ingress instructs cake to essentially automatically adjust the download shapers aggressiveness to the actual responsiveness of the incoming traffic. See https://openwrt.org/docs/guide-user/network/traffic-shaping/sqm-details for more information (also how to do a quick and dirty test whether the router's CPU might be overloaded).

Note with these shaper-rate settings you can at best expect the following TCP/IPv4 goodput (what speedtests measure and report):
9.4500 * ((1500-20-20)/(1500+44)) = 8.94 = Mbps
7.110 * ((1500-20-20)/(1500+44)) = 6.72 Mbps
as shaper rates are gross rates, while speedtests report net payload throughput...

I would, unless the router is already overloaded, set the shaper to 105000 and 8000 respectively, so those speeds that you get without SQM as speedtest results (and only decrease these if latency under load suffers too much).

Are you testing the ping from the same machine you are downloading from? Do you have a dedicated AP or does your router need to do both sqm and WiFi?

And do perform the MTR tests, Bill recommended... you can BTW run mtr from your router:
use opkg update ; opkg install mtr if mtr is not already installed and invoke it like:
mtr -ezb4w -c 120 pingbox1.thinkbroadband.com
for getting a nice report for ~2 minutes of pings (you can copy and paste the terminal output here in the forum), or use:
mtr -ezb4 pingbox1.thinkbroadband.com
to get a continuous updated mtr output in the terminal.
Side-note: pingbox1.thinkbroadband.com seems to be the host that Thinkbroadband uses for their network quality monitoring, so running mtr against that allows you to compare your results with those recorded and displayed with a thinkbraodbandprobe giving you a view from both sides.

1 Like

I completely forgot about the tools you’d suggested Bill. I’ve setup a Broadband Quality Monitor test on thinkbroadband, this morning. I’ve only had the test running for an hour so not much to report in the below image. And my network / desktop computer isn’t on yet so there’s not much traffic.

I'm going off the conversation with the Openreach engineer when they visited the property. I believe their testing equipment measured the line from the cabinet to where it runs into the block of flats at 320m. I live on the 2nd floor of a tenenment building so there will another telephone line that brings that into the flat property and to the final master phone point where the router is connected. It's my understanding the Openreach engineer wasn't able to measure the distance from the common area entry point to the master socket in my flat.

I found SCAN computers were selling the R4AG both on their own site and eBay. With next day delivery.

I've tried both, I've run a ping test on the desktop uploading to Gdrive. I've also tried the ping whilst the desktop is on, but running it from my phone and on an ssh connection from the router. WiFi is using a separate BT Whole Home WiFi AP mesh network. The master WiFi disc is connected to the router via a LAN cable.

Thanks for the SQM and mtr suggestions, moeller0. I'll see how they stack up this morning.

hmm, I thought Scan only sold the R4A 100mb model for £22. I could be wrong.

Here's the output of the MTR tests which I ran from an ssh on the R4AG router. I'd implimented the suggested SQM changes from moeller0 whilst this test was running and my desktop / GDrive machine was off:

# mtr -ezb4w -c 120 pingbox1.thinkbroadband.com
Start: 2022-02-18T09:04:25+0000
HOST: ohib                                                  Loss%   Snt   Last   Avg  Best  Wrst StDev
  1. AS13285  ae50-ner001.msp.as13285.net (78.144.1.33)      0.0%   120   21.2  11.3   7.2  45.5   5.1
  2. AS13285  ae50-scr001-msp.as13285.net (78.144.1.32)      0.0%   120    8.0  11.0   7.2  44.3   5.1
  3. AS13285  ae60-scr101.thw.as13285.net (78.144.1.110)     0.0%   120   12.8  16.6  12.6  56.8   6.2
  4. AS13285  talktalk-gw1.thdo.ncuk.net (78.144.3.74)       0.0%   120   13.0  18.9  12.5 162.6  19.8
  5. AS21396  po4-31.core-rs4.thdo.ncuk.net (80.249.97.85)   0.0%   120   13.2  15.4  12.9  26.4   2.2
  6. AS21396  pingbox1.thinkbroadband.com (80.249.99.164)    0.0%   120   12.8  14.6  12.3  21.6   1.8

Here's the link XiaoMi Router 4A High-Speed Dual Band AC1200 Router: XiaoMi DVB4224GL Mi Router 4A AC1200 WiFi Router, 4x Antennas, Dual-Band (300 + 867Mbps), GbE, 802.11a/ac/b/g/n, White and on eBay.

1 Like

Nothing jumping out, the "Wrst" column is a bit higher than I would expect, but since it is mostly the end-host that gives reliable reports, 12.3 to 21.6 is not great, but also not terrible, also no packet loss (but then this were just 120 packets).

For getting a better handle on loss, maybe let mtr run continously while you are away:
mtr -ezb4 pingbox1.thinkbroadband.com
and just look at the results after a few hours (and copy and paste here)....

Also interesting to repeat this mtr-experiment while you are actually loading your link.

And finally, would e good to see the output of tc -s qdisc...

hmm, both links you provided show conflicting information in the listing.

Title quoting Gbe, and DVB4224GL part number suggests it is the gigabit model.

But when I study the detailed specs, it quotes 100mb ports and 64MB RAM which is the slower R4A 100mb model......

I presume yours must be Gigabit model (check label), otherwise it would have been bricked when you installed R4AG image onto R4A.

Did it come with a white UK power adapter?

It flashed ok with OpenWRT and the Status page lists it as Xiaomi Mi Router 4A Gigabit Edition. See screen grab.

It came with a poweradapter with 2 pins so had to find an adapter to convert it to a UK 3 pin plug.

1 Like

It says it's the R4A gigabyte edition

1 Like

I've left mtr running and will try it again when my desktop is on and putting the network under stress. Here's how it's currently looking:

                                                                                                                             Packets               Pings
 Host                                                                                                                      Loss%   Snt   Last   Avg  Best  Wrst StDev
 1. AS13285  ae50-ner001.msp.as13285.net (78.144.1.33)                                                                      0.0%  1748    9.1  10.1   7.1  50.1   4.7
 2. AS13285  ae50-scr001-msp.as13285.net (78.144.1.32)                                                                      0.0%  1748    8.7  10.2   7.1  50.1   5.3
 3. AS13285  ae60-scr101.thw.as13285.net (78.144.1.110)                                                                     0.0%  1747   15.2  14.6  12.4  80.6   4.6
 4. AS13285  talktalk-gw1.thdo.ncuk.net (78.144.3.74)                                                                       0.0%  1747   15.5  17.6  12.5 277.8  23.3
 5. AS21396  po4-31.core-rs4.thdo.ncuk.net (80.249.97.85)                                                                   0.0%  1747   13.2  13.6  12.6  44.6   2.1
 6. AS21396  pingbox1.thinkbroadband.com (80.249.99.164)                                                                    0.0%  1747   14.7  13.3  12.4  26.2   1.6
:~# tc -s qdisc
qdisc noqueue 0: dev lo root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev eth0 root refcnt 2 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 24069905757 bytes 25355661 pkt (dropped 0, overlimits 0 requeues 138)
 backlog 0b 0p requeues 138
  maxpacket 18216 drop_overlimit 0 new_flow_count 633548 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc noqueue 0: dev lan2 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev lan1 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc cake 8059: dev wan root refcnt 2 bandwidth 8Mbit diffserv3 dual-srchost nat nowash no-ack-filter split-gso rtt 100ms noatm overhead 44 mpu 96
 Sent 148810046 bytes 156535 pkt (dropped 6368, overlimits 159544 requeues 0)
 backlog 0b 0p requeues 0
 memory used: 131040b of 4Mb
 capacity estimate: 8Mbit
 min/max network layer size:           28 /    1500
 min/max overhead-adjusted size:       96 /    1544
 average network hdr offset:           14

                   Bulk  Best Effort        Voice
  thresh        500Kbit        8Mbit        2Mbit
  target         36.3ms          5ms       9.08ms
  interval        131ms        100ms        104ms
  pk_delay          0us         17ms       1.36ms
  av_delay          0us       5.08ms         27us
  sp_delay          0us         20us         10us
  backlog            0b           0b           0b
  pkts                0       162856           61
  bytes               0    156976620         4561
  way_inds            0         1259            0
  way_miss            0         3238            9
  way_cols            0            0            0
  drops               0         6368            0
  marks               0           13            0
  ack_drop            0            0            0
  sp_flows            0            2            1
  bk_flows            0            1            0
  un_flows            0            0            0
  max_len             0        18061          439
  quantum           300          300          300

qdisc ingress ffff: dev wan parent ffff:fff1 ----------------
 Sent 97785926 bytes 140150 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev br-lan root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc cake 805a: dev ifb4wan root refcnt 2 bandwidth 105Mbit diffserv3 dual-dsthost nat nowash ingress no-ack-filter split-gso rtt 100ms noatm overhead 44 mpu 96
 Sent 99541790 bytes 140011 pkt (dropped 138, overlimits 60047 requeues 0)
 backlog 0b 0p requeues 0
 memory used: 786240b of 5250000b
 capacity estimate: 105Mbit
 min/max network layer size:           46 /    1500
 min/max overhead-adjusted size:       96 /    1544
 average network hdr offset:           14

                   Bulk  Best Effort        Voice
  thresh       6562Kbit      105Mbit    26250Kbit
  target            5ms          5ms          5ms
  interval        100ms        100ms        100ms
  pk_delay          0us       2.27ms         20us
  av_delay          0us        227us          2us
  sp_delay          0us         22us          2us
  backlog            0b           0b           0b
  pkts                0       140101           48
  bytes               0     99744291         3663
  way_inds            0         2617            0
  way_miss            0         3181            2
  way_cols            0            0            0
  drops               0          138            0
  marks               0            3            0
  ack_drop            0            0            0
  sp_flows            0            2            1
  bk_flows            0            1            0
  un_flows            0            0            0
  max_len             0         1514          321
  quantum           300         1514          801

Thanks, nothing really jumping out here..., it 8s just 8 Mbps is not that much....

Agreed, I think it's poor upload speed from the property to the cabinet or somewhere else outside the property that's causing the issue. A direct connection the G.Fast modem never peaks beyond 8Mbps up. I'll try and get TalkTalk to switch me back to TalkTalk 60 / VDSL.

For future reference:

  • The latest SQM settings have done a good job on the R4GA.
  • The ping latency stays around 10-20ms even with the network under load (desktop computer on with GDrive running and uploading multiple files).
  • The download speed stays establish, usually around 90Mbps down but sometimes drops to 60-70Mbps. Thankfully the new SQM settings aren't causing the download rate to drop off a cliff when files are being uploaded. With the desktop computer uploading the upload rate is pretty poor though 1-2Mbps.
  • I've left the desktop uploading most of the morning but was unable to leave a local instance of mtr running. However, the Think Broadband test results are below collected from the on-going test on their side.

I've run an mtr test on the router whilst the Desktop is uploading and here's the output.

~#  mtr -ezb4w -c 120 pingbox1.thinkbroadband.com
Start: 2022-02-18T13:20:42+0000
HOST:                                                       Loss%   Snt   Last   Avg  Best  Wrst StDev
  1. AS13285  ae50-ner001.msp.as13285.net (78.144.1.33)      0.0%   120    8.2  10.3   7.3  47.2   4.5
  2. AS13285  ae50-scr001-msp.as13285.net (78.144.1.32)      0.0%   120    9.6  13.5   8.4  31.9   4.4
  3. AS13285  ae60-scr101.thw.as13285.net (78.144.1.110)     0.0%   120   15.5  16.3  13.4  54.1   4.6
  4. AS13285  talktalk-gw1.thdo.ncuk.net (78.144.3.74)       0.0%   120   14.2  19.1  13.3 156.4  18.5
  5. AS21396  po4-31.core-rs4.thdo.ncuk.net (80.249.97.85)   0.0%   120   16.7  15.4  13.3  25.2   1.3
  6. AS21396  pingbox1.thinkbroadband.com (80.249.99.164)    0.0%   120   15.6  15.1  12.8  17.0   0.9

That computer is connected via WiFi? Could you, just for a test, run a wire between OpenWrt router and the desktop computer to figure out whether the issue might be related to what happens on the WiFi link?

Correct, it's connected via WiFi. I've ordered a cable which should arrive in the next couple of days to try this test. I currently have one that will stretch from the Desktop to the modem. Seems like the last logical thing to try.

2 Likes