SQM help | bufferbloat | LTE connection

Installing and Using OpenWrt Network and Wireless Configuration
3

output from 'tc -s qdisc'

qdisc noqueue 0: dev lo root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev eth0 root refcnt 2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 147799 bytes 448 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth1 root refcnt 2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 79535275 bytes 110224 pkt (dropped 0, overlimits 0 requeues 9)
 backlog 0b 0p requeues 9
  maxpacket 1514 drop_overlimit 0 new_flow_count 3044 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc cake 8009: dev eth2 root refcnt 2 bandwidth 19456Kbit besteffort triple-isolate rtt 100.0ms raw
 Sent 41744806 bytes 38095 pkt (dropped 56, overlimits 35038 requeues 0)
 backlog 0b 0p requeues 0
 memory used: 517440b of 4Mb
 capacity estimate: 19456Kbit
             Tin 0
  thresh     19456Kbit
  target         5.0ms
  interval     100.0ms
  pk_delay       7.7ms
  av_delay       3.9ms
  sp_delay         6us
  pkts           38151
  bytes       41827350
  way_inds           0
  way_miss         114
  way_cols           0
  drops             56
  marks              0
  sp_flows           1
  bk_flows           2
  un_flows           0
  max_len        47168

qdisc ingress ffff: dev eth2 parent ffff:fff1 ----------------
 Sent 28904527 bytes 34282 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev br-lan root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth1.1 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth1.10 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev br-guest_wifi root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc mq 0: dev wlan1 root
 Sent 434858 bytes 5386 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev wlan1 parent :1 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 5648 bytes 40 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wlan1 parent :2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wlan1 parent :3 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 429210 bytes 5346 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wlan1 parent :4 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev wlan0 root
 Sent 433021 bytes 5373 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev wlan0 parent :1 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 3811 bytes 27 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wlan0 parent :2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wlan0 parent :3 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 429210 bytes 5346 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 216 drop_overlimit 0 new_flow_count 2 ecn_mark 0
  new_flows_len 1 old_flows_len 0
qdisc fq_codel 0: dev wlan0 parent :4 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev wlan1-1 root
 Sent 515951 bytes 5248 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev wlan1-1 parent :1 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 175510 bytes 1597 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wlan1-1 parent :2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wlan1-1 parent :3 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 340441 bytes 3651 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 95 drop_overlimit 0 new_flow_count 5 ecn_mark 0
  new_flows_len 1 old_flows_len 0
qdisc fq_codel 0: dev wlan1-1 parent :4 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev wlan1-2 root
 Sent 429140 bytes 5345 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev wlan1-2 parent :1 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wlan1-2 parent :2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wlan1-2 parent :3 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 429140 bytes 5345 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 60 drop_overlimit 0 new_flow_count 2 ecn_mark 0
  new_flows_len 1 old_flows_len 0
qdisc fq_codel 0: dev wlan1-2 parent :4 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc cake 800a: dev ifb4eth2 root refcnt 2 bandwidth 6604Kbit autorate_ingress besteffort triple-isolate wash rtt 100.0ms raw
 Sent 29374157 bytes 34275 pkt (dropped 7, overlimits 24354 requeues 0)
 backlog 0b 0p requeues 0
 memory used: 202368b of 4Mb
 capacity estimate: 7044Kbit
             Tin 0
  thresh      6604Kbit
  target         5.0ms
  interval     100.0ms
  pk_delay       2.9ms
  av_delay       308us
  sp_delay        57us
  pkts           34282
  bytes       29384475
  way_inds           0
  way_miss         114
  way_cols           0
  drops              7
  marks              0
  sp_flows           3
  bk_flows           1
  un_flows           0
  max_len         1474

sorry i can't post a link from dslreports at the moment, I just did a factory reset because of problems with wifi...

thx so far!

4
5

Silly question, you really have 19Mbps on upstream and only 6Mbps on downstream? Or is this setting actually controlled by autorate_ingress? Sorry to ask dumb questions, but I have no variable bandwidth link available...

Best Regards

6

It's true... It's such a shame, but there is no alternative solution :confused:

7

Any ideas or what can I do to get rid of bufferbloat? the output from tc -s qdisc doesn't help me :confused:

thx in advance!

8

Please increase the test duration to at least 30 seconds per direction and enable High-Res bufferbloat testing, as described in https://forum.openwrt.org/t/sqm-qos-recommended-settings-for-the-dslreports-speedtest-bufferbloat-testing/2803 and repeat the test.

9

Not sure, but please try to set the shaper to say 5000/5000 and redo the speedtest, if you can not get decent bufferbloat even with extreme shaping, you have issues outside of sqm-scripts' area of influence. If this works well, start to slowly increase the downlink shaper... (Your one test shows decent uplink debloating but terrible downlink bufferbloat).

Best Regards

10

Thx, I will try it! To decrease the shaper to 5000 for example, it means, that my max download speed will be 5mbit? This is no solution or workaround. The download speed changes every day/hour and so I need a "autorate ingress" solution. I don't want to have 5mbits down if there are 20 possible :confused:

thx in advance!

11

Can you pls provide me a link/explanation per pm? I have a similar situation like yours.

12

So I did a test with 1024kbit ingress and bufferbloat also exists :confused: Ideas? Autorate Ingress is useless? Pls help me, browsing doesn't make any sense anymore :confused:

13

Well, this 5000/5000 test is not supposed to be a work around but really just a test of the bufferbloat you see when the LTE network should not be the bottleneck. If this is already bad, do not expect any wonders if the LTE part actually becomes the bottleneck.

14

1Mbps is quite terrible, a single packet will block the line for 100015188/1000^2 = 12.144 milliseconds. So for testing I would still recommend to go a bit higher, and please post links to the dslreports speedtest results, they often (not always) contain additional information helpful in figuring out issues.

Best Regards

15

I did a a speedtest at this moment:

http://www.dslreports.com/speedtest/17988538

with following config:

config queue 'eth1'
        option ingress_ecn 'ECN'
        option egress_ecn 'ECN'
        option itarget 'auto'
        option etarget 'auto'
        option linklayer 'none'
        option interface 'eth2'
        option debug_logging '0'
        option verbosity '5'
        option qdisc 'cake'
        option script 'piece_of_cake.qos'
        option qdisc_advanced '1'
        option squash_dscp '1'
        option squash_ingress '1'
        option qdisc_really_really_advanced '1'
        option enabled '1'
        option iqdisc_opts 'autorate_ingress'
        option eqdisc_opts 'autorate_egress'
        option download '48640'
        option upload '19456'

It's only good because of the "high" bandwith?

16

Probably related to the high bandwidth, but the output of "tc -s qdisc" from just after a test would be more informative than the /etc/config/sqm. PLease note that there is no autorate_egress option, and it is not clear what happens when unsupported options are passed vis the [i|e]qdisc_opts... Now it would e intersting to see a speedtest at around the same time with sqm disabled (followed by one with sqm enabled again, to see whether the result s an outlier or whether it seems robust).

Best Regards

17

ok, thx! i removed the egress option!

speedtest without sqm:

"tc -s qdisc" output after speedtest:

qdisc noqueue 0: dev lo root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev eth0 root refcnt 2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 6391492 bytes 18943 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth1 root refcnt 2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 671431985 bytes 1013155 pkt (dropped 0, overlimits 0 requeues 10)
 backlog 0b 0p requeues 10
  maxpacket 1514 drop_overlimit 0 new_flow_count 10823 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth2 root refcnt 2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 728315601 bytes 1202932 pkt (dropped 37, overlimits 0 requeues 6383)
 backlog 0b 0p requeues 6383
  maxpacket 67804 drop_overlimit 0 new_flow_count 7324 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc noqueue 0: dev br-lan root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth1.1 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth1.10 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc mq 0: dev wlan1 root
 Sent 743677907 bytes 600786 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev wlan1 parent :1 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 48724 bytes 288 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wlan1 parent :2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 312967 bytes 1612 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wlan1 parent :3 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 743297511 bytes 598827 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 1474 drop_overlimit 0 new_flow_count 841 ecn_mark 0
  new_flows_len 0 old_flows_len 4
qdisc fq_codel 0: dev wlan1 parent :4 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 18705 bytes 59 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev wlan0 root
 Sent 9176076 bytes 65659 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev wlan0 parent :1 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 15663 bytes 104 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wlan0 parent :2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 25479 bytes 130 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wlan0 parent :3 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 9126804 bytes 65404 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 1474 drop_overlimit 0 new_flow_count 111 ecn_mark 0
  new_flows_len 1 old_flows_len 6
qdisc fq_codel 0: dev wlan0 parent :4 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 8130 bytes 21 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc htb 1: dev wlan1-1 root refcnt 5 r2q 10 default 12 direct_packets_stat 0 direct_qlen 1000
 Sent 5179 bytes 67 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 110: dev wlan1-1 parent 1:11 limit 1001p flows 1024 quantum 300 target 5.0ms interval 100.0ms ecn
 Sent 1314 bytes 23 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 90 drop_overlimit 0 new_flow_count 23 ecn_mark 0
  new_flows_len 1 old_flows_len 0
qdisc fq_codel 120: dev wlan1-1 parent 1:12 limit 1001p flows 1024 quantum 300 target 5.0ms interval 100.0ms ecn
 Sent 3865 bytes 44 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 113 drop_overlimit 0 new_flow_count 13 ecn_mark 0
  new_flows_len 1 old_flows_len 2
qdisc fq_codel 130: dev wlan1-1 parent 1:13 limit 1001p flows 1024 quantum 300 target 5.0ms interval 100.0ms ecn
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc ingress ffff: dev wlan1-1 parent ffff:fff1 ----------------
 Sent 4747 bytes 74 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev tun0 root refcnt 2 limit 10240p flows 1024 quantum 1500 target 5.0ms interval 100.0ms ecn
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc htb 1: dev ifb4wlan1-1 root refcnt 2 r2q 10 default 10 direct_packets_stat 0 direct_qlen 32
 Sent 5783 bytes 74 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 110: dev ifb4wlan1-1 parent 1:10 limit 1001p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 5783 bytes 74 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 201 drop_overlimit 0 new_flow_count 64 ecn_mark 0
  new_flows_len 1 old_flows_len 0

speedtest with sqm enabled (settings as post above ex. non available autorate_egress option):

"tc -s qdisc" output after speedtest:

 qdisc noqueue 0: dev lo root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev eth0 root refcnt 2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 6410290 bytes 18999 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth1 root refcnt 2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 707308013 bytes 1063327 pkt (dropped 0, overlimits 0 requeues 10)
 backlog 0b 0p requeues 10
  maxpacket 1514 drop_overlimit 0 new_flow_count 12355 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc cake 801e: dev eth2 root refcnt 2 bandwidth 19456Kbit besteffort triple-isolate rtt 100.0ms raw
 Sent 43663282 bytes 40664 pkt (dropped 60, overlimits 38925 requeues 0)
 backlog 0b 0p requeues 0
 memory used: 159936b of 4Mb
 capacity estimate: 19456Kbit
                 Tin 0
  thresh     19456Kbit
  target         5.0ms
  interval     100.0ms
  pk_delay       862us
  av_delay       337us
  sp_delay         8us
  pkts           40724
  bytes       43751542
  way_inds           0
  way_miss         281
  way_cols           0
  drops             60
  marks              0
  sp_flows           1
  bk_flows           1
  un_flows           0
  max_len        28006

qdisc ingress ffff: dev eth2 parent ffff:fff1 ----------------
 Sent 32760787 bytes 39372 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev br-lan root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth1.1 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth1.10 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc mq 0: dev wlan1 root
 Sent 743725453 bytes 601437 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev wlan1 parent :1 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 48724 bytes 288 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wlan1 parent :2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 313269 bytes 1613 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wlan1 parent :3 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 743344755 bytes 599477 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 1474 drop_overlimit 0 new_flow_count 841 ecn_mark 0
  new_flows_len 0 old_flows_len 4
qdisc fq_codel 0: dev wlan1 parent :4 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 18705 bytes 59 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev wlan0 root
 Sent 9217344 bytes 66304 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev wlan0 parent :1 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 15663 bytes 104 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wlan0 parent :2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 25479 bytes 130 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wlan0 parent :3 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 9168072 bytes 66049 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 1474 drop_overlimit 0 new_flow_count 111 ecn_mark 0
  new_flows_len 0 old_flows_len 2
qdisc fq_codel 0: dev wlan0 parent :4 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 8130 bytes 21 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc htb 1: dev wlan1-1 root refcnt 5 r2q 10 default 12 direct_packets_stat 0 direct_qlen 1000
 Sent 4075 bytes 52 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 110: dev wlan1-1 parent 1:11 limit 1001p flows 1024 quantum 300 target 5.0ms interval 100.0ms ecn
 Sent 810 bytes 15 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 54 drop_overlimit 0 new_flow_count 15 ecn_mark 0
  new_flows_len 1 old_flows_len 0
qdisc fq_codel 120: dev wlan1-1 parent 1:12 limit 1001p flows 1024 quantum 300 target 5.0ms interval 100.0ms ecn
 Sent 3265 bytes 37 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 113 drop_overlimit 0 new_flow_count 13 ecn_mark 0
  new_flows_len 1 old_flows_len 2
qdisc fq_codel 130: dev wlan1-1 parent 1:13 limit 1001p flows 1024 quantum 300 target 5.0ms interval 100.0ms ecn
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc ingress ffff: dev wlan1-1 parent ffff:fff1 ----------------
 Sent 3637 bytes 56 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev tun0 root refcnt 2 limit 10240p flows 1024 quantum 1500 target 5.0ms interval 100.0ms ecn
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc cake 801f: dev ifb4eth2 root refcnt 2 bandwidth 7922Kbit autorate_ingress besteffort triple-isolate wash rtt 100.0ms raw
 Sent 33255707 bytes 39333 pkt (dropped 39, overlimits 33044 requeues 0)
 backlog 0b 0p requeues 0
 memory used: 150784b of 4Mb
 capacity estimate: 8450Kbit
                 Tin 0
  thresh      7922Kbit
  target         5.0ms
  interval     100.0ms
  pk_delay       5.8ms
  av_delay       1.8ms
  sp_delay        10us
  pkts           39372
  bytes       33311995
  way_inds           0
  way_miss         224
  way_cols           0
  drops             39
  marks              0
  sp_flows           0
  bk_flows           1
  un_flows           0
  max_len         1474

qdisc htb 1: dev ifb4wlan1-1 root refcnt 2 r2q 10 default 10 direct_packets_stat 0 direct_qlen 32
 Sent 4421 bytes 56 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 110: dev ifb4wlan1-1 parent 1:10 limit 1001p flows 1024 quantum 1514 target 5.0ms interval 100.0ms ecn
 Sent 4421 bytes 56 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 201 drop_overlimit 0 new_flow_count 50 ecn_mark 0
  new_flows_len 1 old_flows_len 0

thx so far!

18

This from your egress indicates that you have offloading enabled, which you probably should not. BUt I am unsure whether that really is the problem with your configuration... I am not sure that autorate_ingress works for your setup. Could you try just for testing to set both ingress and egress to 10000 without the autorate_ingress option, if bufferbloat is still terrible with that configuration, I guess no level of playing with cake's options will help.

When you click on the downloading and uploading text under the bufferbloat bar plot you get a better resiolved version for the selected period (idle uploading or downloading) looking at those it seems clear that you upstream shaper works intended, but the downstream shaper is not very effective in reducing bufferbloat. BUT that shaper almost drops no packets:

So it seems that something is wrong, maybe autorate_ingress does not work in combination with an explicitly configured ingress bandwidth, if that is the case the hard ingress shaping at way below current available bandwidth should show decent bufferbloat reductions. Also try to increase the duration of the tests and do enable the High-Resolution bufferbloat testing for more information about the temporal development of the RTTs under load.

Oh, if your router suports that, you might want to try gargoyle as its automatic congestion controller (I believe that is the expansion of the ACC acronym) might do exactly what you want. Unlike cake's auto_ingress otion it will require to explicitly select a ping host against which to test latency increase due to buffering. This might or might not work better, but first please try to set ingress to something below 10000 (both ingress bandwith plots of this test show longer periods of sub 10Mbps bandwidth, so maybe your rates truly fluctuate on a time basis too short for cake to follow, so first establish whether cake works at all with your ingess, okay?)

Best Regards

19

Are you enabling SQM on the WAN/LTE interface or on the LAN interface ?... I had exactly that problem one time, changed the interface to LAN and reversed the ingress/egress and worked like a charm.

20

This is good advise, the directionality of ingress and egress for SQM are always from the point of view of the router, in case of the WAN interface egress for the WAN and egress towards the internel are aligned, and so are router ingress and internet ingress; but if sqm is instantiated on an internally facing interface like LAN then ingress from the router's perspective equals egress to the internet, and the router's egress equals internet ingress. That is why you need to "flip" the values on sqm on internal interfaces, IF you really want to shape internet bandwidths. Hope this clarifies @braian87b 's excellent observation.

Best Regards

21

Thx for your reply! I don't think I got it... I enabled SQM on eth2 (WAN/LTE interface). Ingress = download and egress = upload, for example=50000 ingress, 20000 egress?

thx for your help!!

so long

22

I really can not tell that, as it depends on the hardware configuration of your router. But there is a quite easy test, in the GUI you set one of the bandwidth, say upload to 5000 and the other to 0 (which effectively disables the shaper on download, zero just signals no shaping, as shaping to 0 ist completely no-sensical). Now run a speedtest, if the results show that the upload speed is limited to around 5000, then the GUIs directionality is correct, if however the test shows that the download bandwidth was limited, you will need to switch ingress and egress values in the GUI. If that should be the case it would probably also indicate why autorate_ingress does not seem to have any meaningfull effect, as it would act on the egress part of the link (which as your tests show does not seem to suffer from bufferbloat).

So how about you do two tests, with 5000/0 and 0/5000 and test duration 30c seconds and high-resolution buffer bloat measurements configured and post the results here (please also post the output of "tc -s qdisc" after each speedtest)? Then we can discuss the directionality in an informed manner.

Also I hope you are testing via ethernet and not via wlan1-1, as you seem to have another htb shaper instantiated on the wlan interface...

Best Regards