SQM not pushing cpu

Installing and Using OpenWrt
1

I have a DL-WRX36 which has 4 cores. My speedtest .net gets 1gigbits. When i use waveform it gets down to 120mbps during the test and I still get c grade when i put the download rate to 350,000. If i lower it down to 100,000 the grade goes to A. Throughout the whole time only cpu0 never hit above 60% and the rest stay at 0-10% its a fresh install and recently rebooted. Can i assign a cpu to sqm? If the cpu is staying low then is the xfinity xb7 modem in bridge gutting overwhelmed? How would i test that? Plug laptop in directly and try again? Apologies on phone

Unloaded connection

root@OpenWrt:~#  tc -s qdisc
qdisc noqueue 0: dev lo root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc mq 0: dev lan4 root
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan4 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan3 root
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan3 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan2 root
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan2 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan1 root
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan1 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev wan root
 Sent 433045046 bytes 1440741 pkt (dropped 0, overlimits 0 requeues 654)
 backlog 0b 0p requeues 654
qdisc fq_codel 0: dev wan parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 122260742 bytes 372388 pkt (dropped 0, overlimits 0 requeues 225)
 backlog 0b 0p requeues 225
  maxpacket 110 drop_overlimit 0 new_flow_count 4 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wan parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 121678393 bytes 401124 pkt (dropped 0, overlimits 0 requeues 198)
 backlog 0b 0p requeues 198
  maxpacket 102 drop_overlimit 0 new_flow_count 2 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wan parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 123650337 bytes 438590 pkt (dropped 0, overlimits 0 requeues 224)
 backlog 0b 0p requeues 224
  maxpacket 110 drop_overlimit 0 new_flow_count 1 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wan parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 65455574 bytes 228639 pkt (dropped 0, overlimits 0 requeues 7)
 backlog 0b 0p requeues 7
  maxpacket 110 drop_overlimit 0 new_flow_count 7 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc ingress ffff: dev wan parent ffff:fff1 ----------------
 Sent 236827016 bytes 180033 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev br-lan root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev phy1-ap0 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev phy0-ap0 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc cake 8024: dev ifb4wan root refcnt 2 bandwidth 100Mbit besteffort triple-isolate nonat wash no-ack-filter split-gso rtt 100ms noatm overhead 42
 Sent 240774866 bytes 180026 pkt (dropped 7, overlimits 287408 requeues 0)
 backlog 0b 0p requeues 0
 memory used: 1302188b of 5000000b
 capacity estimate: 100Mbit
 min/max network layer size:           46 /    1500
 min/max overhead-adjusted size:       88 /    1542
 average network hdr offset:           14

                  Tin 0
  thresh        100Mbit
  target            5ms
  interval        100ms
  pk_delay       1.18ms
  av_delay        252us
  sp_delay         14us
  backlog            0b
  pkts           180033
  bytes       240784302
  way_inds            0
  way_miss          370
  way_cols            0
  drops               7
  marks               2
  ack_drop            0
  sp_flows            3
  bk_flows            1
  un_flows            0
  max_len         19318
  quantum          1514

Loaded connection

root@OpenWrt:~#  tc -s qdisc
qdisc noqueue 0: dev lo root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc mq 0: dev lan4 root
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan4 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan3 root
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan3 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan2 root
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan2 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan1 root
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan1 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev wan root
 Sent 545671865 bytes 1596417 pkt (dropped 0, overlimits 0 requeues 654)
 backlog 0b 0p requeues 654
qdisc fq_codel 0: dev wan parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 124789330 bytes 393644 pkt (dropped 0, overlimits 0 requeues 225)
 backlog 0b 0p requeues 225
  maxpacket 110 drop_overlimit 0 new_flow_count 4 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wan parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 125198020 bytes 429588 pkt (dropped 0, overlimits 0 requeues 198)
 backlog 0b 0p requeues 198
  maxpacket 102 drop_overlimit 0 new_flow_count 2 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wan parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 126066676 bytes 464282 pkt (dropped 0, overlimits 0 requeues 224)
 backlog 0b 0p requeues 224
  maxpacket 110 drop_overlimit 0 new_flow_count 1 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wan parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 169617839 bytes 308903 pkt (dropped 0, overlimits 0 requeues 7)
 backlog 0b 0p requeues 7
  maxpacket 110 drop_overlimit 0 new_flow_count 7 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc ingress ffff: dev wan parent ffff:fff1 ----------------
 Sent 501611396 bytes 400149 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev br-lan root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev phy1-ap0 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev phy0-ap0 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc cake 8024: dev ifb4wan root refcnt 2 bandwidth 100Mbit besteffort triple-isolate nonat wash no-ack-filter split-gso rtt 100ms noatm overhead 42
 Sent 511595244 bytes 400036 pkt (dropped 113, overlimits 587259 requeues 0)
 backlog 0b 0p requeues 0
 memory used: 1302188b of 5000000b
 capacity estimate: 100Mbit
 min/max network layer size:           46 /    1500
 min/max overhead-adjusted size:       88 /    1542
 average network hdr offset:           14

                  Tin 0
  thresh        100Mbit
  target            5ms
  interval        100ms
  pk_delay       3.47ms
  av_delay        496us
  sp_delay        223us
  backlog            0b
  pkts           400149
  bytes       511764054
  way_inds            0
  way_miss          460
  way_cols            0
  drops             113
  marks              11
  ack_drop            0
  sp_flows            0
  bk_flows            1
  un_flows            0
  max_len         19682
  quantum          1514

sqm start stop logread

root@OpenWrt:~# SQM_DEBUG=1 SQM_VERBOSITY_MAX=8 /etc/init.d/sqm stop ; SQM_DEBUG
=1 SQM_VERBOSITY_MAX=8 /etc/init.d/sqm start
/usr/lib/sqm/run.sh: line 57: can't create : nonexistent directory
SQM: Stopping SQM on wan
SQM: ERROR: cmd_wrapper: tc: FAILURE (2): /sbin/tc qdisc del dev wan root
SQM: ERROR: cmd_wrapper: tc: LAST ERROR: Error: Cannot delete qdisc with handle of zero.
/usr/lib/sqm/run.sh: line 57: can't create : nonexistent directory
SQM: Starting SQM script: piece_of_cake.qos on wan, in: 100000 Kbps, out: 0 Kbps
SQM: fn_exists: function candidate name: sqm_start
SQM: fn_exists: TYPE_OUTPUT: sqm_start: not found
SQM: fn_exists: return value: 1
SQM: Using generic sqm_start_default function.
SQM: fn_exists: function candidate name: sqm_prepare_script
SQM: fn_exists: TYPE_OUTPUT: sqm_prepare_script is a function
SQM: fn_exists: return value: 0
SQM: sqm_start_default: starting sqm_prepare_script
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link add name SQM_IFB_c8a43 type ifb
SQM: cmd_wrapper: tc: SUCCESS: /sbin/tc qdisc replace dev SQM_IFB_c8a43 root cake
SQM: QDISC cake is useable.
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link set dev SQM_IFB_c8a43 down
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link delete SQM_IFB_c8a43 type ifb
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link add name SQM_IFB_feeb4 type ifb
SQM: cmd_wrapper: tc: SUCCESS: /sbin/tc qdisc replace dev SQM_IFB_feeb4 root cake
SQM: QDISC cake is useable.
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link set dev SQM_IFB_feeb4 down
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link delete SQM_IFB_feeb4 type ifb
SQM: sqm_start_default: Starting piece_of_cake.qos
SQM: ifb associated with interface wan:
SQM: Currently no ifb is associated with wan, this is normal during starting of the sqm system.
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link add name ifb4wan type ifb
SQM: sqm_start_default: egress shaping deactivated
SQM: cmd_wrapper: tc: invocation silenced by request, FAILURE either expected or acceptable.
SQM: cmd_wrapper: tc: FAILURE (2): /sbin/tc qdisc del dev wan root
SQM: cmd_wrapper: tc: LAST ERROR: Error: Cannot delete qdisc with handle of zero.
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link add name SQM_IFB_08349 type ifb
SQM: cmd_wrapper: tc: SUCCESS: /sbin/tc qdisc replace dev SQM_IFB_08349 ingress
SQM: QDISC ingress is useable.
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link set dev SQM_IFB_08349 down
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link delete SQM_IFB_08349 type ifb
SQM: fn_exists: function candidate name: ingress
SQM: fn_exists: TYPE_OUTPUT: ingress is a function
SQM: fn_exists: return value: 0
SQM: ingress
SQM: cmd_wrapper: tc: invocation silenced by request, FAILURE either expected or acceptable.
SQM: cmd_wrapper: tc: FAILURE (2): /sbin/tc qdisc del dev wan handle ffff: ingress
SQM: cmd_wrapper: tc: LAST ERROR: Error: Invalid handle.
SQM: cmd_wrapper: tc: SUCCESS: /sbin/tc qdisc add dev wan handle ffff: ingress
SQM: cmd_wrapper: tc: invocation silenced by request, FAILURE either expected or acceptable.
SQM: cmd_wrapper: tc: FAILURE (2): /sbin/tc qdisc del dev ifb4wan root
SQM: cmd_wrapper: tc: LAST ERROR: Error: Cannot delete qdisc with handle of zero.
SQM: LLA: default link layer adjustment method for cake is cake
SQM: cake link layer adjustments:  overhead 42 mpu 0
SQM: cmd_wrapper: tc: SUCCESS: /sbin/tc qdisc add dev ifb4wan root cake bandwidth 100000kbit overhead 42 mpu 0 besteffort wash
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link set dev ifb4wan up
SQM: cmd_wrapper: tc: SUCCESS: /sbin/tc filter add dev wan parent ffff: protocol all prio 10 u32 match u32 0 0 flowid 1:1 action mirred egress redirect dev ifb4wan
SQM: sqm_start_default: ingress shaping activated
SQM: piece_of_cake.qos was started on wan successfully

config

config queue 'eth1'
        option enabled '1'
        option interface 'wan'
        option download '120000'
        option upload '35000'
        option qdisc 'cake'
        option script 'piece_of_cake.qos'
        option linklayer 'ethernet'
        option debug_logging '0'
        option verbosity '5'
        option overhead '22'

{
  "up": true,
  "pending": false,
  "available": true,
  "autostart": true,
  "dynamic": false,
  "uptime": 38493,
  "l3_device": "wan",
  "proto": "dhcp",
  "device": "wan",
  "updated": [
    "data"
  ],
  "metric": 0,
  "dns_metric": 0,
  "delegation": true,
  "ipv4-address": [
    {
      "address": "69.255.224.43",
      "mask": 23
    }
  ],
  "ipv6-address": [],
  "ipv6-prefix": [],
  "ipv6-prefix-assignment": [],
  "route": [
    {
      "target": "0.0.0.0",
      "mask": 0,
      "nexthop": "69.255.224.1",
      "source": "69.255.224.43/32"
    }
  ],
  "dns-server": [
    "75.75.75.75",
    "75.75.76.76"
  ],
  "dns-search": [
    "hsd1.md.comcast.net."
  ],
  "neighbors": [],
  "inactive": {
    "ipv4-address": [],
    "ipv6-address": [],
    "route": [],
    "dns-server": [],
    "dns-search": [],
    "neighbors": []
  },
  "data": {
    "dhcpserver": "69.241.109.143",
    "hostname": "OpenWrt",
    "leasetime": 345600
  }
}
2

Swapped governer to performance with no change, adjusted MTU to 2k with no change. Enabled packet steering with no change.

3

Reading other peoples posts i think part of the issue is that comcast bursts initial downloads and that throws off the sqm greatly. Need to find out if some system exists that knows it will happen and adjust the download rate in sqm temporary to compensate it. One issue could be if sqm restarts when a new value is passed. Or another queue management suite all together.

4

check this thread: CAKE w/ Adaptive Bandwidth may help you

5

How did you measure that? The cost of a traffic-shaper/AQM is mainly accounted as SIRQ (soft-interrupt) and e.g. top dies not show this by default. So if you use top the "trick" is to look at the idle% and if the CPU running cake/HTB drops below 10% idle sqm will likely be CPU limited.
htop can be configured to show the CPU load per CPU and with details including SIRQ...

6

I used htop with more details turned on to show sirq and such. The sirq did show higher, I'm starting to think its what was posted earlier, comcast bursts my download and then sqm is rendered less than useful. Looking through cake variable rate scripts now!

Edit:
Running some more tests, Core0 does hit 80%~ during wired bufferbloat tests.

Something else I noticed was my ipad air does poorly in comparison to my usb WIFI adapter on my pc or my galaxy s21 ultra.

The odds should be good that a single cpu should handle sqm for 350,000kbits? I know i cant multi proc/thread it due push/pull rates. Possible I should assign sqm to a free cpu ?

7

Quick note, please add the tc -s qdisc output from directly before and directly after a speedtest (waveform or speed.cloudflare.com) with sqm set to 350 Mbps.
Also you should enable SQM on the uplink as well, the posted output of 100/0 shows no sign of being CPU-bound...

8

I installed cake autorate which in theory should help in the long run, switching to simplest_tbf.qos however dropped the additional latency added from < premature, still goes to previous latency issues. still 50 m/s +/- 15 to 10 m/s +/- 10m/s>. This looks like a winner and i want to know why!

I set the upload to 0 because it's never had a bit of additional latency from any tests i've done. It seemed useless but i am happy to enable it if experience says it'll help.

pre tc -s qdisc speedtest

qdisc noqueue 0: dev lo root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc mq 0: dev lan4 root
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan4 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan3 root
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan3 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan2 root
 Sent 6365915809 bytes 4748388 pkt (dropped 0, overlimits 0 requeues 26245)
 backlog 0b 0p requeues 26245
qdisc fq_codel 0: dev lan2 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 1207701209 bytes 937658 pkt (dropped 0, overlimits 0 requeues 9172)
 backlog 0b 0p requeues 9172
  maxpacket 1434 drop_overlimit 0 new_flow_count 416 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 824583992 bytes 638211 pkt (dropped 0, overlimits 0 requeues 8320)
 backlog 0b 0p requeues 8320
  maxpacket 1434 drop_overlimit 0 new_flow_count 253 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 2584021032 bytes 1869740 pkt (dropped 0, overlimits 0 requeues 8661)
 backlog 0b 0p requeues 8661
  maxpacket 1434 drop_overlimit 0 new_flow_count 406 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 1749609576 bytes 1302779 pkt (dropped 0, overlimits 0 requeues 92)
 backlog 0b 0p requeues 92
  maxpacket 1434 drop_overlimit 0 new_flow_count 89 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan1 root
 Sent 8342122 bytes 120651 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan1 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 2309395 bytes 35928 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 1979845 bytes 28717 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 1928858 bytes 25917 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 2124024 bytes 30089 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc tbf 1: dev wan root refcnt 5 rate 37Mbit burst 4620b lat 300ms
 Sent 82799598 bytes 313017 pkt (dropped 15, overlimits 49052 requeues 0)
 backlog 4292517632b 0p requeues 0
qdisc fq_codel 110: dev wan parent 1: limit 1001p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 82799598 bytes 313017 pkt (dropped 15, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 4432 drop_overlimit 0 new_flow_count 283315 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc ingress ffff: dev wan parent ffff:fff1 ----------------
 Sent 514378936 bytes 392321 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev br-lan root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev phy0-ap0 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev phy1-ap0 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc tbf 1: dev ifb4wan root refcnt 2 rate 350Mbit burst 43706b lat 300ms
 Sent 522029552 bytes 390919 pkt (dropped 988, overlimits 436107 requeues 0)
 backlog 4294918540b 0p requeues 0
qdisc fq_codel 110: dev ifb4wan parent 1: limit 1001p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 522029552 bytes 390919 pkt (dropped 988, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 43616 drop_overlimit 0 new_flow_count 49156 ecn_mark 0
  new_flows_len 0 old_flows_len 0

post speedtest

qdisc noqueue 0: dev lo root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc mq 0: dev lan4 root
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan4 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan3 root
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan3 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan2 root
 Sent 7360666879 bytes 5475894 pkt (dropped 0, overlimits 0 requeues 28747)
 backlog 0b 0p requeues 28747
qdisc fq_codel 0: dev lan2 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 1207916041 bytes 939205 pkt (dropped 0, overlimits 0 requeues 9212)
 backlog 0b 0p requeues 9212
  maxpacket 1434 drop_overlimit 0 new_flow_count 417 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 1089362427 bytes 824762 pkt (dropped 0, overlimits 0 requeues 8607)
 backlog 0b 0p requeues 8607
  maxpacket 1434 drop_overlimit 0 new_flow_count 256 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 3092530289 bytes 2241703 pkt (dropped 0, overlimits 0 requeues 10836)
 backlog 0b 0p requeues 10836
  maxpacket 1434 drop_overlimit 0 new_flow_count 411 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 1970858122 bytes 1470224 pkt (dropped 0, overlimits 0 requeues 92)
 backlog 0b 0p requeues 92
  maxpacket 1434 drop_overlimit 0 new_flow_count 89 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan1 root
 Sent 8474155 bytes 122645 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan1 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 2349150 bytes 36586 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 2008991 bytes 29062 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 1962015 bytes 26364 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 2153999 bytes 30633 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc tbf 1: dev wan root refcnt 5 rate 37Mbit burst 4620b lat 300ms
 Sent 237129828 bytes 876898 pkt (dropped 24, overlimits 151195 requeues 17)
 backlog 4287975450b 0p requeues 17
qdisc fq_codel 110: dev wan parent 1: limit 1001p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 237129828 bytes 876898 pkt (dropped 24, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 4592 drop_overlimit 0 new_flow_count 786703 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc ingress ffff: dev wan parent ffff:fff1 ----------------
 Sent 1500640697 bytes 1135693 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev br-lan root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev phy0-ap0 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev phy1-ap0 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc tbf 1: dev ifb4wan root refcnt 2 rate 350Mbit burst 43706b lat 300ms
 Sent 1522286760 bytes 1132637 pkt (dropped 1861, overlimits 1162051 requeues 0)
 backlog 4293845908b 0p requeues 0
qdisc fq_codel 110: dev ifb4wan parent 1: limit 1001p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 1522286760 bytes 1132637 pkt (dropped 1861, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 43616 drop_overlimit 0 new_flow_count 135411 ecn_mark 0
  new_flows_len 0 old_flows_len 0
9

Cake-autorate, as the name implies, only works when cake is used as traffic shaper, it will not affect HTB or TBF type shapers at all.

If we want to figure out what caused cake to have issues you need to, at lest temporarily, switch back to using cake....

Now if cake gets short on CPU cycles it will accumulate higher delays while delivering higher throughput, while HTB will stick closer to the configured delay target but showing less throughput.
So TBF doing better is an indication that cake might run out of CPU cycles.
I am not all that surprised though, the arm a53 cores are decent but not really great, which is fine as they are out of arm's efficiency line. But what else are you running on your router?

10

I didnt notice that it reverts to another system when tbf is used until i read the logs! Thank you, ill swap it back!

Im happy to place with affinities but the hardware i have apparently doesnt play well with the irqbalance scripts

Im running adblock, sqm, cake auto rater and luci ontop of openwrt im
Some process output luci provides:

Status
Overview
Routing
Firewall
System Log
Processes
Channel Analysis
Realtime Graphs
System
System
Administration
Software
Startup
Scheduled Tasks
LED Configuration
Backup / Flash Firmware
Reboot
Services
Adblock
Network
Interfaces
Wireless
Routing
DHCP and DNS
Diagnostics
SQM QoS
Firewall
Logout
Processes
This list gives an overview over currently running system processes and their status.
1
root
/sbin/procd
0%
0%
Hang Up
Terminate
Kill
2
root
[kthreadd]
0%
0%
Hang Up
Terminate
Kill
3
root
[rcu_gp]
0%
0%
Hang Up
Terminate
Kill
4
root
[rcu_par_gp]
0%
0%
Hang Up
Terminate
Kill
5
root
[slub_flushwq]
0%
0%
Hang Up
Terminate
Kill
6
root
[netns]
0%
0%
Hang Up
Terminate
Kill
8
root
[kworker/0:0H-ev]
0%
0%
Hang Up
Terminate
Kill
10
root
[mm_percpu_wq]
0%
0%
Hang Up
Terminate
Kill
11
root
[rcu_tasks_trace]
0%
0%
Hang Up
Terminate
Kill
12
root
[ksoftirqd/0]
0%
0%
Hang Up
Terminate
Kill
13
root
[rcu_sched]
0%
0%
Hang Up
Terminate
Kill
14
root
[migration/0]
0%
0%
Hang Up
Terminate
Kill
15
root
[cpuhp/0]
0%
0%
Hang Up
Terminate
Kill
16
root
[cpuhp/1]
0%
0%
Hang Up
Terminate
Kill
17
root
[migration/1]
0%
0%
Hang Up
Terminate
Kill
18
root
[ksoftirqd/1]
0%
0%
Hang Up
Terminate
Kill
20
root
[kworker/1:0H-kb]
0%
0%
Hang Up
Terminate
Kill
21
root
[cpuhp/2]
0%
0%
Hang Up
Terminate
Kill
22
root
[migration/2]
0%
0%
Hang Up
Terminate
Kill
23
root
[ksoftirqd/2]
0%
0%
Hang Up
Terminate
Kill
25
root
[kworker/2:0H-ev]
0%
0%
Hang Up
Terminate
Kill
26
root
[cpuhp/3]
0%
0%
Hang Up
Terminate
Kill
27
root
[migration/3]
0%
0%
Hang Up
Terminate
Kill
28
root
[ksoftirqd/3]
0%
0%
Hang Up
Terminate
Kill
29
root
[kworker/3:0-pm]
0%
0%
Hang Up
Terminate
Kill
30
root
[kworker/3:0H-kb]
0%
0%
Hang Up
Terminate
Kill
31
root
[inet_frag_wq]
0%
0%
Hang Up
Terminate
Kill
33
root
[kworker/1:1-eve]
0%
0%
Hang Up
Terminate
Kill
34
root
[oom_reaper]
0%
0%
Hang Up
Terminate
Kill
35
root
[writeback]
0%
0%
Hang Up
Terminate
Kill
36
root
[kcompactd0]
0%
0%
Hang Up
Terminate
Kill
37
root
[pencrypt_serial]
0%
0%
Hang Up
Terminate
Kill
38
root
[pdecrypt_serial]
0%
0%
Hang Up
Terminate
Kill
39
root
[kblockd]
0%
0%
Hang Up
Terminate
Kill
40
root
[blkcg_punt_bio]
0%
0%
Hang Up
Terminate
Kill
41
root
[watchdogd]
0%
0%
Hang Up
Terminate
Kill
49
root
[kswapd0]
0%
0%
Hang Up
Terminate
Kill
55
root
[kworker/0:1H-kb]
0%
0%
Hang Up
Terminate
Kill
57
root
[kthrotld]
0%
0%
Hang Up
Terminate
Kill
198
root
[iscsi_conn_clea]
0%
0%
Hang Up
Terminate
Kill
275
root
[irq/22-4a9000.t]
0%
0%
Hang Up
Terminate
Kill
312
root
[mld]
0%
0%
Hang Up
Terminate
Kill
313
root
[ipv6_addrconf]
0%
0%
Hang Up
Terminate
Kill
314
root
[kworker/2:1H-kb]
0%
0%
Hang Up
Terminate
Kill
315
root
[kstrp]
0%
0%
Hang Up
Terminate
Kill
362
root
[irq/26-cpr3]
0%
0%
Hang Up
Terminate
Kill
366
root
[irq/19-smp2p]
0%
0%
Hang Up
Terminate
Kill
506
root
[irq/24-q6v5 wdo]
0%
0%
Hang Up
Terminate
Kill
518
root
[ubi_bgt0d]
0%
0%
Hang Up
Terminate
Kill
525
root
[kworker/3:1H-kb]
0%
0%
Hang Up
Terminate
Kill
548
root
[irq/34-keys]
0%
0%
Hang Up
Terminate
Kill
549
root
[irq/63-keys]
0%
0%
Hang Up
Terminate
Kill
574
root
[kworker/u8:2-ev]
0%
0%
Hang Up
Terminate
Kill
664
root
[kworker/1:1H-kb]
0%
0%
Hang Up
Terminate
Kill
746
root
[ubifs_bgt0_2]
0%
0%
Hang Up
Terminate
Kill
883
ubus
/sbin/ubusd
0%
0%
Hang Up
Terminate
Kill
884
root
/sbin/askfirst /usr/libexec/login.sh
0%
0%
Hang Up
Terminate
Kill
919
root
/sbin/urngd
0%
0%
Hang Up
Terminate
Kill
1042
root
[cfg80211]
0%
0%
Hang Up
Terminate
Kill
1081
root
[ath11k_wq]
0%
0%
Hang Up
Terminate
Kill
1082
root
[ath11k_aux_wq]
0%
0%
Hang Up
Terminate
Kill
1210
logd
/sbin/logd -S 64
0%
0%
Hang Up
Terminate
Kill
1267
root
[napi/-6]
0%
0%
Hang Up
Terminate
Kill
1269
root
[napi/-7]
0%
0%
Hang Up
Terminate
Kill
1270
root
[napi/-8]
0%
0%
Hang Up
Terminate
Kill
1271
root
[napi/-9]
0%
0%
Hang Up
Terminate
Kill
1272
root
[napi/-10]
0%
0%
Hang Up
Terminate
Kill
1273
root
[napi/-11]
0%
0%
Hang Up
Terminate
Kill
1274
root
[napi/-12]
0%
0%
Hang Up
Terminate
Kill
1275
root
[napi/-13]
0%
0%
Hang Up
Terminate
Kill
1276
root
[napi/-14]
0%
0%
Hang Up
Terminate
Kill
1277
root
[napi/-15]
0%
0%
Hang Up
Terminate
Kill
1278
root
[napi/-16]
3%
0%
Hang Up
Terminate
Kill
1291
root
/sbin/rpcd -s /var/run/ubus/ubus.sock -t 30
0%
0%
Hang Up
Terminate
Kill
1539
root
/usr/sbin/dropbear -F -P /var/run/dropbear.1.pid -p 22 -K 300 -T 3
0%
0%
Hang Up
Terminate
Kill
1663
root
{hostapd} /sbin/ujail -t 5 -n hostapd -U network -G network -C /etc/capabilities/wpad.json -c -- /usr/sbin/hostapd -s -g /var/run/hostapd/global
0%
0%
Hang Up
Terminate
Kill
1664
root
{wpa_supplicant} /sbin/ujail -t 5 -n wpa_supplicant -U network -G network -C /etc/capabilities/wpad.json -c -- /usr/sbin/wpa_supplicant -n -s -g /var/run/wpa_supplicant/global
0%
0%
Hang Up
Terminate
Kill
1708
network
/usr/sbin/hostapd -s -g /var/run/hostapd/global
0%
0%
Hang Up
Terminate
Kill
1709
network
/usr/sbin/wpa_supplicant -n -s -g /var/run/wpa_supplicant/global
0%
0%
Hang Up
Terminate
Kill
1728
root
/sbin/netifd
0%
0%
Hang Up
Terminate
Kill
1961
root
/usr/sbin/odhcpd
0%
0%
Hang Up
Terminate
Kill
2755
root
[kworker/u8:3-ev]
0%
0%
Hang Up
Terminate
Kill
2828
root
[kworker/u8:5-ev]
0%
0%
Hang Up
Terminate
Kill
2857
root
/usr/sbin/uhttpd -f -h /www -r OpenWrt -x /cgi-bin -u /ubus -t 60 -T 30 -k 20 -A 1 -n 3 -N 100 -R -p 0.0.0.0:80 -p [::]:80 -C /etc/uhttpd.crt -K /etc/uhttpd.key -s 0.0.0.0:443 -s [::]:443
0%
0%
Hang Up
Terminate
Kill
2922
root
/usr/sbin/collectd -C /tmp/collectd.conf -f
0%
0%
Hang Up
Terminate
Kill
3529
root
{ntpd} /sbin/ujail -t 5 -n ntpd -U ntp -G ntp -C /etc/capabilities/ntpd.json -c -u -r /bin/ubus -r /usr/bin/env -r /usr/bin/jshn -r /usr/sbin/ntpd-hotplug -r /usr/share/libubox/jshn.sh -- /usr/sbin/ntpd -n -N -S /usr/sbin/ntpd-hotplug -p 0.openwrt.pool.ntp.org -p 1.openwrt.pool.ntp.org -p 2.openwrt.pool.ntp.org -p 3.openwrt.pool.ntp.org
0%
0%
Hang Up
Terminate
Kill
3650
ntp
/usr/sbin/ntpd -n -N -S /usr/sbin/ntpd-hotplug -p 0.openwrt.pool.ntp.org -p 1.openwrt.pool.ntp.org -p 2.openwrt.pool.ntp.org -p 3.openwrt.pool.ntp.org
0%
0%
Hang Up
Terminate
Kill
3752
root
odhcp6c -s /lib/netifd/dhcpv6.script -P0 -t120 wan
0%
0%
Hang Up
Terminate
Kill
3755
root
udhcpc -p /var/run/udhcpc-wan.pid -s /lib/netifd/dhcp.script -f -t 0 -i wan -x hostname:OpenWrt -C -R -O 121
0%
0%
Hang Up
Terminate
Kill
4066
root
[kworker/u8:1-ev]
0%
0%
Hang Up
Terminate
Kill
5198
root
[kworker/2:0-eve]
0%
0%
Hang Up
Terminate
Kill
5518
root
[kworker/u8:0]
0%
0%
Hang Up
Terminate
Kill
6041
root
[kworker/u8:6-ev]
0%
0%
Hang Up
Terminate
Kill
6173
root
[kworker/0:2-eve]
0%
0%
Hang Up
Terminate
Kill
6212
root
[kworker/2:2-mm_]
0%
0%
Hang Up
Terminate
Kill
6326
root
{cake-autorate.s} /bin/bash /root/cake-autorate/cake-autorate.sh /root/cake-autorate/cake-autorate_config.primary.sh
0%
0%
Hang Up
Terminate
Kill
6327
root
fping --timestamp --loop --period 300 --interval 50 --timeout 10000 8.8.4.4 94.140.15.16 156.154.71.5 156.154.70.4 8.8.8.8 208.67.220.220
0%
0%
Hang Up
Terminate
Kill
6417
root
ucode /www/cgi-bin/luci
3%
0%
Hang Up
Terminate
Kill
9226
root
/usr/sbin/dropbear -F -P /var/run/dropbear.1.pid -p 22 -K 300 -T 3 -2 9
0%
0%
Hang Up
Terminate
Kill
9242
root
-ash
0%
0%
Hang Up
Terminate
Kill
20297
root
[kworker/1:0-mm_]
0%
0%
Hang Up
Terminate
Kill
22893
root
/usr/sbin/crond -f -c /etc/crontabs -l 5
0%
0%
Hang Up
Terminate
Kill
23441
root
[kworker/0:0-eve]
0%
0%
Hang Up
Terminate
Kill
24057
root
[kworker/2:1-eve]
0%
0%
Hang Up
Terminate
Kill
24447
root
[kworker/u8:4-ev]
0%
0%
Hang Up
Terminate
Kill
25214
root
[kworker/3:1-eve]
0%
0%
Hang Up
Terminate
Kill
27135
root
{dnsmasq} /sbin/ujail -t 5 -n dnsmasq -u -l -r /bin/ubus -r /etc/TZ -r /etc/dnsmasq.conf -r /etc/ethers -r /etc/group -r /etc/hosts -r /etc/passwd -w /tmp/dhcp.leases -r /tmp/dnsmasq.d -r /tmp/hosts -r /tmp/resolv.conf.d -r /usr/bin/jshn -r /usr/lib/dnsmasq/dhcp-script.sh -r /usr/share/dnsmasq/dhcpbogushostname.conf -r /usr/share/dnsmasq/rfc6761.conf -r /usr/share/dnsmasq/trust-anchors.conf -r /usr/sh
0%
0%
Hang Up
Terminate
Kill
27173
dnsmasq
/usr/sbin/dnsmasq -C /var/etc/dnsmasq.conf.cfg01411c -k -x /var/run/dnsmasq/dnsmasq.cfg01411c.pid
0%
1%
Hang Up
Terminate
Kill
30650
root
{cake-autorate.s} /bin/bash /root/cake-autorate/cake-autorate.sh /root/cake-autorate/cake-autorate_config.primary.sh
0%
0%
Hang Up
Terminate
Kill
30682
root
{cake-autorate.s} /bin/bash /root/cake-autorate/cake-autorate.sh /root/cake-autorate/cake-autorate_config.primary.sh
0%
0%
Hang Up
Terminate
Kill
30686
root
{cake-autorate.s} /bin/bash /root/cake-autorate/cake-autorate.sh /root/cake-autorate/cake-autorate_config.primary.sh
0%
0%
Hang Up
Terminate
Kill
30697
root
{cake-autorate.s} /bin/bash /root/cake-autorate/cake-autorate.sh /root/cake-autorate/cake-autorate_config.primary.sh
0%
0%
Hang Up
Terminate
Kill
30698
root
{cake-autorate.s} /bin/bash /root/cake-autorate/cake-autorate.sh /root/cake-autorate/cake-autorate_config.primary.sh
0%
0%
Hang Up
Terminate
Kill
30702
root
{cake-autorate.s} /bin/bash /root/cake-autorate/cake-autorate.sh /root/cake-autorate/cake-autorate_config.primary.sh
0%
0%
Hang Up
Terminate
Kill
Powered by LuCI Master (git-23.158.78004-23a246e) / OpenWrt SNAPSHOT (r23370-244328b19c
11

That is not too much, so I really would like to see:

  1. the screenshot (and if available link to the results page) of a speedtest with sqm disabled (waveform bufferbloat test is OK, or speed.cloudflare.com)
  2. enable sqm (with the shaper rate set to 500/50) and post the output of tc -s qdisc
  3. run a speedtest again (same test as in 1) and post a link/screenshot to the results
  4. post the output of tc -s qdisc taken immediately after the test (the closer the better)

The goal is to document cake statistics that might show cake overtaxing your CPU...

12

How long should i wait before the tc -s qdisc is cleared of previous activity and how long is to long to capture relevant data in the logs?
Is 15-20 seconds to long to wait? I want to make sure i get you clean accurate data.

Disable sqm
+n seconds
speedtest run
+n seconds
enable sqm at 500/50 && post tc -s qdisc output
+n seconds
run speedtest again, grab screen shot
+n seconds
get tc -s disc?

13

Results below:

Disabled SQM csv output from speedtest

time,direction,bytes,latency,bps,duration,serverTime,responseSize
1687114683206,download,100000,19.39990103576278,37495500.5006358,21.39990103576278,71.000099,100300
1687114685929,download,100000,16.89988197615814,43373249.623970576,18.499882,51.000118,100300
1687114686049,download,100000,19.80007801192093,37495190.375430755,21.40007803576279,56.999922,100300
1687114686150,download,100000,16.700150988079073,45590518.03762615,17.600150964237216,57.999849,100300
1687114686231,download,100000,18.300162011920932,41791314.07840159,19.200161988079074,44.999838,100300
1687114686381,download,100000,17.10004596423721,42231476.702740625,19.000045999999998,72.999954,100300
1687114686457,download,100000,21.69997498807907,35039339.507877,22.899975035762786,49.000025,100300
1687114686570,download,100000,18.40007803576279,17330424.363289524,46.30007801192093,56.999922,100300
1687114686677,download,100000,19.60007802384186,27016764.074561182,29.700077988079073,56.999922,100300
1687114686772,download,100000,19.50013,29499858.9563115,27.200130047683714,60.99987,100300
1687114686942,download,1000000,24.299869952316286,83707226.82984406,95.59986996423721,64.00013,1000300
1687114687045,download,1000000,17.200006047683715,186536104.29166254,42.900006035762786,55.999994,1000300
1687114687167,download,1000000,18.30024401192093,253238550.75177023,31.60024402384186,55.999756,1000300
1687114687343,download,1000000,18.199885988079075,274997640.6589203,29.09988602384186,130.000114,1000300
1687114687432,download,1000000,14.40005697615814,317554837.42697686,25.20005698807907,59.999943,1000300
1687114687526,download,1000000,18.500006,277861053.1083791,28.800006011920928,55.999994,1000300
1687114687628,download,1000000,15.999900999999994,299716466.57822466,26.69990104768371,71.000099,1000300
1687114687729,download,1000000,16.800088011920934,297486015.92279613,26.900087976158147,66.999912,1000300
1687114687823,upload,100000,17.79987001192093,9828850.854313334,81.80000001192093,64.00013,376
1687114687881,upload,100000,17.200007988079072,16015936.258783361,50.19999998807907,32.999992,375
1687114687941,upload,100000,21.899863035762788,15198487.702390542,52.90000003576279,31.000137,375
1687114688050,upload,100000,21.10013202384186,13604060.908217492,59.10000002384186,37.999868,376
1687114688183,upload,100000,32.79990301192093,9950495.04803689,80.80000001192093,48.000097,376
1687114688240,upload,100000,15.799987011920926,15521235.517663559,51.80000001192093,36.000013,376
1687114688367,upload,100000,18.60003602384186,9852941.173591759,81.60000002384186,62.999964,375
1687114688423,upload,100000,17.500079999999997,15611650.485436892,51.5,33.99992,376
1687114697576,upload,1000000,44.400133976158145,8604452.055014068,934.3999999761581,889.999866,376
1687114698025,upload,1000000,16.599934964237207,18980169.973273803,423.5999999642372,407.000065,375
1687114698556,upload,1000000,15.900104976158161,16051108.006353935,500.89999997615814,484.999895,376
1687114698948,upload,1000000,16.799960011920916,21451440.767727528,374.80000001192093,358.00004,376
1687114699274,upload,1000000,16.80022501192093,26552179.655493636,302.80000001192093,285.999775,376
1687114699689,upload,1000000,17.2000510476837,20292781.421081178,396.2000000476837,378.999949,376
1687114699893,download,10000000,17.09986102384186,682033203.704048,117.29986101192094,54.000139,10000300
1687114700202,download,10000000,15.500295999999999,350119458.9262152,228.500296,59.999704,10000300
1687114700405,download,10000000,15.800119952316287,589118772.7086792,135.8001199523163,50.99988,10000300
1687114700610,download,10000000,17.40000597615814,629444502.3276451,127.10000596423721,55.999994,10000300
1687114700794,download,10000000,16.800130011920928,764840349.4504719,104.60013002384186,60.99987,10000300
1687114700984,download,10000000,17.599975023841857,657914608.8172641,121.59997502384186,49.000025,10000300
1687114703114,upload,10000000,18.499845999999934,40069773.23697981,2006.5,1988.000154,376
1687114707542,upload,10000000,17.500245999999606,18695500.523194972,4300.5,4282.999754,376
1687114713698,upload,10000000,16.90009303576244,13366805.765602414,6014.900000035763,5997.999907,376
1687114719664,upload,10000000,17.500004000000445,13751817.326605659,5846.5,5828.999996,376
1687114720031,download,25000000,19.79988201192093,758159550.6208832,263.79988201192094,51.000118,25000300
1687114720538,download,25000000,22.499954000000002,480890651.9173727,415.89995397615814,52.000046,25000300
1687114721083,download,25000000,18.200119988079074,458615787.56058526,436.10012002384184,50.99988,25000300
1687114721492,download,25000000,17.499954000000002,621125554.5707314,321.999954,52.000046,25000300
1687114723688,download,100000000,23.299911952316286,400221339.3511531,1998.8999119761581,58.000088,100000300
1687114725203,download,100000000,15.100193023841861,609479111.9579462,1312.600193023842,51.999807,100000300
1687114726800,download,100000000,17.10006902384186,566854928.7042106,1411.3000690119209,46.999931,100000300

Next picture is disabled sqm speedtest

disabled_sqm_speedtest
disabled_sqm_speedtest1920×1080 307 KB

enabled sqm then ran speedtest qdisc.

root@OpenWrt:~#  tc -s qdisc
qdisc noqueue 0: dev lo root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc mq 0: dev lan4 root
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan4 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan3 root
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan3 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan2 root
 Sent 46671127521 bytes 33550564 pkt (dropped 0, overlimits 0 requeues 906929)
 backlog 0b 0p requeues 906929
qdisc fq_codel 0: dev lan2 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 36267355817 bytes 25141724 pkt (dropped 0, overlimits 0 requeues 826263)
 backlog 0b 0p requeues 826263
  maxpacket 1514 drop_overlimit 0 new_flow_count 1708 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 2024839736 bytes 1657330 pkt (dropped 0, overlimits 0 requeues 24329)
 backlog 0b 0p requeues 24329
  maxpacket 1514 drop_overlimit 0 new_flow_count 290 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 6263214959 bytes 5122041 pkt (dropped 0, overlimits 0 requeues 56243)
 backlog 0b 0p requeues 56243
  maxpacket 1434 drop_overlimit 0 new_flow_count 472 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 2115717009 bytes 1629469 pkt (dropped 0, overlimits 0 requeues 94)
 backlog 0b 0p requeues 94
  maxpacket 1494 drop_overlimit 0 new_flow_count 91 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan1 root
 Sent 5636236591 bytes 4090623 pkt (dropped 0, overlimits 0 requeues 1018314)
 backlog 0b 0p requeues 1018314
qdisc fq_codel 0: dev lan1 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 2506187185 bytes 1756736 pkt (dropped 0, overlimits 0 requeues 250193)
 backlog 0b 0p requeues 250193
  maxpacket 1514 drop_overlimit 0 new_flow_count 200 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 650020705 bytes 518882 pkt (dropped 0, overlimits 0 requeues 399548)
 backlog 0b 0p requeues 399548
  maxpacket 1514 drop_overlimit 0 new_flow_count 98 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 1226467835 bytes 887087 pkt (dropped 0, overlimits 0 requeues 367181)
 backlog 0b 0p requeues 367181
  maxpacket 1514 drop_overlimit 0 new_flow_count 159 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 1253560866 bytes 927918 pkt (dropped 0, overlimits 0 requeues 1392)
 backlog 0b 0p requeues 1392
  maxpacket 1514 drop_overlimit 0 new_flow_count 302 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev wan root
 Sent 144879363 bytes 540030 pkt (dropped 0, overlimits 0 requeues 49493)
 backlog 0b 0p requeues 49493
qdisc fq_codel 0: dev wan parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 8462808 bytes 16107 pkt (dropped 0, overlimits 0 requeues 11)
 backlog 0b 0p requeues 11
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wan parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 43043460 bytes 104761 pkt (dropped 0, overlimits 0 requeues 24815)
 backlog 0b 0p requeues 24815
  maxpacket 110 drop_overlimit 0 new_flow_count 41 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wan parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 89359676 bytes 413217 pkt (dropped 0, overlimits 0 requeues 24660)
 backlog 0b 0p requeues 24660
  maxpacket 110 drop_overlimit 0 new_flow_count 1047 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wan parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 4013419 bytes 5945 pkt (dropped 0, overlimits 0 requeues 7)
 backlog 0b 0p requeues 7
  maxpacket 1514 drop_overlimit 0 new_flow_count 6 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc noqueue 0: dev br-lan root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev phy0-ap0 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev phy1-ap0 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0

New picture is 500/50 sqm enabled sppedtest

500-50_speedtest
500-50_speedtest1920×1080 314 KB

enabled sqm with 500/500 qdisc.

root@OpenWrt:~#  tc -s qdisc
qdisc noqueue 0: dev lo root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc mq 0: dev lan4 root
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan4 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan3 root
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan3 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan2 root
 Sent 46116750564 bytes 33145372 pkt (dropped 0, overlimits 0 requeues 891367)
 backlog 0b 0p requeues 891367
qdisc fq_codel 0: dev lan2 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 36025136896 bytes 24964541 pkt (dropped 0, overlimits 0 requeues 815069)
 backlog 0b 0p requeues 815069
  maxpacket 1514 drop_overlimit 0 new_flow_count 1289 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 1992514185 bytes 1633796 pkt (dropped 0, overlimits 0 requeues 24329)
 backlog 0b 0p requeues 24329
  maxpacket 1514 drop_overlimit 0 new_flow_count 290 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 5983699561 bytes 4918386 pkt (dropped 0, overlimits 0 requeues 51876)
 backlog 0b 0p requeues 51876
  maxpacket 1434 drop_overlimit 0 new_flow_count 425 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 2115399922 bytes 1628649 pkt (dropped 0, overlimits 0 requeues 93)
 backlog 0b 0p requeues 93
  maxpacket 1434 drop_overlimit 0 new_flow_count 90 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan1 root
 Sent 5597212814 bytes 4064413 pkt (dropped 0, overlimits 0 requeues 1018208)
 backlog 0b 0p requeues 1018208
qdisc fq_codel 0: dev lan1 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 2506169444 bytes 1756631 pkt (dropped 0, overlimits 0 requeues 250193)
 backlog 0b 0p requeues 250193
  maxpacket 1514 drop_overlimit 0 new_flow_count 200 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 650008720 bytes 518793 pkt (dropped 0, overlimits 0 requeues 399548)
 backlog 0b 0p requeues 399548
  maxpacket 1514 drop_overlimit 0 new_flow_count 98 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 1226454965 bytes 886993 pkt (dropped 0, overlimits 0 requeues 367181)
 backlog 0b 0p requeues 367181
  maxpacket 1514 drop_overlimit 0 new_flow_count 159 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 1214579685 bytes 901996 pkt (dropped 0, overlimits 0 requeues 1286)
 backlog 0b 0p requeues 1286
  maxpacket 1514 drop_overlimit 0 new_flow_count 286 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev wan root
 Sent 74810981 bytes 291768 pkt (dropped 0, overlimits 0 requeues 26569)
 backlog 0b 0p requeues 26569
qdisc fq_codel 0: dev wan parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 8161934 bytes 14032 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wan parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 38787805 bytes 88858 pkt (dropped 0, overlimits 0 requeues 14595)
 backlog 0b 0p requeues 14595
  maxpacket 110 drop_overlimit 0 new_flow_count 30 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wan parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 27147720 bytes 185589 pkt (dropped 0, overlimits 0 requeues 11968)
 backlog 0b 0p requeues 11968
  maxpacket 110 drop_overlimit 0 new_flow_count 466 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wan parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 713522 bytes 3289 pkt (dropped 0, overlimits 0 requeues 6)
 backlog 0b 0p requeues 6
  maxpacket 1514 drop_overlimit 0 new_flow_count 5 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc noqueue 0: dev br-lan root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev phy0-ap0 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev phy1-ap0 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
14

The peak (_pk) counters clear pretty quickly so for those as short as possible after a speedtest is best.

However, I failed to ask for switching back to piece_of_cake first, cake offers a lot of statistics that other qdiscs do not, and I thought we still want to figure out whether cake is CPU bound?

15

Ahh i can redo it now that it's set to piece_of_cake, no problem. However I thought I had already swapped it back?

At this point I would be willing to say I dont even know if sqm is running properly, I dont see it listed anywhere. I see autorate in the ps-e, top, htop commands but i've never seen anything called ('sqm', 'cake', 'qdisc', 'qos', 'qos'). It may not even be properly running!

16

sqm-scripts really are convenience scripts to set-up kernel qdiscs, that is the work is done not as a user-level process, but in the kernel in software interrupt context, so it is not supposed to show up asa a process in ps/top/htop, nothing to worry there.

To test whether it is configured as intended you need to ask the kernel:
tc -s qdisc
will request qdisc statistics for all interfaces and will show cake's output. For HTB/TBF I believe you need to look at both tc -s qdisc and tc -q qdisc output IIRC.

Also you could run:
SQM_DEBUG=1 SQM_VERBOSITY_MAX=8 /etc/init.d/sqm stop ; SQM_DEBUG=1 SQM_VERBOSITY_MAX=8 /etc/init.d/sqm start

and post the output here...

17

Just wanted to thank you for engaging on this issue for so long and in general on the forum as a whole. That ownership and dedictation has helped a ton of people.

i ran it and got a few errors,

root@OpenWrt:/usr/lib/sqm# SQM_DEBUG=1 SQM_VERBOSITY_MAX=8 /etc/init.d/sqm stop ; SQM_DEBUG=1 SQM_VERBOSITY_MAX=8 /etc/init.d/sqm start
/usr/lib/sqm/run.sh: line 57: can't create : nonexistent directory
SQM: Stopping SQM on wan
/usr/lib/sqm/run.sh: line 57: can't create : nonexistent directory
SQM: Starting SQM script: piece_of_cake.qos on wan, in: 450000 Kbps, out: 30000 Kbps
SQM: fn_exists: function candidate name: sqm_start
SQM: fn_exists: TYPE_OUTPUT: sqm_start: not found
SQM: fn_exists: return value: 1
SQM: Using generic sqm_start_default function.
SQM: fn_exists: function candidate name: sqm_prepare_script
SQM: fn_exists: TYPE_OUTPUT: sqm_prepare_script is a function
SQM: fn_exists: return value: 0
SQM: sqm_start_default: starting sqm_prepare_script
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link add name SQM_IFB_935de type ifb
SQM: cmd_wrapper: tc: SUCCESS: /sbin/tc qdisc replace dev SQM_IFB_935de root cake
SQM: QDISC cake is useable.
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link set dev SQM_IFB_935de down
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link delete SQM_IFB_935de type ifb
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link add name SQM_IFB_fafdf type ifb
SQM: cmd_wrapper: tc: SUCCESS: /sbin/tc qdisc replace dev SQM_IFB_fafdf root cake
SQM: QDISC cake is useable.
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link set dev SQM_IFB_fafdf down
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link delete SQM_IFB_fafdf type ifb
SQM: sqm_start_default: Starting piece_of_cake.qos
SQM: ifb associated with interface wan:
SQM: Currently no ifb is associated with wan, this is normal during starting of the sqm system.
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link add name ifb4wan type ifb
SQM: fn_exists: function candidate name: egress
SQM: fn_exists: TYPE_OUTPUT: egress is a function
SQM: fn_exists: return value: 0
SQM: egress
SQM: cmd_wrapper: tc: invocation silenced by request, FAILURE either expected or acceptable.
SQM: cmd_wrapper: tc: FAILURE (2): /sbin/tc qdisc del dev wan root
SQM: cmd_wrapper: tc: LAST ERROR: Error: Cannot delete qdisc with handle of zero.
SQM: LLA: default link layer adjustment method for cake is cake
SQM: cake link layer adjustments:  overhead 22 mpu 0
SQM: cmd_wrapper: tc: SUCCESS: /sbin/tc qdisc add dev wan root cake bandwidth 30000kbit overhead 22 mpu 0 besteffort
SQM: sqm_start_default: egress shaping activated
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link add name SQM_IFB_d97b1 type ifb
SQM: cmd_wrapper: tc: SUCCESS: /sbin/tc qdisc replace dev SQM_IFB_d97b1 ingress
SQM: QDISC ingress is useable.
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link set dev SQM_IFB_d97b1 down
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link delete SQM_IFB_d97b1 type ifb
SQM: fn_exists: function candidate name: ingress
SQM: fn_exists: TYPE_OUTPUT: ingress is a function
SQM: fn_exists: return value: 0
SQM: ingress
SQM: cmd_wrapper: tc: invocation silenced by request, FAILURE either expected or acceptable.
SQM: cmd_wrapper: tc: FAILURE (2): /sbin/tc qdisc del dev wan handle ffff: ingress
SQM: cmd_wrapper: tc: LAST ERROR: Error: Invalid handle.
SQM: cmd_wrapper: tc: SUCCESS: /sbin/tc qdisc add dev wan handle ffff: ingress
SQM: cmd_wrapper: tc: invocation silenced by request, FAILURE either expected or acceptable.
SQM: cmd_wrapper: tc: FAILURE (2): /sbin/tc qdisc del dev ifb4wan root
SQM: cmd_wrapper: tc: LAST ERROR: Error: Cannot delete qdisc with handle of zero.
SQM: LLA: default link layer adjustment method for cake is cake
SQM: cake link layer adjustments:  overhead 22 mpu 0
SQM: cmd_wrapper: tc: SUCCESS: /sbin/tc qdisc add dev ifb4wan root cake bandwidth 450000kbit overhead 22 mpu 0 besteffort wash
SQM: cmd_wrapper: ip: SUCCESS: /sbin/ip link set dev ifb4wan up
SQM: cmd_wrapper: tc: SUCCESS: /sbin/tc filter add dev wan parent ffff: protocol all prio 10 u32 match u32 0 0 flowid 1:1 action mirred egress redirect dev ifb4wan
SQM: sqm_start_default: ingress shaping activated
SQM: piece_of_cake.qos was started on wan successfully
18

Will need to look into the line 57 errors, but I believe these are cosmetic mostly, all FAILUREs are expected/acceptable FAILURES, so could you post the output of tc -s qdisc again?

19

  1. the screenshot (and if available link to the results page) of a speedtest with sqm disabled (waveform bufferbloat test is OK, or speed.cloudflare.com )
    e7d0ab1e504e3039f960b7368538be7bbf4b329e_2_690x388

  2. enable sqm (with the shaper rate set to 500/50) and post the output of tc -s qdisc


root@OpenWrt:/usr/lib/sqm# tc -s qdisc
qdisc noqueue 0: dev lo root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc mq 0: dev lan4 root
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan4 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan3 root
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan3 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan2 root
 Sent 50799926462 bytes 37749765 pkt (dropped 0, overlimits 0 requeues 990811)
 backlog 0b 0p requeues 990811
qdisc fq_codel 0: dev lan2 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 38590471012 bytes 27125742 pkt (dropped 0, overlimits 0 requeues 880812)
 backlog 0b 0p requeues 880812
  maxpacket 1514 drop_overlimit 0 new_flow_count 2904 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 2844152233 bytes 2547813 pkt (dropped 0, overlimits 0 requeues 40242)
 backlog 0b 0p requeues 40242
  maxpacket 1514 drop_overlimit 0 new_flow_count 315 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 6844278434 bytes 5867612 pkt (dropped 0, overlimits 0 requeues 69610)
 backlog 0b 0p requeues 69610
  maxpacket 1434 drop_overlimit 0 new_flow_count 515 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 2521024783 bytes 2208598 pkt (dropped 0, overlimits 0 requeues 147)
 backlog 0b 0p requeues 147
  maxpacket 1494 drop_overlimit 0 new_flow_count 104 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan1 root
 Sent 30718760285 bytes 21014194 pkt (dropped 2, overlimits 0 requeues 5172002)
 backlog 0b 0p requeues 5172002
qdisc fq_codel 0: dev lan1 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 10510164663 bytes 7121110 pkt (dropped 0, overlimits 0 requeues 1605271)
 backlog 0b 0p requeues 1605271
  maxpacket 1514 drop_overlimit 0 new_flow_count 859 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 6934285805 bytes 4745390 pkt (dropped 0, overlimits 0 requeues 1552764)
 backlog 0b 0p requeues 1552764
  maxpacket 1514 drop_overlimit 0 new_flow_count 640 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 7751029075 bytes 5272020 pkt (dropped 0, overlimits 0 requeues 2005463)
 backlog 0b 0p requeues 2005463
  maxpacket 1514 drop_overlimit 0 new_flow_count 909 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 5523280742 bytes 3875674 pkt (dropped 2, overlimits 0 requeues 8504)
 backlog 0b 0p requeues 8504
  maxpacket 1514 drop_overlimit 0 new_flow_count 2230 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc cake 8046: dev wan root refcnt 5 bandwidth 20Mbit besteffort triple-isolate nonat nowash no-ack-filter split-gso rtt 100ms noatm overhead 22
 Sent 72573652 bytes 287339 pkt (dropped 11, overlimits 546028 requeues 21046)
 backlog 0b 0p requeues 21046
 memory used: 700608b of 4Mb
 capacity estimate: 50Kbit
 min/max network layer size:           28 /    1500
 min/max overhead-adjusted size:       50 /    1522
 average network hdr offset:           14

                  Tin 0
  thresh         20Mbit
  target            5ms
  interval        100ms
  pk_delay        809us
  av_delay         70us
  sp_delay          3us
  backlog            0b
  pkts           287350
  bytes        72588070
  way_inds          385
  way_miss          715
  way_cols            0
  drops              11
  marks               0
  ack_drop            0
  sp_flows            2
  bk_flows            1
  un_flows            0
  max_len         11632
  quantum           610

qdisc ingress ffff: dev wan parent ffff:fff1 ----------------
 Sent 700239061 bytes 524775 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev br-lan root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev phy0-ap0 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev phy1-ap0 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc cake 8047: dev ifb4wan root refcnt 2 bandwidth 400Mbit besteffort triple-isolate nonat wash no-ack-filter split-gso rtt 100ms noatm overhead 22
 Sent 721569601 bytes 524586 pkt (dropped 189, overlimits 457950 requeues 0)
 backlog 0b 0p requeues 0
 memory used: 3681178b of 15140Kb
 capacity estimate: 500Kbit
 min/max network layer size:           46 /    1500
 min/max overhead-adjusted size:       68 /    1522
 average network hdr offset:           14

                  Tin 0
  thresh        400Mbit
  target            5ms
  interval        100ms
  pk_delay        224us
  av_delay         59us
  sp_delay          2us
  backlog            0b
  pkts           524775
  bytes       721839891
  way_inds         1395
  way_miss          656
  way_cols            0
  drops             189
  marks               0
  ack_drop            0
  sp_flows            3
  bk_flows            1
  un_flows            0
  max_len         67398
  quantum          1514

  1. run a speedtest again (same test as in 1) and post a link/screenshot to the results.

    post_500_50_speedrun
    post_500_50_speedrun1920×1080 320 KB

  2. post the output of tc -s qdisc taken immediately after the test (the closer the better)

root@OpenWrt:/usr/lib/sqm# tc -s qdisc
qdisc noqueue 0: dev lo root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc mq 0: dev lan4 root
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan4 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan4 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan3 root
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev lan3 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan3 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan2 root
 Sent 51297236059 bytes 38115321 pkt (dropped 0, overlimits 0 requeues 991171)
 backlog 0b 0p requeues 991171
qdisc fq_codel 0: dev lan2 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 39021394596 bytes 27434916 pkt (dropped 0, overlimits 0 requeues 881172)
 backlog 0b 0p requeues 881172
  maxpacket 1514 drop_overlimit 0 new_flow_count 2914 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 2844479235 bytes 2548657 pkt (dropped 0, overlimits 0 requeues 40242)
 backlog 0b 0p requeues 40242
  maxpacket 1514 drop_overlimit 0 new_flow_count 315 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 6844478958 bytes 5868850 pkt (dropped 0, overlimits 0 requeues 69610)
 backlog 0b 0p requeues 69610
  maxpacket 1434 drop_overlimit 0 new_flow_count 515 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan2 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 2586883270 bytes 2262898 pkt (dropped 0, overlimits 0 requeues 147)
 backlog 0b 0p requeues 147
  maxpacket 1494 drop_overlimit 0 new_flow_count 104 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc mq 0: dev lan1 root
 Sent 30718829002 bytes 21014628 pkt (dropped 2, overlimits 0 requeues 5172002)
 backlog 0b 0p requeues 5172002
qdisc fq_codel 0: dev lan1 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 10510186359 bytes 7121214 pkt (dropped 0, overlimits 0 requeues 1605271)
 backlog 0b 0p requeues 1605271
  maxpacket 1514 drop_overlimit 0 new_flow_count 859 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 6934297306 bytes 4745480 pkt (dropped 0, overlimits 0 requeues 1552764)
 backlog 0b 0p requeues 1552764
  maxpacket 1514 drop_overlimit 0 new_flow_count 640 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 7751042947 bytes 5272106 pkt (dropped 0, overlimits 0 requeues 2005463)
 backlog 0b 0p requeues 2005463
  maxpacket 1514 drop_overlimit 0 new_flow_count 909 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev lan1 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 5523302390 bytes 3875828 pkt (dropped 2, overlimits 0 requeues 8504)
 backlog 0b 0p requeues 8504
  maxpacket 1514 drop_overlimit 0 new_flow_count 2230 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc cake 8046: dev wan root refcnt 5 bandwidth 35Mbit besteffort triple-isolate nonat nowash no-ack-filter split-gso rtt 100ms noatm overhead 22
 Sent 144449704 bytes 563081 pkt (dropped 22, overlimits 1101539 requeues 21562)
 backlog 0b 0p requeues 21562
 memory used: 792448b of 4Mb
 capacity estimate: 50Kbit
 min/max network layer size:           28 /    1500
 min/max overhead-adjusted size:       50 /    1522
 average network hdr offset:           14

                  Tin 0
  thresh         35Mbit
  target            5ms
  interval        100ms
  pk_delay       1.87ms
  av_delay       1.02ms
  sp_delay          4us
  backlog            0b
  pkts           563103
  bytes       144479956
  way_inds          660
  way_miss          855
  way_cols            0
  drops              22
  marks               0
  ack_drop            0
  sp_flows            6
  bk_flows            1
  un_flows            0
  max_len         11632
  quantum          1068

qdisc ingress ffff: dev wan parent ffff:fff1 ----------------
 Sent 1198583927 bytes 902642 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev br-lan root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev phy0-ap0 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev phy1-ap0 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc cake 8047: dev ifb4wan root refcnt 2 bandwidth 594Mbit besteffort triple-isolate nonat wash no-ack-filter split-gso rtt 100ms noatm overhead 22
 Sent 1233781177 bytes 902143 pkt (dropped 499, overlimits 775047 requeues 0)
 backlog 0b 0p requeues 0
 memory used: 3681178b of 15140Kb
 capacity estimate: 500Kbit
 min/max network layer size:           46 /    1500
 min/max overhead-adjusted size:       68 /    1522
 average network hdr offset:           14

                  Tin 0
  thresh        594Mbit
  target            5ms
  interval        100ms
  pk_delay       10.2ms
  av_delay       9.83ms
  sp_delay          5us
  backlog            0b
  pkts           902642
  bytes      1234496007
  way_inds         1660
  way_miss          793
  way_cols            0
  drops             499
  marks               0
  ack_drop            0
  sp_flows            6
  bk_flows            1
  un_flows            0
  max_len         67398
  quantum          1514
20

The shaper was set to download 400 and upload 20:

UPLOAD:
qdisc cake 8046: dev wan root refcnt 5 bandwidth 20Mbit besteffort triple-isolate nonat nowash no-ack-filter split-gso rtt 100ms noatm overhead 22
DOWNLOAD:
qdisc cake 8047: dev ifb4wan root refcnt 2 bandwidth 400Mbit besteffort triple-isolate nonat wash no-ack-filter split-gso rtt 100ms noatm overhead 22

But later is was set to 594/35:

UPLOAD:
qdisc cake 8046: dev wan root refcnt 5 bandwidth 35Mbit besteffort triple-isolate nonat nowash no-ack-filter split-gso rtt 100ms noatm overhead 22
DOWNLOAD:
qdisc cake 8047: dev ifb4wan root refcnt 2 bandwidth 594Mbit besteffort triple-isolate nonat wash no-ack-filter split-gso rtt 100ms noatm overhead 22

The speedtest reported 423/24.6 with sqm and 658/23 without so I assume the for the second speedtest the shaper was set to 594/35.
With your overhead settings and IPv6 I expect 594/35 to at best result in:

594 * ((1500-40-20)/(1500+22)) = 562.0 Mbps
35 * ((1500-40-20)/(1500+22)) = 33.1 Mbps
inversely the non-SQM speedtest goodput implies a shaper setting of
658 * (((1500+22))/(1500-40-20)) = 695.5 Mbps
23 * (((1500+22))/(1500-40-20))  = 24.3 Mbps

423/24 seems to be considerably off... Since the speedtest without SQM results in 24 Mbps upload and with sqm we seem to top out slightly above 400 Mbps, please set the shaper to 350/24 ahe goal is to find acceptable shaper settings that do not overtax your CPU. (And once we have these you need to decide whether you can tolerate the throughput sacrifice or whether you want to trade in slightly higher latency under load for more throughput, but let's first try to find a shaper setting where sqm/cake operates decently).

1 Like