18.06 QoS feedback needed

I'm interesting in feedback on the latest release 18.06 in regards to QoS/SQM.

What is your current settings that works well for you? Example template:

  • Line: ADSL/Cable/Fiber
  • Speed: 100/10 (100Mbps down, 10Mbps up)
  • QoS: cake/pie/fq-codel/etc.
  • Any other settings...

What's not working, needs improvements/bugs/wishlist (speed, cpu load, software/hardware NAT, SFE, etc.)?

Thanks!

*Update: Any improvements in 18.06.1?

1 Like

For my BT Home Hub 5A:

sqm.eth1.interface='pppoe-wan’
sqm.eth1.download='14400’
sqm.eth1.upload='10800’

sqm.eth1.linklayer_adaptation_mechanism='cake’
layer_cake
sqm.eth1.iqdisc_opts='rtt 150ms nat dual-dsthost mpu 64’
sqm.eth1.eqdisc_opts=‘rtt 150ms nat dual-srchost mpu 64’

sqm.eth1.linklayer='ethernet’
sqm.eth1.overhead='8’
sqm.eth1.tcMTU='2047’
sqm.eth1.tcTSIZE='128’
sqm.eth1.tcMPU='64’

<a href="http://www.dslreports.com/speedtest/36741192">
<img src="http://www.dslreports.com/speedtest/36741192.png"></a>
13.83/8.07Mbps
A+/B/C  BufferBloat/Quality/Speed
22/41/13msec max
11/21/12msec avg

Hi @murraydr44, I believe that 18.06's version of sqm-scripts will interpret "sqm.eth1.tcMPU='64’" to be valid for cake also, so you might drop the "mpu 64" from []i|eqdisc_opts...

To test this, just remove them and run:
/etc/init.d/sqm stop ; /etc/init.d/sqm start
tc -s qdisc
and look at the options cake reports as in-use...

1 Like

Hi WRT3200acm I am on cable 200 down and 12 up.
I set sqm to 185000 down and 10500 up.
Queue Discipline cake piece_of_cake.qos.
Link Layer Adaptation Ethernet with overhead: to 18.
DSL reports says that I scor a A for buffer bloat.
I still get lag spikes and my sun gets lag when playing xbox and PC.I installed rich hanovers OpenWrtScripts


When running betterspeedtest.sh I get max pings of 100 +. The hi pings are just for upload. I have just flashed a new snapshot so I will test again after I reconfigure.

OpenWrt SNAPSHOT r7847 no SQM.
Kernel Version 4.14.62
root@OpenWrt:/usr/lib/OpenWrtScripts# sh betterspeedtest.sh -t120.sh -tt 120120
2018-08-14 11:09:05 Testing against netperf.bufferbloat.net (ipv4) with 5 simultaneous sessions while pinging gstatic.com (120 seconds in each direction)
.........................................................................................................................
Download: 210.15 Mbps
Latency: (in msec, 121 pings, 0.00% packet loss)
Min: 15.583
10pct: 35.409
Median: 69.601
Avg: 65.037
90pct: 83.882
Max: 94.844
.....................................................................^[[B.....................................................
Upload: 11.73 Mbps
Latency: (in msec, 122 pings, 0.00% packet loss)
Min: 16.914
10pct: 30.485
Median: 46.835
Avg: 45.166
90pct: 55.046
Max: 101.759

With SQM.

config queue 'eth1'
option qdisc_advanced '0'
option enabled '1'
option interface 'eth1.2'
option download '185000'
option upload '10500'
option debug_logging '0'
option verbosity '5'
option qdisc 'cake'
option script 'piece_of_cake.qos'
option linklayer 'ethernet'
option overhead '18'
35 Testing against netperf.bufferbloat.net (ipv4) with 5 simultaneous sessions while pinging gstatic.com (120 seconds in each direction)
................................................................................................................
Download: 140.07 Mbps
Latency: (in msec, 121 pings, 0.00% packet loss)
Min: 15.132
10pct: 17.242
Median: 22.352
Avg: 23.138
90pct: 29.066
Max: 66.246
................
Upload: 8.99 Mbps
Latency: (in msec, 122 pings, 0.00% packet loss)
Min: 14.545
10pct: 15.873
Median: 18.287
Avg: 18.427
90pct: 20.781
Max: 26.202
That is mutch better pings, but A lot of band width to give up!

Layered cake on my slow rural ADSL connection. Very pleased, can saturate the link eg with bittorrent and still have top notch latency with VoIP. Pie of cake, which I tried first, works equally well, you just have to get the speed settings right so that queues don't fill up. Also, traffic seemed to be more "even" resp. less "bursty" w/ pie of cake, right now I'm considering switching back.

Using fw connmarks to distribute some traffic to tins, egress and ingress.

Config:

config queue 'eth1'
        option enabled '1'
        option interface 'pppoe-wan'
        option download '5600'
        option upload '620'
        option qdisc_advanced '1'
        option ingress_ecn 'ECN'
        option egress_ecn 'NOECN'
        option qdisc_really_really_advanced '1'
        option itarget 'auto'
        option etarget 'auto'
        option linklayer 'atm'
        option overhead '44'
        option debug_logging '1'
        option verbosity '5'
        option qdisc 'cake'
        option squash_dscp '1'
        option squash_ingress '0'
        option iqdisc_opts 'nat dual-dsthost'
        option eqdisc_opts 'nat dual-srchost'
        option script 'layer_cake.qos'

Stats:

qdisc cake 8067: dev pppoe-wan root refcnt 2 bandwidth 620Kbit diffserv3 dual-srchost nat split-gso rtt 100.0ms atm overhead 44 
 Sent 6891716863 bytes 30395032 pkt (dropped 13890, overlimits 38729802 requeues 0) 
 backlog 0b 0p requeues 0
 memory used: 320Kb of 4Mb
 capacity estimate: 620Kbit
 min/max network layer size:           28 /    1492
 min/max overhead-adjusted size:      106 /    1696
 average network hdr offset:            0

                   Bulk  Best Effort        Voice
  thresh       38744bit      620Kbit      155Kbit
  target        468.9ms       29.3ms      117.2ms
  interval      937.8ms      124.3ms      234.4ms
  pk_delay       11.2ms        7.9ms        7.5ms
  av_delay        1.3ms        503us        524us
  sp_delay         42us         36us         37us
  backlog            0b           0b           0b
  pkts          6958610     21915756      1534563
  bytes      5084142323   1666407320    160807474
  way_inds       544837       446256        26506
  way_miss       565912       134308        23034
  way_cols          225            0            0
  drops           13271          619            0
  marks               0            0            0
  ack_drop            0            0            0
  sp_flows            5            1            1
  bk_flows            0            1            0
  un_flows            0            0            0
  max_len          1492         1492         1328
  quantum           300          300          300

qdisc cake 8068: dev ifb4pppoe-wan root refcnt 2 bandwidth 5600Kbit diffserv3 dual-dsthost nat wash split-gso rtt 100.0ms atm overhead 44 
 Sent 44192585421 bytes 35564223 pkt (dropped 1604943, overlimits 56642007 requeues 0) 
 backlog 14920b 10p requeues 0
 memory used: 278Kb of 4Mb
 capacity estimate: 5600Kbit
 min/max network layer size:           21 /    1492
 min/max overhead-adjusted size:      106 /    1696
 average network hdr offset:            0

                   Bulk  Best Effort        Voice
  thresh        350Kbit     5600Kbit     1400Kbit
  target         51.9ms        5.0ms       13.0ms
  interval      146.9ms      100.0ms      108.0ms
  pk_delay        3.7ms       21.2ms       38.6ms
  av_delay        642us        3.4ms        1.9ms
  sp_delay         56us        1.9ms         61us
  backlog            0b       14920b           0b
  pkts          7828982     28808823       531371
  bytes      5594219150  40782782325    106165350
  way_inds       672703       406209          322
  way_miss       158917       518378         2584
  way_cols            0            0            0
  drops          508421      1096509           13
  marks             560            0            0
  ack_drop            0            0            0
  sp_flows            1            2            1
  bk_flows            0            1            0
  un_flows            0            0            0
  max_len          1492         1492         1338
  quantum           300          300          300

I stopped using
option iqdisc_opts 'nat dual-dsthost'
option eqdisc_opts 'nat dual-srchost'
I have to dumb APS and it made them act strange. Think it mite be that it sees all the traffic to them as just one IP address.

is that 1050 or 10500 ?

Today's results:

sqm.eth1.interface='pppoe-wan’
sqm.eth1.download='14400’
sqm.eth1.upload='10800’

sqm.eth1.linklayer_adaptation_mechanism='cake’
layer_cake
sqm.eth1.iqdisc_opts='rtt 150ms nat dual-dsthost mpu 64’
sqm.eth1.eqdisc_opts=‘rtt 150ms nat dual-srchost mpu 64’

sqm.eth1.linklayer='ethernet’
sqm.eth1.overhead='8’
sqm.eth1.tcMTU='2047’
sqm.eth1.tcTSIZE='128’
sqm.eth1.tcMPU='64’

<a href="http://www.dslreports.com/speedtest/36741192">
<img src="http://www.dslreports.com/speedtest/36741192.png"></a>
13.83/8.07Mbps
A+/B/C  BufferBloat/Quality/Speed
22/41/13msec max
11/21/12msec avg
sqm.eth1.interface='pppoe-wan’
sqm.eth1.download='14400’
sqm.eth1.upload='10800’

2014/14/8
sqm.eth1.linklayer_adaptation_mechanism='cake’
layer_cake
sqm.eth1.iqdisc_opts='rtt 150ms nat dual-dsthost’
sqm.eth1.eqdisc_opts=‘rtt 150ms nat dual-srchost’

sqm.eth1.linklayer='ethernet’
sqm.eth1.overhead='8’
sqm.eth1.tcMTU='2047’
sqm.eth1.tcTSIZE='128’
sqm.eth1.tcMPU='64’

<a href="http://www.dslreports.com/speedtest/37210175">
<img src="http://www.dslreports.com/speedtest/37210175.png"></a>
13.82/7.6Mbps
A+/C/C  BufferBloat/Quality/Speed
12/18/16msec max BB idle/dl/ul msec
10/15/12msec avg BB idle/dl/ul msec

login as: root
root@192.168.5.1's password:


BusyBox v1.28.3 () built-in shell (ash)

  _______                     ________        __
 |       |.-----.-----.-----.|  |  |  |.----.|  |_
 |   -   ||  _  |  -__|     ||  |  |  ||   _||   _|
 |_______||   __|_____|__|__||________||__|  |____|
          |__| W I R E L E S S   F R E E D O M
 -----------------------------------------------------
 OpenWrt 18.06.0, r7188-b0b5c64c22
 -----------------------------------------------------
root@HH5A:~# /etc/init.d/sqm stop ; /etc/init.d/sqm start
SQM: Stopping SQM on pppoe-wan
SQM: Starting SQM script: layer_cake.qos on pppoe-wan, in: 14400 Kbps, out: 10800 Kbps
SQM: layer_cake.qos was started on pppoe-wan successfully
root@HH5A:~# tc -s qdisc
qdisc noqueue 0: dev lo root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev eth0 root refcnt 2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms memory_limit 4Mb ecn
 Sent 10997878299 bytes 18432357 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 1514 drop_overlimit 0 new_flow_count 2949 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc noqueue 0: dev br-lan root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth0.1 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev wlan1 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev wlan0 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev dsl0 root refcnt 2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms memory_limit 4Mb ecn
 Sent 4982818693 bytes 14671544 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc noqueue 0: dev dsl0.35 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc cake 8028: dev pppoe-wan root refcnt 2 bandwidth 10800Kbit diffserv3 dual-srchost nat split-gso rtt 150.0ms noatm overhead 8 mpu 64
 Sent 36156 bytes 179 pkt (dropped 0, overlimits 8 requeues 0)
 backlog 0b 0p requeues 0
 memory used: 6240b of 4Mb
 capacity estimate: 10800Kbit
 min/max network layer size:           40 /    1480
 min/max overhead-adjusted size:       64 /    1488
 average network hdr offset:            0

                   Bulk  Best Effort        Voice
  thresh        675Kbit    10800Kbit     2700Kbit
  target         27.0ms        7.5ms        7.5ms
  interval      169.5ms      150.0ms      150.0ms
  pk_delay          0us        585us          8us
  av_delay          0us         21us          0us
  sp_delay          0us         18us          0us
  backlog            0b           0b           0b
  pkts                0          177            2
  bytes               0        35976          180
  way_inds            0            0            0
  way_miss            0          124            1
  way_cols            0            0            0
  drops               0            0            0
  marks               0            0            0
  ack_drop            0            0            0
  sp_flows            0            3            0
  bk_flows            0            1            0
  un_flows            0            0            0
  max_len             0         1480           90
  quantum           300          329          300

qdisc ingress ffff: dev pppoe-wan parent ffff:fff1 ----------------
 Sent 24559 bytes 167 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc cake 8029: dev ifb4pppoe-wan root refcnt 2 bandwidth 14400Kbit besteffort dual-dsthost nat wash split-gso rtt 150.0ms noatm overhead 8 mpu 64
 Sent 24559 bytes 167 pkt (dropped 0, overlimits 10 requeues 0)
 backlog 0b 0p requeues 0
 memory used: 2112b of 4Mb
 capacity estimate: 14400Kbit
 min/max network layer size:           40 /    1492
 min/max overhead-adjusted size:       64 /    1500
 average network hdr offset:            0

                  Tin 0
  thresh      14400Kbit
  target          7.5ms
  interval      150.0ms
  pk_delay        203us
  av_delay         17us
  sp_delay         17us
  backlog            0b
  pkts              167
  bytes           24559
  way_inds            0
  way_miss          128
  way_cols            0
  drops               0
  marks               0
  ack_drop            0
  sp_flows           25
  bk_flows            1
  un_flows            0
  max_len          1492
  quantum           439

root@HH5A:~# tc -d qdisc
qdisc noqueue 0: dev lo root refcnt 2
qdisc fq_codel 0: dev eth0 root refcnt 2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms memory_limit 4Mb ecn
qdisc noqueue 0: dev br-lan root refcnt 2
qdisc noqueue 0: dev eth0.1 root refcnt 2
qdisc noqueue 0: dev wlan1 root refcnt 2
qdisc noqueue 0: dev wlan0 root refcnt 2
qdisc fq_codel 0: dev dsl0 root refcnt 2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms memory_limit 4Mb ecn
qdisc noqueue 0: dev dsl0.35 root refcnt 2
qdisc cake 8028: dev pppoe-wan root refcnt 2 bandwidth 10800Kbit diffserv3 dual-srchost nat split-gso rtt 150.0ms noatm overhead 8 mpu 64
qdisc ingress ffff: dev pppoe-wan parent ffff:fff1 ----------------
qdisc cake 8029: dev ifb4pppoe-wan root refcnt 2 bandwidth 14400Kbit besteffort dual-dsthost nat wash split-gso rtt 150.0ms noatm overhead 8 mpu 64
root@HH5A:~#


Hi thanks It was 10500 I edeted the post. :slight_smile:

@moeller0 Is there anything I can do with SQM so I don't loos so much bandwidth?

As for a wishlist. A chek box to ad the nat dual-dsthost in the luci-app-sqm would be nice.

1 Like

Everything great !!!

My config:

config queue 'wan'
	option ingress_ecn 'ECN'
	option egress_ecn 'ECN'
	option linklayer 'none'
	option enabled '1'
	option interface 'pppoe-wan'
	option download '38000'
	option upload '38000'
	option debug_logging '0'
	option verbosity '5'
	option qdisc 'cake'
	option script 'layer_cake.qos'
	option qdisc_advanced '1'
	option squash_dscp '1'
	option squash_ingress '1'
	option qdisc_really_really_advanced '1'
	option iqdisc_opts 'diffserv8 nat dual-dsthost'
	option eqdisc_opts 'diffserv8 nat dual-srchost'

My stats:

/etc/config$ tc -s qdisc
qdisc noqueue 0: dev lo root refcnt 2 
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0) 
 backlog 0b 0p requeues 0
qdisc fq_codel 0: dev eth0 root refcnt 2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms memory_limit 4Mb ecn 
 Sent 475996131 bytes 1262527 pkt (dropped 0, overlimits 0 requeues 181) 
 backlog 0b 0p requeues 181
  maxpacket 1514 drop_overlimit 0 new_flow_count 269 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc noqueue 0: dev br-lan root refcnt 2 
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0) 
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth0.1 root refcnt 2 
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0) 
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth0.3 root refcnt 2 
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0) 
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth0.2 root refcnt 2 
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0) 
 backlog 0b 0p requeues 0
qdisc cake 8007: dev pppoe-wan root refcnt 2 bandwidth 38Mbit diffserv8 dual-srchost nat split-gso rtt 100.0ms raw overhead 0 
 Sent 161655837 bytes 1008431 pkt (dropped 248, overlimits 85982 requeues 0) 
 backlog 0b 0p requeues 0
 memory used: 374094b of 4Mb
 capacity estimate: 38Mbit
 min/max network layer size:           32 /    1492
 min/max overhead-adjusted size:       32 /    1492
 average network hdr offset:            0

                  Tin 0        Tin 1        Tin 2        Tin 3        Tin 4        Tin 5        Tin 6        Tin 7
  thresh         38Mbit    33250Kbit    29093Kbit    25457Kbit    22274Kbit    19490Kbit    17054Kbit    14922Kbit
  target          5.0ms        5.0ms        5.0ms        5.0ms        5.0ms        5.0ms        5.0ms        5.0ms
  interval      100.0ms      100.0ms      100.0ms      100.0ms      100.0ms      100.0ms      100.0ms      100.0ms
  pk_delay          0us          0us        1.3ms         52us         68us          0us          0us         21us
  av_delay          0us          0us        118us         21us         11us          0us          0us         14us
  sp_delay          0us          0us          2us          3us         11us          0us          0us          0us
  backlog            0b           0b           0b           0b           0b           0b           0b           0b
  pkts                0            0       996690         9097          155            0            0         2737
  bytes               0            0    153060859      8282172        11780            0            0       660280
  way_inds            0            0       299602            0            0            0            0            0
  way_miss            0            0        11135            3          154            0            0          254
  way_cols            0            0            0            0            0            0            0            0
  drops               0            0          248            0            0            0            0            0
  marks               0            0            0            0            0            0            0            0
  ack_drop            0            0            0            0            0            0            0            0
  sp_flows            0            0            1            0            0            0            0            1
  bk_flows            0            0            1            0            0            0            0            0
  un_flows            0            0            0            0            0            0            0            0
  max_len             0            0        17568         1280           76            0            0          576
  quantum          1159         1014          887          776          679          594          520          455

qdisc ingress ffff: dev pppoe-wan parent ffff:fff1 ---------------- 
 Sent 1991169784 bytes 1473990 pkt (dropped 0, overlimits 0 requeues 0) 
 backlog 0b 0p requeues 0
qdisc mq 0: dev wlan1 root 
 Sent 191874491 bytes 161160 pkt (dropped 0, overlimits 0 requeues 55) 
 backlog 0b 0p requeues 55
qdisc fq_codel 0: dev wlan1 parent :4 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms memory_limit 4Mb ecn 
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0) 
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wlan1 parent :3 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms memory_limit 4Mb ecn 
 Sent 191847295 bytes 161108 pkt (dropped 0, overlimits 0 requeues 55) 
 backlog 0b 0p requeues 55
  maxpacket 1506 drop_overlimit 0 new_flow_count 18 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wlan1 parent :2 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms memory_limit 4Mb ecn 
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0) 
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev wlan1 parent :1 limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms memory_limit 4Mb ecn 
 Sent 27196 bytes 52 pkt (dropped 0, overlimits 0 requeues 0) 
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc noqueue 0: dev wlan0 root refcnt 2 
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0) 
 backlog 0b 0p requeues 0
qdisc cake 8008: dev ifb4pppoe-wan root refcnt 2 bandwidth 38Mbit diffserv8 dual-dsthost nat wash split-gso rtt 100.0ms raw overhead 0 
 Sent 1987690755 bytes 1471598 pkt (dropped 2392, overlimits 2197189 requeues 0) 
 backlog 0b 0p requeues 0
 memory used: 594720b of 4Mb
 capacity estimate: 38Mbit
 min/max network layer size:           28 /    1492
 min/max overhead-adjusted size:       28 /    1492
 average network hdr offset:            0

                  Tin 0        Tin 1        Tin 2        Tin 3        Tin 4        Tin 5        Tin 6        Tin 7
  thresh         38Mbit    33250Kbit    29093Kbit    25457Kbit    22274Kbit    19490Kbit    17054Kbit    14922Kbit
  target          5.0ms        5.0ms        5.0ms        5.0ms        5.0ms        5.0ms        5.0ms        5.0ms
  interval      100.0ms      100.0ms      100.0ms      100.0ms      100.0ms      100.0ms      100.0ms      100.0ms
  pk_delay          0us         98us        617us        439us          0us          0us         70us          0us
  av_delay          0us         20us        152us         43us          0us          0us          1us          0us
  sp_delay          0us          2us          7us         20us          0us          0us          1us          0us
  backlog            0b           0b           0b           0b           0b           0b           0b           0b
  pkts                0      1104873       367440         1672            0            0            5            0
  bytes               0   1538590906    452436752       141334            0            0          792            0
  way_inds            0        15529           59            0            0            0            0            0
  way_miss            0         1410        10893           40            0            0            4            0
  way_cols            0            0            0            0            0            0            0            0
  drops               0         2089          303            0            0            0            0            0
  marks               0            0            0            0            0            0            0            0
  ack_drop            0            0            0            0            0            0            0            0
  sp_flows            0            1            3            0            0            0            1            0
  bk_flows            0            0            0            0            0            0            0            0
  un_flows            0            0            0            0            0            0            0            0
  max_len             0         1492         1492          159            0            0          332            0
  quantum          1159         1014          887          776          679          594          520          455

The problem seems to be that the resulting sppeds are pretty much beloww the shaper setting, which might indicate an oveloaded CPU, could you run "top -d 1" on your router while running beterspeedtest, and monitor the idle%? That could indicate CPU shortage. If so it would be worthwhile figuring out why you are shrt on CPU cycles, for older router's the answer often is, the CPU runs at full throttle but that simply is not enough, for more modern routers like the r7800? it seems to be sometimes, that power saving interferes with the bandwidth shaper (here trying to disable all aggressive power savving features might help to diagnose the issue).

I see, I guess now that cake has made it into net-next, it seems unlikely to disappear any time soon, so exposing more of cake's unique features in sqm-scripts would make sense. But currently I -EOUTOFTIME....

2 Likes

I'm using a DIR-860L B1 as a (smart) switch + AP and i wonder if that isn't good for my SQM setup.
My main router is a WRT3200ACM and responsible for my whole network (DHCP, DNS, PPPoE, SQM) but the clients which are connected over my DIR-860L (wired and wireless) seem to act normal...

I've tested my SQM setup with the "betterspeedtest" script while downloading three torrents over qbittorrent and i think the results are okay but when i download a game over steam i get bad ping times (not very stable) at my other clients (hopefully that can be fixed somehow?).
At the moment i'm using the latest build of davidc502: Lede SNAPSHOT r7829-42dc0e2594 / LuCI Master (git-18.222.53504-c2d36ba)

Result with almost no activity at my connection:

root@OpenWRT:/usr/lib/OpenWrtScripts# sh betterspeedtest.sh
2018-08-14 19:13:52 Testing against netperf.bufferbloat.net (ipv4) with 5 simultaneous sessions while pinging gstatic.com (60 seconds in each direction)
.............................................................
 Download:  80.69 Mbps
  Latency: (in msec, 61 pings, 0.00% packet loss)
      Min: 26.149
    10pct: 26.399
   Median: 26.699
      Avg: 26.992
    90pct: 28.360
      Max: 29.080
.............................................................
   Upload:  33.19 Mbps
  Latency: (in msec, 61 pings, 0.00% packet loss)
      Min: 26.188
    10pct: 26.280
   Median: 26.662
      Avg: 26.723
    90pct: 27.012
      Max: 29.384

While downloading 3 torrents (~500 connections):

root@OpenWRT:/usr/lib/OpenWrtScripts# sh betterspeedtest.sh
2018-08-14 19:54:23 Testing against netperf.bufferbloat.net (ipv4) with 5 simultaneous sessions while pinging gstatic.com (60 seconds in each direction)
.............................................................
 Download:  33.85 Mbps
  Latency: (in msec, 61 pings, 0.00% packet loss)
      Min: 26.284
    10pct: 26.633
   Median: 27.092
      Avg: 28.503
    90pct: 32.465
      Max: 41.846
..............................................................
   Upload:  26.97 Mbps
  Latency: (in msec, 62 pings, 0.00% packet loss)
      Min: 26.401
    10pct: 26.959
   Median: 27.660
      Avg: 28.393
    90pct: 30.645
      Max: 39.011

When downloading a game over steam client (this really bothers me!):

root@OpenWRT:/usr/lib/OpenWrtScripts# sh betterspeedtest.sh
2018-08-14 20:25:02 Testing against netperf.bufferbloat.net (ipv4) with 5 simultaneous sessions while pinging gstatic.com (60 seconds in each direction)
.............................................................
 Download:  41.32 Mbps
  Latency: (in msec, 61 pings, 0.00% packet loss)
      Min: 26.402
    10pct: 26.613
   Median: 27.757
      Avg: 29.787
    90pct: 33.192
      Max: 53.241
.............................................................
   Upload:  28.28 Mbps
  Latency: (in msec, 60 pings, 0.00% packet loss)
      Min: 26.641
    10pct: 27.020
   Median: 29.391
      Avg: 34.662
    90pct: 51.482
      Max: 76.017

SQM config:
Another thing that i'm confused about is that my config queue = 'eth1', i guess it should be wan or eth1.2 (my wan interface)... imho very strange.

config queue 'eth1'
	option ingress_ecn 'ECN'
	option egress_ecn 'ECN'
	option itarget 'auto'
	option etarget 'auto'
	option interface 'pppoe-wan'
	option debug_logging '0'
	option verbosity '5'
	option qdisc 'cake'
	option qdisc_advanced '1'
	option squash_dscp '1'
	option squash_ingress '1'
	option qdisc_really_really_advanced '1'
	option iqdisc_opts 'nat dual-dsthost ingress'
	option eqdisc_opts 'nat dual-srchost'
	option linklayer 'ethernet'
	option overhead '34'
	option linklayer_advanced '1'
	option tcMTU '2047'
	option tcTSIZE '128'
	option tcMPU '64'
	option linklayer_adaptation_mechanism 'default'
	option download '90000'
	option upload '35200'
	option enabled '1'
	option script 'layer_cake.qos'

And right now i'm trying to figure out how to make SQM @layer_cake work with DSCP markings to put my steam downloads into the bulk class so my ping will stay low while someone on my network is downloading something over the steam client.

Mmmh, what do I get wrong in the following:
You run betterspeedtest from your router, so with a different IP address than the machine runnig the steam client, and now you only get roughly 50% of your unloaded 80 Mbps at the router. This looks to me that the dual-XXXhost isolation modes work as intended. Or is your point that the max and 90pct values for the Latency increased more than you would like?

This is mostly just cosmetic and should have no real effect on the configs utility.

I use the max bandwidth setting in the Steam client.

one thing that works well is using an http proxy such as squid with delay pools. You can decide what bandwidth to allocate based on the actual URL or at least the domain name (for HTTPS traffic) and the config is all in one place, affecting all the LAN machines.

I see in general with the 4.x kernels vs 3.x is high qos latency (lag spike) and cpu load, with speed > 100Mbps