I play fps games, mainly Valorant, and despite having a tight SQM-layered-cake limits that I always get A+ on the bufferbloat test with +1 +1 loaded latencies, I still get high jitter in valorant and packet loss constantly, is there a way to track what’s happening to the packets and where they’re being dropped?
install package tcpdump and monitor both lan and wan interfaces, then compare.
1 Like
tc -s qdisc # you should have monitoted this already - resched and ecn good, drop bad)
cat /proc/net/softnet_stat (2nd/3rd column are packet drops in router
ethtool -S wan/lan5/eth0 # drops in buffers, bad checksums, pause activities
likely too much traffic crosses in voice priorities and messes up rest of bins.
netstat -s on your local system, tc -s qdisc on router to see dropped packages and marked (if ECN used), ss -tio - per connection statistics.
Dropping packages is OK, totally OK. That's how most congestion control algos detect throughput of your cable/wifi/etc.
If you have game control udp stream and bin it together with game resource download you kill the purpose of qos.
You're totally right. In this case the problem is in software which manages that flow. It works in userspace... - end of story.
I’m a bit confused by all of that, I’ve DSCP value of 46 for valorant traffic, from the main executable, which afaik doesn’t generate the voice traffic, the voice traffic goes through the riot client
output for tc -s qdisk
qdisc noqueue 0: dev lo root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc mq 0: dev dsa root
Sent 55976803818 bytes 51894702 pkt (dropped 286, overlimits 0 requeues 12287)
backlog 0b 0p requeues 12287
qdisc fq_codel 0: dev dsa parent :10 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :f limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :e limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :d limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :c limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :b limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :a limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :9 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :8 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 33000235230 bytes 31405559 pkt (dropped 0, overlimits 0 requeues 4207)
backlog 0b 0p requeues 4207
maxpacket 3036 drop_overlimit 0 new_flow_count 102010 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :7 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 22976566736 bytes 20489125 pkt (dropped 286, overlimits 0 requeues 8080)
backlog 0b 0p requeues 8080
maxpacket 1504 drop_overlimit 0 new_flow_count 12913 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :6 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :5 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :4 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 1852 bytes 18 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :3 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :2 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :1 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc mq 0: dev eth0 root
Sent 3741701061 bytes 24282007 pkt (dropped 0, overlimits 0 requeues 5692)
backlog 0b 0p requeues 5692
qdisc fq_codel 0: dev eth0 parent :10 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :f limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :e limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :d limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :c limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :b limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :a limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :9 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :8 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :7 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :6 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :5 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 3741701061 bytes 24282007 pkt (dropped 0, overlimits 0 requeues 5692)
backlog 0b 0p requeues 5692
maxpacket 1494 drop_overlimit 0 new_flow_count 4593 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc noqueue 0: dev eth1 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth2 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth3 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth4 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev br-lan root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc cake 800b: dev pppoe-wan root refcnt 2 bandwidth 19Mbit diffserv3 dual-dsthost nat nowash ingress no-ack-filter split-gso rtt 100ms noatm overhead 44 mpu 64 memlimit 32Mb
Sent 1747078629 bytes 11611344 pkt (dropped 395, overlimits 875330 requeues 0)
backlog 0b 0p requeues 0
memory used: 617376b of 32Mb
capacity estimate: 19Mbit
min/max network layer size: 36 / 1472
min/max overhead-adjusted size: 80 / 1516
average network hdr offset: 0Bulk Best Effort Voicethresh 1187Kbit 19Mbit 4750Kbit
target 15.3ms 5ms 5ms
interval 110ms 100ms 100ms
pk_delay 0us 727us 134us
av_delay 0us 35us 24us
sp_delay 0us 15us 16us
backlog 0b 0b 0b
pkts 0 9908100 1703639
bytes 0 1341031367 406558910
way_inds 0 232239 2308
way_miss 0 124294 34210
way_cols 0 0 0
drops 0 395 0
marks 0 0 0
ack_drop 0 0 0
sp_flows 0 3 8
bk_flows 0 0 0
un_flows 0 0 0
max_len 0 67160 1021
quantum 300 579 300qdisc ingress ffff: dev pppoe-wan parent ffff:fff1 ----------------
Sent 27865049120 bytes 28211132 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc cake 800c: dev ifb4pppoe-wan root refcnt 2 bandwidth 50Mbit besteffort triple-isolate nonat wash no-ack-filter split-gso rtt 100ms noatm overhead 44
Sent 27787326531 bytes 28153506 pkt (dropped 57626, overlimits 36059998 requeues 0)
backlog 0b 0p requeues 0
memory used: 2967840b of 4Mb
capacity estimate: 50Mbit
min/max network layer size: 36 / 1491
min/max overhead-adjusted size: 80 / 1535
average network hdr offset: 0Tin 0thresh 50Mbit
target 5ms
interval 100ms
pk_delay 212us
av_delay 62us
sp_delay 13us
backlog 0b
pkts 28211132
bytes 27865049120
way_inds 255040
way_miss 147286
way_cols 0
drops 57626
marks 961
ack_drop 0
sp_flows 6
bk_flows 1
un_flows 0
max_len 1491
quantum 1514
seems like the drops happen on the uplink?
cat /proc/net/softnet_stat
039524b0 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00a70b8f 00000000 00000000 00000000
03337a6d 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 0092ded4 00000000 00000000 00000001
0407ed9b 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00cb62c4 00000000 00000000 00000002
02ebf86b 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 0093aab2 00000000 00000000 00000003
finally netstat:
netstat -s
IPv4 Statistics
Packets Received = 31649974
Received Header Errors = 0
Received Address Errors = 0
Datagrams Forwarded = 0
Unknown Protocols Received = 0
Received Packets Discarded = 6795
Received Packets Delivered = 31999431
Output Requests = 20790547
Routing Discards = 0
Discarded Output Packets = 27973
Output Packet No Route = 891
Reassembly Required = 0
Reassembly Successful = 0
Reassembly Failures = 0
Datagrams Successfully Fragmented = 0
Datagrams Failing Fragmentation = 0
Fragments Created = 0IPv6 Statistics
Packets Received = 147236
Received Header Errors = 0
Received Address Errors = 230
Datagrams Forwarded = 2
Unknown Protocols Received = 0
Received Packets Discarded = 17
Received Packets Delivered = 175991
Output Requests = 166276
Routing Discards = 0
Discarded Output Packets = 14
Output Packet No Route = 0
Reassembly Required = 0
Reassembly Successful = 0
Reassembly Failures = 0
Datagrams Successfully Fragmented = 0
Datagrams Failing Fragmentation = 0
Fragments Created = 0ICMPv4 Statistics
Received SentMessages 35198 34531
Errors 0 0
Destination Unreachable 16296 15143
Time Exceeded 104 0
Parameter Problems 0 0
Source Quenches 0 0
Redirects 0 0
Echo Replies 43 18755
Echos 18755 633
Timestamps 0 0
Timestamp Replies 0 0
Address Masks 0 0
Address Mask Replies 0 0
Router Solicitations 0 0
Router Advertisements 0 0ICMPv6 Statistics
Received SentMessages 66255 27306
Errors 0 0
Destination Unreachable 23406 1
Packet Too Big 0 0
Time Exceeded 0 0
Parameter Problems 0 0
Echos 5133 0
Echo Replies 0 5133
MLD Queries 0 0
MLD Reports 0 0
MLD Dones 0 0
Router Solicitations 0 37
Router Advertisements 15569 0
Neighbor Solicitations 10977 11131
Neighbor Advertisements 11170 11004
Redirects 0 0
Router Renumberings 0 0TCP Statistics for IPv4
Active Opens = 111710
Passive Opens = 6342
Failed Connection Attempts = 74384
Reset Connections = 8339
Current Connections = 59
Segments Received = 15990338
Segments Sent = 13016064
Segments Retransmitted = 280140TCP Statistics for IPv6
Active Opens = 24474
Passive Opens = 564
Failed Connection Attempts = 24067
Reset Connections = 366
Current Connections = 0
Segments Received = 108635
Segments Sent = 58417
Segments Retransmitted = 59751UDP Statistics for IPv4
Datagrams Received = 16499329
No Ports = 6792
Receive Errors = 0
Datagrams Sent = 7865368UDP Statistics for IPv6
Datagrams Received = 116190
No Ports = 1
Receive Errors = 0
Datagrams Sent = 53992
I see no problems with packet drop from what I see. Did you run that tc -s qdisc on your router and netstat -s on your client PC?
Can you fix formatting?
yep tc on router, netstat on pc, I’ll try fixing the formatting but probably will stay messed up
57626 in Tin 0? Can you provide your /etc/config/network,sqm? And what's that device you use as a router?
Set game dscp 32 or 40 (video, not voice) 25% traffic in voice is excessive, normally it was prioritising 64kbps call in 100Mbps corporate network.
replaced some stuff with -------------
cat /etc/config/network:
config interface 'loopback'
option device 'lo'
option proto 'static'
option ipaddr '127.0.0.1'
option netmask '255.0.0.0'
config globals 'globals'
option ula_prefix '-------------'
option packet_steering '1'
config device
option name 'br-lan'
option type 'bridge'
list ports 'eth1'
list ports 'eth2'
list ports 'eth3'
list ports 'eth4'
config device
option name 'eth1'
option macaddr '-------------'
config device
option name 'eth2'
option macaddr '-------------'
config device
option name 'eth3'
option macaddr '-------------'
config device
option name 'eth4'
option macaddr '-------------'
config interface 'lan'
option device 'br-lan'
option proto 'static'
option ipaddr '192.168.1.1'
option netmask '255.255.255.0'
option ip6assign '60'
config device
option name 'eth0'
option macaddr '-------------'
config interface 'wan'
option device 'eth0'
option proto 'pppoe'
option username 'classified XD'
option password 'classified'
option ipv6 'auto'
config interface 'wan6'
option device 'eth0'
option proto 'dhcpv6'
config interface 'modem'
option proto 'static'
option device 'eth0'
option ipaddr '192.168.0.2'
option netmask '255.255.255.0'
cat /etc/config/sqm:
config queue 'eth1'
option enabled '1'
option interface 'pppoe-wan'
option download '50000'
option upload '19000'
option qdisc 'cake'
option script 'layer_cake.qos'
option linklayer 'ethernet'
option debug_logging '0'
option verbosity '5'
option overhead '44'
option qdisc_advanced '1'
option qdisc_really_really_advanced '1'
option eqdisc_opts 'dual-dsthost nat ingress noatm overhead 44 mpu 64 memlimit 32mb'
option squash_dscp '1'
option squash_ingress '1'
option ingress_ecn 'ECN'
option egress_ecn 'NOECN'
device is TP-Link ER605 v2 as the openwrt router, & tplink VR600 as a modem in bridge mode, internet type is VDSL2, as for the 57626 in Tin0, isn't that ingress/download?
also here's the tc -s qdisk again formatted properly this time I think:
root@OpenWrt:~# tc -s qdisc
qdisc noqueue 0: dev lo root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc mq 0: dev dsa root
Sent 10307802367 bytes 7852284 pkt (dropped 0, overlimits 0 requeues 1657)
backlog 0b 0p requeues 1657
qdisc fq_codel 0: dev dsa parent :10 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :f limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :e limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :d limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :c limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :b limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :a limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :9 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :8 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 4929377309 bytes 3395963 pkt (dropped 0, overlimits 0 requeues 491)
backlog 0b 0p requeues 491
maxpacket 1518 drop_overlimit 0 new_flow_count 564 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :7 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 5378423206 bytes 4456303 pkt (dropped 0, overlimits 0 requeues 1166)
backlog 0b 0p requeues 1166
maxpacket 1490 drop_overlimit 0 new_flow_count 1283 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :6 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :5 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :4 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 1852 bytes 18 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :3 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :2 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev dsa parent :1 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc mq 0: dev eth0 root
Sent 448635244 bytes 3865978 pkt (dropped 0, overlimits 0 requeues 916)
backlog 0b 0p requeues 916
qdisc fq_codel 0: dev eth0 parent :10 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :f limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :e limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :d limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :c limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :b limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :a limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :9 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :8 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :7 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :6 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :5 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :4 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :3 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :2 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 448635244 bytes 3865978 pkt (dropped 0, overlimits 0 requeues 916)
backlog 0b 0p requeues 916
maxpacket 1494 drop_overlimit 0 new_flow_count 806 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :1 limit 10240p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
new_flows_len 0 old_flows_len 0
qdisc noqueue 0: dev eth1 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth2 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth3 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev eth4 root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc noqueue 0: dev br-lan root refcnt 2
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc cake 8005: dev pppoe-wan root refcnt 2 bandwidth 19Mbit diffserv3 dual-dsthost nat nowash ingress no-ack-filter split-gso rtt 100ms noatm overhead 44 mpu 64 memlimit 32Mb
Sent 363461274 bytes 3850916 pkt (dropped 96, overlimits 188229 requeues 0)
backlog 0b 0p requeues 0
memory used: 688608b of 32Mb
capacity estimate: 19Mbit
min/max network layer size: 36 / 1472
min/max overhead-adjusted size: 80 / 1516
average network hdr offset: 0
Bulk Best Effort Voice
thresh 1187Kbit 19Mbit 4750Kbit
target 15.3ms 5ms 5ms
interval 110ms 100ms 100ms
pk_delay 0us 258us 410us
av_delay 0us 25us 44us
sp_delay 0us 16us 17us
backlog 0b 0b 0b
pkts 0 3848569 2443
bytes 0 363134890 455944
way_inds 0 1043006 0
way_miss 0 25653 127
way_cols 0 0 0
drops 0 96 0
marks 0 0 0
ack_drop 0 0 0
sp_flows 0 2 1
bk_flows 0 1 0
un_flows 0 0 0
max_len 0 50717 576
quantum 300 579 300
qdisc ingress ffff: dev pppoe-wan parent ffff:fff1 ----------------
Sent 10212296746 bytes 7840490 pkt (dropped 0, overlimits 0 requeues 0)
backlog 0b 0p requeues 0
qdisc cake 8006: dev ifb4pppoe-wan root refcnt 2 bandwidth 50Mbit besteffort triple-isolate nonat wash no-ack-filter split-gso rtt 100ms noatm overhead 44
Sent 10163536354 bytes 7807020 pkt (dropped 33470, overlimits 13035888 requeues 0)
backlog 0b 0p requeues 0
memory used: 2630880b of 4Mb
capacity estimate: 50Mbit
min/max network layer size: 38 / 1491
min/max overhead-adjusted size: 82 / 1535
average network hdr offset: 0
Tin 0
thresh 50Mbit
target 5ms
interval 100ms
pk_delay 5.97ms
av_delay 4.83ms
sp_delay 12us
backlog 0b
pkts 7840490
bytes 10212296746
way_inds 85922
way_miss 23854
way_cols 0
drops 33470
marks 40
ack_drop 0
sp_flows 3
bk_flows 1
un_flows 0
max_len 1491
quantum 1514
is there a way to squash dscp on egress before doing that to test if it changes things? and also should I be squashing dscp on ingress "current value is to squash", finally, if my ISP sometimes throttles certain streaming website at a certain time of the day could using dscp values of 32/40 affect things negatively?
Don't squash anything, add diffserv4 to your advanced options for better Voice/Video separation, follow @brada4 's advice on marking and run tcpdump on your PC's source IP in order to see hwat value that traffic gets. Also check whether those tc -s qdisc counters are increasing. At least this is what I would do...
P.S. that high drop value on Tin 0 confuses me a bit to be honest.
P.S. #2 I know that there is a special option about ECN and SQM but I wouldn't drop it too. It's 2025 and Apple uses ECN for over decade now... even more, improved ECN is coming and Linux is still coming with half-enabled support making it useless.
could you explain what you mean by p.s.#2, I'm a bit confused, also is it normal that my download is just one tin, tin0 where those drops happen, for example the output for tc -s qdisc show dev ifb4pppoe-wan shows:
qdisc cake 8006: root refcnt 2 bandwidth 50Mbit besteffort triple-isolate nonat wash no-ack-filter split-gso rtt 100ms noatm overhead 44
Sent 13980806040 bytes 10747975 pkt (dropped 46913, overlimits 18193953 requeues 0)
backlog 0b 0p requeues 0
memory used: 2630880b of 4Mb
capacity estimate: 50Mbit
min/max network layer size: 38 / 1491
min/max overhead-adjusted size: 82 / 1535
average network hdr offset: 0
Tin 0
thresh 50Mbit
target 5ms
interval 100ms
pk_delay 218us
av_delay 22us
sp_delay 14us
backlog 0b
pkts 10794888
bytes 14049285506
way_inds 86969
way_miss 35284
way_cols 0
drops 46913
marks 40
ack_drop 0
sp_flows 2
bk_flows 1
un_flows 0
max_len 1491
quantum 1514
is this "Sent 13980806040 bytes 10747975 pkt (dropped 46913, overlimits 18193953 requeues 0)" normal?
I'm confused by the fact that it shows 3 tins for upload but only one for download, does this mean diffserv3 is on just for uploads but off for downloads, and should I replace it with diffserv4 or even 8, or try first to somehow have diffserv 3 for download? as for dscp, I used tcpdump to check the valorant udp traffic on both lan and wan, and the dscp is retained 0xb8? per brada4's advice should I test first with different dscp values of 32/40 or should I address the above first?
Make that, run /etc/init.d/sqm restart and check again.
I tried with option squash_dscp '0' option squash_ingress '0' didn't seem to help, in fact it felt as if it made it worse, although maybe that was just in my head, then I tried dscp of 40 didn't seem to make a difference, then tried 32, felt like it got a bit better, then I removed the windows qos dscp completely, and now it feels better than before, but there's still loss and jitter, gonna try diffserv4, but for diffserv3 on download:
tc -s qdisc show dev ifb4pppoe-wan
qdisc cake 8012: root refcnt 2 bandwidth 50Mbit diffserv3 triple-isolate nonat nowash no-ack-filter split-gso rtt 100ms noatm overhead 44
Sent 204081358 bytes 349243 pkt (dropped 34, overlimits 230597 requeues 0)
backlog 0b 0p requeues 0
memory used: 1290816b of 4Mb
capacity estimate: 50Mbit
min/max network layer size: 40 / 1480
min/max overhead-adjusted size: 84 / 1524
average network hdr offset: 0
Bulk Best Effort Voice
thresh 3125Kbit 50Mbit 12500Kbit
target 5.81ms 5ms 5ms
interval 101ms 100ms 100ms
pk_delay 4us 2.96ms 44us
av_delay 0us 548us 19us
sp_delay 0us 11us 13us
backlog 0b 0b 0b
pkts 1 163490 185786
bytes 60 164545105 39578552
way_inds 0 699 0
way_miss 1 2451 556
way_cols 0 0 0
drops 0 34 0
marks 0 0 0
ack_drop 0 0 0
sp_flows 1 1 6
bk_flows 0 1 0
un_flows 0 0 0
max_len 60 1480 1020
quantum 300 1514 381
and upload
qdisc cake 8011: dev pppoe-wan root refcnt 2 bandwidth 19Mbit diffserv3 dual-dsthost nat nowash ingress no-ack-filter split-gso rtt 100ms noatm overhead 44 mpu 64 memlimit 32Mb
Sent 60884138 bytes 250958 pkt (dropped 21, overlimits 15892 requeues 0)
backlog 0b 0p requeues 0
memory used: 141120b of 32Mb
capacity estimate: 19Mbit
min/max network layer size: 40 / 1472
min/max overhead-adjusted size: 84 / 1516
average network hdr offset: 0
Bulk Best Effort Voice
thresh 1187Kbit 19Mbit 4750Kbit
target 15.3ms 5ms 5ms
interval 110ms 100ms 100ms
pk_delay 0us 760us 46us
av_delay 0us 97us 19us
sp_delay 0us 14us 16us
backlog 0b 0b 0b
pkts 0 248825 2154
bytes 0 60480277 430106
way_inds 0 7270 0
way_miss 0 3208 15
way_cols 0 0 0
drops 0 21 0
marks 0 0 0
ack_drop 0 0 0
sp_flows 0 1 0
bk_flows 0 1 0
un_flows 0 0 0
max_len 0 16886 562
quantum 300 579 300
I'm assuming valorant traffic now goes into besteffort, right? and if so, do the stats show any problem?
Now you have three tins instead of one! Now is the time to install and learn a bit about tcpdump. Run something like tcpdump -vvv -i br-lan src host PC_ADDRESS and see if those packets have DSCP field properly marked. Probably something is working since you have 2154 packets in Voice.
BTW, can you provide https://www.waveform.com/tools/bufferbloat results? Just to see general picture...
As reported by Valorant? In that case please be aware that your ISP might simply be badly connected with the network housing riot games' servers... that drop and delay can happen anywhere between your gaming machine and the servers for both forward* and return path (these typically are not equal). What ISP are we talking about here, what cpuntry and where are the game servers housed (in how far away from your location).
*) Forward paths can be probed realatively straight forward; figure out the IP address of one of the servers you use and then use a traceroute tool (I like mtr or even better trippy) and get a trace of the path from your home network to the servers. Alas, for the return path you need machines that allow you to run a traceroute from close to the server (same network, same datacenter) back to your home network, and that is typically hard to get ones hands on, some ISPs offer so called looking glas server, that often offer traceroute as well, but gaming companies typically do not do so (and I can not find public looking glas servers for riot games/valorant).
I would have a look both at qosmate (and the matching luci-app-qosmate):
and geomate (and the matching luci-app-geomate)
to help with some of your problems... qosmate will allow to meaningfully use priority scheduling also for ingress packets, and geomate should allow to collect information about server IP addresses and geographic location easily (I believe after that you can use geomate to restrict games to specific servers/lserver locations, which might help with your issue).
2 Likes