QoSmate: (Yet Another) Quality of Service Tool for OpenWrt

[lytr]

@Hudra

Are you aiming to create a database of QoS performance metrics per router, or what exactly should be measured?

My idea is a script that would be able to determine the performance of the device in some way.

@Hudra

For example, are you focusing on throughput alone, or throughput plus latency, CPU utilization, or all of them combined?

It could be just a throughput test to start with, and some other metrics could be added later.

@Hudra

If you create a test environment using netns and iperf3 as in your example script to measure QoS performance the test will likely be more synthetic and may not accurately reflect the real-world conditions when applying QoS to the WAN-facing interface.

There is no problem with this, it is more about estimating the capabilities of the device than the actual results.

@Hudra

If I remember correctly, betterspeedtest does something similar and could potentially be integrated into qosmate. However, this is not something you couldn't already test with the waveform bufferbloat test or the cloudflare speedtest.

I am thinking about a test that would be performed internally without the need for communication with external services.

[Hudra]

@lytr

the performance of the device in some way.

Hmm yeah, but that’s exactly the question: What kind of performance are you trying to measure and what problem are you actually trying to solve with it?

If we implement a synthetic benchmark what kind of conclusions can we realistically draw from it?

For example, if your router proves capable of traffic shaping at 1 Gbps in a test, but fails to do so in a real-world scenario then what’s the point of the test?

[lytr]

@Hudra

Hmm yeah, but that’s exactly the question: What kind of performance are you trying to measure and what problem are you actually trying to solve with it?

If we implement a synthetic benchmark what kind of conclusions can we realistically draw from it?

I mean estimating the maximum performance of the processor. By running the same test on different devices, you can create a database of results.

Such a database can help you choose a device. Currently, you can find very diverse information from different users.

@Hudra

For example, if your router proves capable of traffic shaping at 1 Gbps in a test, but fails to do so in a real-world scenario then what’s the point of the test?

Real results may differ significantly, but this depends on many factors.

[Knomax]

Hi..i want to thanks again @Hudra for his work and @antonk for update system.
Until now even in my low speeds i get in Waveform bufferbloat test 1-3ms for download and stable 0 ms in upload direction!!
Also my rule for game console is only for UDP of course and was seeing until now that if i wasnt playing "live" and seeing something in games menu etc trophy's,medals,tanks (i play wot) and such things game menu wasnt "fast".
Now i think something has to do with "Enable Initial TCP Down-Prioritization" and "Enable Sustained TCP Down-Prioritization" game menu is much more faster ..changing tabs and so on...maybe it uses TCP traffic?Or maybe it is "placebo" from me i dont know.
For sure i "see" an improvement .
Again thank you guys.

[Hudra]

@Knomax

Now i think something has to do with "Enable Initial TCP Down-Prioritization" and "Enable Sustained TCP Down-Prioritization" game menu is much more faster ..changing tabs and so on...maybe it uses TCP traffic?Or maybe it is "placebo" from me i dont know.
For sure i "see" an improvement .

What exactly do you mean by that? Are you seeing an improvement when these two settings are enabled or disabled?

[Knomax]

@Hudra

What exactly do you mean by that? Are you seeing an improvement when these two settings are enabled or disabled?

Both are enabled and see improvement...as i said maybe it is "placebo" from me?

[Hudra]

Then it’s probably more of a placebo effect, since those two settings have always been active before. The only thing that changed is that they can now be disabled.

[Knomax]

In statistics tab i have some "Drops" and the same number in "Overlimits" for "High Priority (Realtime)" class in normal class has only "drops" but i dont care for this class.
I change the speeds in settings but didnt change anything...i use "red" for Queue Discipline.
Can i do something about it?
And i understand "drop"....overlimit what means?

[moeller0]

@Knomax

And i understand "drop"....overlimit what means?

Overlimits with qdiscs typically just means that the qdisc actually engaged, this is not an error it is really just an information if you ask, did my realtime qdisc actually ever do something?

[Knomax]

Hi..it is possible to have crontab jobs in Luci?Like to "restart" Qosmate every 2 hours or stop it or enable it at specific hours,days?

[Hudra]

Of course you can use a cronjob… This is not really related to qosmate. There’s also a luci app for that. The question is why you would need to restart it every 2 hours?

[Knomax]

Need restart to test if "small" lags caused somehow from my hardware or game server side.

[Hudra]

And why do you think restarting qosmate will help you here?

[Knomax]

Because these small lags "fixed" when i restart qosmate....just to see if this was "lucky timing".

[godsEXist]

Hi @Hudra, I can't seem to overcome the TOS 0x0 on income and outcome traffic. I remember I had this exact network configuration (AP with/ split WAN / LAN) while using SimpleHFSCscript before. Technically, br-lan.2 is my WAN, while Qosmate makes the IFB.
Both Egress and Ingress are turned off.

root@OpenWrt:~# tcpdump -i br-lan.2 -v -n -Q out icmp
tcpdump: listening on br-lan.2, link-type EN10MB (Ethernet), snapshot length 262144 bytes
12:07:35.732358 IP (tos 0x0, ttl 128, id 20852, offset 0, flags [none], proto ICMP (1), length 60)
    192.168.1.3 > 1.1.1.1: ICMP echo request, id 1, seq 117, length 40
12:07:36.749057 IP (tos 0x0, ttl 128, id 20853, offset 0, flags [none], proto ICMP (1), length 60)
    192.168.1.3 > 1.1.1.1: ICMP echo request, id 1, seq 118, length 40
12:07:37.751595 IP (tos 0x0, ttl 128, id 20854, offset 0, flags [none], proto ICMP (1), length 60)
    192.168.1.3 > 1.1.1.1: ICMP echo request, id 1, seq 119, length 40
12:07:38.754929 IP (tos 0x0, ttl 128, id 20855, offset 0, flags [none], proto ICMP (1), length 60)
    192.168.1.3 > 1.1.1.1: ICMP echo request, id 1, seq 120, length 40

config rule
        option name 'dscp test'
        list proto 'icmp'
        list dest_ip '1.1.1.1'
        option target 'DSCP'
        option set_dscp 'CS0'
        option src '*'
        option dest '*'
        list src_ip '192.168.1.3'

[Hudra]

Without more information about your network topology or settings, it's difficult to draw any conclusions. If you need help, please fill out the issue report template.

Also, a quick tip: if you're using tcpdump to check whether QoSmate is marking packets correctly, make sure to temporarily disable DSCP washing. Otherwise, you won't see the DSCP values in tcpdump . Also, the interface you're capturing on with tcpdump depends on the direction you want to inspect.

Edit:
Also, the syntax of your rule is incorrect (looks like a default openwrt firewall config?):

@godsEXist

config rule
        option name 'dscp test'
        list proto 'icmp'
        list dest_ip '1.1.1.1'
        option target 'DSCP'
        option set_dscp 'CS0'
        option src '*'
        option dest '*'
        list src_ip '192.168.1.3'

This is not a supported format and would prevent QoSmate from starting properly. You should see this reflected in the UI - there will be an "x" next to "nft", indicating that the nftables rules could not be created.
Please refer to the README or use the "Rules" section in the UI to create valid rules.

[godsEXist]

The DSCP washing are disabled.
The "dscp test" config rule was created based on the troubleshooting instructions of SimpleHFSCgamerscript, to be able to check both: tcpdump -i eth1 -v -n -Q out icmp and tcpdump -i ifb-eth1 -v -n icmptraffic.

root@OpenWrt:~# ubus call system board
{
        "kernel": "6.6.69",
        "hostname": "OpenWrt",
        "system": "ARMv8 Processor rev 4",
        "model": "ASUS RT-AX59U",
        "board_name": "asus,rt-ax59u",
        "rootfs_type": "squashfs",
        "release": {
                "distribution": "OpenWrt",
                "version": "24.10.0-rc5",
                "revision": "r28304-6dacba30a7",
                "target": "mediatek/filogic",
                "description": "OpenWrt 24.10.0-rc5 r28304-6dacba30a7",
                "builddate": "1736026537"
        }
}

root@OpenWrt:~# /etc/init.d/qosmate check_version
Backend versions:
  Update channel: release
  Current version: 1.2.0
  Latest version: 1.2.0
Frontend versions:
  Update channel: release
  Current version: 1.2.0
  Latest version: 1.2.0

QoSmate components 'BACKEND FRONTEND' are up to date.

root@OpenWrt:~# /etc/init.d/qosmate status
==== qosmate Status ====
qosmate autostart is enabled.
qosmate service is enabled.
Traffic shaping (HFSC) is active on the egress interface (br-lan.2).
Traffic shaping is active on the ingress interface (ifb-br-lan.2).
==== Overall Status ====
qosmate is currently active and managing traffic shaping.
==== Current Settings ====
Upload rate: 45000 kbps
Download rate: 90000 kbps
Game traffic upload: 7150 kbps
Game traffic download: 13900 kbps
Queue discipline: pfifo (for game traffic in HFSC)
==== Package Status ====
All required packages are installed.

==== Detailed Technical Information ====
Traffic Control (tc) Queues:
qdisc noqueue 0: dev lo root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc mq 0: dev eth0 root
 Sent 226953506 bytes 288107 pkt (dropped 0, overlimits 0 requeues 37)
 backlog 0b 0p requeues 37
qdisc fq_codel 0: dev eth0 parent :10 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :f limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :e limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :d limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :c limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :b limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :a limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :9 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :8 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 198390074 bytes 160154 pkt (dropped 0, overlimits 0 requeues 27)
 backlog 0b 0p requeues 27
  maxpacket 1518 drop_overlimit 0 new_flow_count 21 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :7 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :6 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 28561720 bytes 127937 pkt (dropped 0, overlimits 0 requeues 10)
 backlog 0b 0p requeues 10
  maxpacket 1470 drop_overlimit 0 new_flow_count 5 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :5 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :4 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 1712 bytes 16 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :3 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :2 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 0: dev eth0 parent :1 limit 10240p flows 1024 quantum 1518 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc noqueue 0: dev lan1 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev lan2 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev lan3 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev b root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev br-lan root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc noqueue 0: dev br-lan.1 root refcnt 2
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc hfsc 1: dev br-lan.2 root refcnt 2 default 13
 Sent 4527140 bytes 18478 pkt (dropped 1, overlimits 3337 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 801e: dev br-lan.2 parent 1:13 limit 10240p flows 1024 quantum 3000 target 4ms interval 100ms memory_limit 1125000b ecn drop_batch 64
 Sent 4527140 bytes 18478 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 13951 drop_overlimit 0 new_flow_count 5378 ecn_mark 0
  new_flows_len 0 old_flows_len 1
qdisc fq_codel 8020: dev br-lan.2 parent 1:15 limit 10240p flows 1024 quantum 3000 target 4ms interval 100ms memory_limit 1125000b ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc pfifo 10: dev br-lan.2 parent 1:11 limit 305p
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 801d: dev br-lan.2 parent 1:12 limit 10240p flows 1024 quantum 3000 target 4ms interval 100ms memory_limit 1125000b ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 801f: dev br-lan.2 parent 1:14 limit 10240p flows 1024 quantum 3000 target 4ms interval 100ms memory_limit 1125000b ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc ingress ffff: dev br-lan.2 parent ffff:fff1 ----------------
 Sent 16467055 bytes 30922 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc hfsc 1: dev ifb-br-lan.2 root refcnt 2 default 13
 Sent 17339538 bytes 30540 pkt (dropped 108, overlimits 8084 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 8022: dev ifb-br-lan.2 parent 1:13 limit 10240p flows 1024 quantum 3000 target 4ms interval 100ms memory_limit 2250000b ecn drop_batch 64
 Sent 17037366 bytes 28819 pkt (dropped 108, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 32134 drop_overlimit 106 new_flow_count 7062 ecn_mark 0 drop_overmemory 106
  new_flows_len 1 old_flows_len 3
qdisc fq_codel 8024: dev ifb-br-lan.2 parent 1:15 limit 10240p flows 1024 quantum 3000 target 4ms interval 100ms memory_limit 2250000b ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc pfifo 10: dev ifb-br-lan.2 parent 1:11 limit 605p
 Sent 302172 bytes 1721 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc fq_codel 8021: dev ifb-br-lan.2 parent 1:12 limit 10240p flows 1024 quantum 3000 target 4ms interval 100ms memory_limit 2250000b ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0
qdisc fq_codel 8023: dev ifb-br-lan.2 parent 1:14 limit 10240p flows 1024 quantum 3000 target 4ms interval 100ms memory_limit 2250000b ecn drop_batch 64
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
  maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0
  new_flows_len 0 old_flows_len 0

==== Nftables Ruleset (dscptag) ====
        chain dscptag {
                type filter hook forward priority filter; policy accept;
                iif "lo" accept
                meta l4proto udp ct original proto-src { 6881-6889, 51413 } counter packets 0 bytes 0 jump mark_cs1
                meta l4proto udp ct original proto-dst { 6881-6889, 51413 } counter packets 0 bytes 0 jump mark_cs1
                meta l4proto tcp ct original proto-dst { 6881-6889, 51413 } counter packets 0 bytes 0 jump mark_cs1
                meta length < 100 tcp flags ack add @xfst4ack { ct id . ct direction limit rate over 225000/second burst 5 packets } counter packets 0 bytes 0 jump drop995
                meta length < 100 tcp flags ack add @fast4ack { ct id . ct direction limit rate over 22500/second burst 5 packets } counter packets 0 bytes 0 jump drop95
                meta length < 100 tcp flags ack add @med4ack { ct id . ct direction limit rate over 2250/second burst 5 packets } counter packets 0 bytes 0 jump drop50
                meta length < 100 tcp flags ack add @slow4ack { ct id . ct direction limit rate over 2250/second burst 5 packets } counter packets 0 bytes 0 jump drop50
                meta l4proto tcp ct bytes < 5625000 jump mark_500ms
                meta l4proto tcp ct bytes > 112500000 jump mark_10s
                meta l4proto tcp ip dscp != cs1 add @slowtcp { ct id . ct direction limit rate 150/second burst 150 packets } ip dscp set af42 counter packets 0 bytes 0
                meta l4proto tcp ip6 dscp != cs1 add @slowtcp { ct id . ct direction limit rate 150/second burst 150 packets } ip6 dscp set af42 counter packets 0 bytes 0
                meta priority set ip dscp map @priomap counter packets 0 bytes 0
                meta priority set ip6 dscp map @priomap counter packets 0 bytes 0
                ct mark set ip dscp | 0x80 counter packets 0 bytes 0
                ct mark set ip6 dscp | 0x80 counter packets 0 bytes 0
        }
}

==== Custom Rules Table Status ====
Custom rules table (qosmate_custom) is not active or doesn't exist.

root@OpenWrt:~# /etc/init.d/qosmate health_check
status=service:enabled;nft:ok;tc:ok;config:ok;packages:ok;BACKEND_integrity:ok;FRONTEND_integrity:ok;;errors=0

root@OpenWrt:~# cat /etc/config/qosmate

config global 'global'
        option enabled '1'

config settings 'settings'
        option WAN 'br-lan.2'
        option DOWNRATE '90000'
        option UPRATE '45000'
        option ROOT_QDISC 'hfsc'

config advanced 'advanced'
        option PRESERVE_CONFIG_FILES '1'
        option WASHDSCPUP '0'
        option WASHDSCPDOWN '0'
        option BWMAXRATIO '20'
        option UDP_RATE_LIMIT_ENABLED '0'
        option TCP_UPGRADE_ENABLED '1'
        option UDPBULKPORT '51413,6881-6889'
        option TCPBULKPORT '51413,6881-6889'
        option NFT_HOOK 'forward'
        option NFT_PRIORITY '0'

config hfsc 'hfsc'
        option LINKTYPE 'ethernet'
        option OH '44'
        option gameqdisc 'pfifo'
        option nongameqdisc 'fq_codel'
        option nongameqdiscoptions 'besteffort ack-filter'
        option MAXDEL '24'
        option PFIFOMIN '5'
        option PACKETSIZE '450'
        option netemdelayms '30'
        option netemjitterms '7'
        option netemdist 'normal'
        option pktlossp 'none'
        option netem_direction 'both'

config cake 'cake'
        option COMMON_LINK_PRESETS 'ethernet'
        option PRIORITY_QUEUE_INGRESS 'diffserv4'
        option PRIORITY_QUEUE_EGRESS 'diffserv4'
        option HOST_ISOLATION '1'
        option NAT_INGRESS '1'
        option NAT_EGRESS '1'
        option ACK_FILTER_EGRESS 'auto'
        option AUTORATE_INGRESS '0'

config custom_rules 'custom_rules'

[godsEXist]

I've deleted the "dscp test" firewall config rule, and added a QoSmate rule instead, same issue "tos 0x0".

[Hudra]

You didn't provide all requested commands. What about:

ifstatus wan | grep -e device

Also make sure that the source ip matches the device you're using to run the ping.
What is your general issue? Are DSCP values not being marked at all, or is it only specific ones?
What problem are you trying to investigate with your tests?

[godsEXist]

When ifstatus wan | grep -e device no output / nothing happens. My PC IP is correct 192.168.1.3.
Yes, no DSCP values are being marked.