I think the main reason people are using it is because it is easy to set up and because it can add DSCP tags based on the destination domain.
But I agree with you, applying the same DSCP using connection tracking would be better.
Once dnsmasq is updated to 2.87, which supports nftset (like ipset for domain based firewall rules), then perhaps your proposed solution can fully replace QoSify.