Unable to turn off IPv6 and still use DNS

I can't even use my designated IPv4 DNS servers when I have wan6:

Adding this back won't work:

…
config interface 'wan6'
        option ifname 'eth1.2'
        option proto 'dhcpv6'
        option delegate '0'
        option peerdns '0'
…

Nor will this:

…
config interface 'wan6'
        option ifname 'eth1.2'
        option proto 'dhcpv6'
        option delegate '0'
        option peerdns '0'
        list dns '185.121.177.177'
        list dns '169.239.202.202'
…
root@…:~# ifconfig
…
eth1.2    Link encap:Ethernet  HWaddr …
          inet addr:<ISP_ASSIGNED_IPv4>  Bcast:<ISP_ASSIGNED_BCAST_IPv4>  Mask:255.255.254.0
          inet6 addr: <ISP_ASSIGNED_IPv6>/128 Scope:Global
          inet6 addr: fe80::6238:…/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:24 errors:0 dropped:0 overruns:0 frame:0
          TX packets:271 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:4882 (4.7 KiB)  TX bytes:23058 (22.5 KiB)
…

Only if I do this, can I resolve names:

…
config interface 'wan6'
        option ifname 'eth1.2'
        option proto 'dhcpv6'
        option delegate '0'
        option peerdns '0'
        # These have to be IPv6 addresses for some reason, otherwise I can't resolve names
        list dns '2a05:dfc7:5::53'
        list dns '2a05:dfc7:5::5353'
…

Now it works (but uses IPv6):

root@…:~# nslookup openwrt.org
Server:         127.0.0.1
Address:        127.0.0.1#53

Name:      openwrt.org
Address 1: 139.59.209.225
Address 2: 2a03:b0c0:3:d0::1af1:1

dnsmasq logs:

Fri Sep 10 17:12:14 2021 daemon.info dnsmasq[5874]: 155 127.0.0.1/49708 query[A] openwrt.org from 127.0.0.1
Fri Sep 10 17:12:14 2021 daemon.info dnsmasq[5874]: 155 127.0.0.1/49708 forwarded openwrt.org to 2a05:dfc7:5::5353
Fri Sep 10 17:12:14 2021 daemon.info dnsmasq[5874]: 156 127.0.0.1/49708 query[AAAA] openwrt.org from 127.0.0.1
Fri Sep 10 17:12:14 2021 daemon.info dnsmasq[5874]: 156 127.0.0.1/49708 forwarded openwrt.org to 2a05:dfc7:5::5353
Fri Sep 10 17:12:14 2021 daemon.info dnsmasq[5874]: 155 127.0.0.1/49708 reply openwrt.org is 139.59.209.225
Fri Sep 10 17:12:14 2021 daemon.info dnsmasq[5874]: 156 127.0.0.1/49708 reply openwrt.org is 2a03:b0c0:3:d0::1af1:1

What gives?