So for multiple ip networks, domain interception is needed to redirect local lookups to OpenWrt and not pass them to the upstream (which will only reply NXDOMAIN as it has no knowledge of local hosts.)
Adding these intercepts :
[/lan/]127.0.0.1:5353 #change lan to your domain
[//]127.0.0.1:5353 #intercept domainless requests
to the upstream list will intercept lan (or what ever domain you are using locally) and domainless requests and pass those requests back to openwrt. "lan" is OpenWrt's default domain, change this if you are using something else. (You may need to put your ip address instead of just local host if you are hosting AGH on another router.)
Thanks to @Cheddoleum