Routing traffic to wireless in client mode

Hello out there,
I've been busy the whole day figuring out out how to route traffic to an esp32 in ap mode with the router connected to the device. My setup already has lots of vlans and other openwrt devices for further distribution of traffic. The problem now is how to route traffic from let's say 192.168.1.0/24 net to 192.168.4.1 (which is the esp32). I've managed to get it running in its own vlan. I can connect a laptop to that and it gets an IP address from the esp32 using relayd on the router. Traffic is as expected but no cross subnet traffic is accomplished. Any ideas how to set it up to get running?