These are the instructions I've followed from the OpenWrt site: https://openwrt.org/docs/guide-user/services/vpn/openvpn/client-luci
The firewall settings are described in section 4.1-b.
Everything works as expected after following the instructions.