factory images can only be used when flashing from the OEM environment, e.g. from the OEM/ ZyXEL webinterface or the OEM bootloader (tftp recovery).
Once you have flashed OpenWrt, you must only use the corresponding sysupgrade images.
Clearing browser caches is strongly recommended when switching between OEM- and OpenWrt webinterface, as it might remember, now obsolete, http redirects which won't work in 'the other' webinterface.
If you messed anything up in your previous attempts, there's always https://openwrt.org/toh/zyxel/nbg6817#debricking using the factory image (as the tftp recovery is done by the OEM bootloader and not from within an OpenWrt environment).