There is no supported way to do this. Since all devices of a given target share the same kernel, the kernel config has to be generic among them.
The only two choices I see are a) enabling CONFIG_SPI_GPIO and regression-test the other devices [preferred] or b) break out your specific device into another subtarget [unlikely to get accepted upstream].