That speed reduction is expected because the CPU is not able to handle the speed. The stock firmware implement some sort of hardware nat that LEDE doesn't do, so the CPU has to work harder resulting in lower total speed.
Have a look at Qualcomm Fast Path For LEDE, a recent development that could help you.