a) you're expecting more than this hardware can deliver (around one third of your expectations are realistic).
b) this is not an issue for ipq40xx, it physically only has a single CPU port to the switch anyways (even if it were capable of routing at 1 GBit/s wire speed in the first place).