You can configure the LACP to also use the port in its hashing algorithm.
You have to choose mode 4 (802.3ad) and also set the xmit_hash_policy, something like the following:
BONDING_OPTS="mode=802.3ad miimon=100 lacp_rate=fast xmit_hash_policy=layer2+3"
For details search xmit_hash_policy in: https://www.kernel.org/doc/Documentation/networking/bonding.txt
xmit_hash_policy
Don't forget to check your switch configuration.
yes however not all switches will do the same thing back to you. so for Linux to send to the switch it can use the port, but then, receiving replies it may only be the IP or MAC. This makes the performance asymmetric. It just depends on the switch.
Yes, the switch has to be sane and cooperative. As always check with your own eyes that it is really working as expected. Assume nothing.