How to prioritize IP?

I cant find anywhere how to actually give priority to my IP. I have SQM with piece of cake installed and i throttle my streams to 85% which does seem to help bufferbloat. But living in the woods, my connection is so slow if anyone gets on the network my games still lag badly. I need it so when I enable SQM it essentially throttles everyone down to like 200kbits to share and my IP gets the other 1Mbit or so (its very bad internet, but when I have it all to myself i get stable ping believe it or not). How do I give my IP the lions share here?