I just turned off everything and this is what I get:
I'm still not sure why my upload speeds have always been so low using this test.
At least FAST.COM likes me again! 
Do it the old basic way, speedtest.net and ping 8.8.8.8 (I'm ~1.2ms away from 8.8.8.8) and see if the ping increases 
When "idle" I get a ping of around 7ms. When it's downloading it jumped to 50ms. When it's UPLOADING it stays at 7ms.
That's as much as I know...no idea how bad is 50ms, since the DSL report still says A
Waiting for more opinions from the forum 
A jump from 7ms to 50ms will wipe out gaming or voip. This can be especially bad with streaming video which cyclicly grabs a short buffer then nothing... Then grabs... Nothing. Your latency will bounce around +- 40ms and its equivalent to 2-3 packet drops in many games. I would run SQM since you have the CPU power
Yeah I had temporarily disabled it and noticed a difference right away when I tried playing CoD on my PS4. Once I re-enabled SQM it was smooth sailing once again. 
@Cylac I have some questions for you regarding openwrt and fibreop .. are you still using the two?
