I finally have a solution. Setting the MTU to 1380 in the WireGuard interface solves the problem. Bloody hell was this difficult to troubleshoot. Thank you so much for your help, trendy, I really appreciate it. I learned a bunch of things about networking along the way, so this wasn't entirely pointless 
I'll leave the IPv6 as it is since it doesn't cause any issues.