Noise from speakers only in FFXIV

[Halcyon]

I have some small interference issue that creates a hiss from my speakers. If I turn them about to about half volume I can't even hear it so it doesn't bother me. But when I start FFXIV there is a sort of small buzz on top of that. Moving the jack from the back panel to the front panel seems to have made the buzz quiet enough that I can't hear it unless I lean way forward, but I'd rather solve it if I can in case it's a more complex issue. Trying to fix it also made me notice that my GPU gets noisier just from tabbing into FF, I tried other games and can't find anything else that does it. Just to be clear, it's not related to the actual in-game noise from FF, this sound happens even if the master volume is muted.

I found this information googling and it seems very possible to be related but I don't know how to test or solve it.

Due to the close proximity of the PCI-E power and data traces to the audio traces EMI can transfer between them. As the GPU sends/receives data this EMI can be heard as a buzz over the speakers.

I think I tried everything software related like disabling digital audio device, changing sound quality, turning off all extra options, changing from 5.1 to stereo. I moved the jack already of course but I can't move my GPU, it is right next to the PSU but it doesn't fit in the first slots. I also tried messing with the in-game graphics to see if that affected the sound like some other posts I googled but it didn't seem to.

I don't know what else to try, unless fixing the interference would also fix this? It's only FF so I don't see how but then again EMI seems to be really tricky.