Final Fantasy XIV freezes everything else

I have an issue which seems to be occurring since the latest patch.

Whenever I'm playing the game, after a while all my other windows seem to freeze. I can't click on anything in my second monitor. I then try to alt tab out of the game and also everything in both my monitors are frozen. I only can go back to the game when I click on the game window. Then the game works but everything else is still frozen including my desktop.

Even after exiting the game everything's still frozen. All I can do is ctrl+al+delete -> log out and log back in which closes everything.

So basically I can't access anything else when the game is running(it's visible but I can't click on anything) and I want to be able to use my browser in my second monitor while playing the game but as it is frozen I can't.

I've tried reinstalling and running in borderless windowed(this also creates a significant FPS drop for some reason) which both didn't work, still the same issue. My drivers are up to date and I can't seem to figure out what else could be causing the problem.