Game freezing whenever a device is connected or disconnected (Steam PC)

[cerealfordinner]

So I've had this issue going on for a while now, I haven't been playing for too long so it's hard to say if it's always been there or I just didn't notice it until later, but whenever a device is connected or disconnected the game will lock up for probably 10-20 seconds before returning to normal. During this time the audio will continue to play, but the game is completely unresponsive. I play on controller so a device connecting or disconnecting isn't completely unusual.
This is different than the issues I've seen in the past where the Device Manager refreshing will causing the controller to stop working briefly.

What I've tried so far:
-Changing Steam's settings for Steam Input, but to be fair I get the same freezing behavior if I plug in a mouse or a virtual controller through something like Moonlight
-Disabling Microsoft Device Association Root Enumerator from the Windows Device Manager

Interestingly I don't have this issue when I play on Linux and no other Steam games seem to have this issue. Any help would be greatly appreciated, as these lock ups will seem to happen during the most inopportune times.