SE's suggestion of disabling the PS5 controller in the sound settings fixed the issue for me even with DX11 turned on. I'm missing out on the dualsense haptic feedback but I can actually hear the game and play with max graphics settings again.