I had no issues. Reducing volume of the specific environmental volume that's causing it seems the simplest solution. You can make a macro to do this which does /ambientsounds, so that you can disable the ambient volume. It's just one fight out of the whole game.