I don't know what platforms you are on, but in my PC i have a dedicated sound card and have external speakers and my front audio jacks connected to it, and because windows and by extension the game client sees the sound card as a single device regardless of the input selected i can have my speakers as the default device but when i plug in my headset it takes over from the speakers while still being seen as the same device. If any of you are on PC just get a cheap sound card and do what i did, being able to freely switch is a god send!