Ya its annoying. I usually prefer to play without my headset on but if I hop into voice chat I want to switch to my headset so people in voice chat dont have to hear feedback from my speakers. Sadly that requires me to restart the client so I usually just turn my speakers off or way low when i get into voice chat.