Glad I'm no the only one that finds it annoying. There's some UX issues in game and that's one of em.