I don't play bard but it honestly seems like a simple case of use it or don't. No one is forcing anyone to play WM and lose the ability to move and auto attack. It's an option to be considered when you know the coast is clear.