I switch targets often enough, whenever I get close to getting aggro (or after it already happened).
Then you have situations where you have to free your group mates out of a prison spell and the boss is in the way so the mouse isn't usable.

So many cases where proper targeting would be helpful.