Oh my god, it's terribly annoying. This is the worst feature by far that I've experienced while playing. I am constantly changing my target settings from Enemy or All to Friendly or Party mid-battle.

MID-BATTLE!

It's killed me and my party multiple times. I am confidently and regrettably stating that this is the biggest problem I've experienced since I've started and I experience it constantly. Someone else may not think that is their biggest issue, but it certainly is mine. I'm with you.