Left/right = enemies (only), up/down = party members (only).

How is it possible to accidentally target party members when the set-up is so simple?

Unless you are talking about the system being glitchy and targetting enemies and party members at the same time in the Enemy filter mode while pressing left/right.