since u tap "x" to select an action, what if when you hold "x" for over half a second or a second, it allows u to quickly switch selected targets without needing to cancle out, switch, reselect new target.

So...
When target is selected,
Hold x,
Cursor changes colour to signify you can select a new target,
Scroll through targets to find desired target,
Release x.

This alliveates the clunkyness