Good point.

I suggest then to be able to press the skill button while casting to change who the skill executes on. So, while casting is happening, change target and press the skill again to have it execute on the new target. If you want to preemptively change targets, don't press the skill button after changing targets.

Alternatively, maybe just have this feature as a Character setting.