I think it's pretty clear that the up/down/left/right keys would only used to switch targets while, err, targeting? It doesn't stop you from switching between skills and/or navigating through a menu.
You would do both at the same time if they share the same input method. You think this is np?

You are always "targeting" something when in an encounter.