Targeting options say "Nearest to Farthest" and "Farthest to Nearest".

In reality, those actually behave as "Left to Right" and "Right to Left".

All I can really suggest are workarounds, such as using a "/targetenemy" or "/targetpc" macro, both of which target the nearest possible target within view.
On the bright side, the filters for a controller are much better than the basic filters, which are nearly useless.