Dump your controller. Im sorry to say, but BLM and controller just simply dont mix. Being able to rotate your character very quickly and precisely is very important as BLM for the LoS reasons you complained about. If you absolutely cant use a keyboard, see if you can set up your controller to "lock on" to targets.