I'm not trying to say that gamepad can't work just fine as the game was designed with it in mind, but it's still slower to switch targets than a mouse.
With locked hotbars (who on earth wouldn't switch this on) you can cycle through targets with the left and right bumpers. Can't imagine anything quicker than a single button press?