I play on PS4 (originaly PS3 - PS4 is superior in so many ways) and I think the "handicaps" are as much about the player as the set-up

HotBar - limited to 16 can be a pain. But you can mitigate this. Its only a tap of R1 to change. And if you place key actions in the same place on your HB then if you're n the wrong one you won't cause any disasters if you R1'd out of synch. Example, as WHM, I have Cure1, 2 and 3, and Regen all in the same place on my HBs. The other skills differ (I only work on 2; one DPS, one Heals
Placement - this is clunky, I won't deny. Not only for Pet placement, but also DPS Limit Break. Its not a deal breaker, but it does mean you need to pick your moment to do the faff
Typing - You must get a keyboard if you want to communicate effectively with people you aren't voice connected to. I have a wireless keyboard, work perfect. I just start typing and the cursor goes straight to the chat box. Only thing that is a little sh1tty is changing the chatlog (ie from FC to LS etc).
Movement - I think is a little better. With the controller you can 180 and run, instead of back-stepping.
Skills/Spells - It becomes muscle memory anyway, so I think by end game you are good, unless your co-ordination is pants. Also sometimes the HB helps with rotations better. ie With my MNK I have my Rear and Flank on separate groupings, and my buffs, and my specials....kinda helps me not eff-up my stacks

I main WHM, but have my MNK at 50 too, and some other randoms - and levelling my PLD to 50 currently - so have experience on most job types. I experience no "handicap" - and actually, as you get used to the game you will adjust your HBs over time, and your camera angles and what not to your needs.