I have a wireless controller and adapter for my PC and haven't had issues with FFXIV. (I'm not sure if yours is wireless or wired.)

In the past when I experienced something similar to what you're describing (in other games), it was usually because the batteries were weak.