It should come as no surprise that it's difficult to you when you're used to the other system entirely. Just give it time. Controller is almost certainly only equal to keybinds at best.