I got finally got into the game, I bought a new controller which was my last resort solution and it actually works. Apparently there is some issue with older controllers, mine is from 2010 and the one I borrowed from my friend is quite old too. The strangest thing is that the old controller works fine in every other game.

Oh well, at least I will get some use for my 2-month subscription now.

Thanks for all the advice Squa11_Leonhart, I might do another go at trying to get the old controller to work (it's more responsive than the newer one so I'll probably keep using it for other games).