Teleporting frequently will cause strain on your character. It is logical that your character need time to recharge anima after many use.

There is your immersion.


Switch to Gil..? Might as well shout for a person to teleport you for gil instead if you can't manage your anima properly.