I don't believe this is the issue, but in a realm reborn I suddenly had a super long load time whenever i teleported to different zones after like patch 2.2 and I solved it by removing the ffxiv folder in my documents -> my games and saved my screenshots elsewhere. It had to redownload all the patches but that just took me 15 minutes

I don't know if that information can help you in any way though