It could be due to population. If there are people there, even if they aren't drawn, the system is still communicating with the server to get those locations causing a slow down in the PS4. Will have to check it out, but I remember quite a bit of FPS drops when ever I go through a populated area (such as Limsa).