I think the same, it somehow kills immersion, but in the end it's all up to you.

I love lore and immersion, so whenever I fly an I have free time, I end up changing the camera or stopping anywhere to watch the map from other perspectives.
Also I like to level other jobs and do all world quests, so I ended up stepping everywhere!

Maybe we need more "immersive flying" maps like Azys Lla!