Yeah, ok youre right on that one.
I forgot that when the story had you leave and come back with Hien, you already had flying. Not sure if you can leave the House of the Fierce and explore the northern part of the map at that point, but the currents are all on the other side of the wall.
So you can do most of the zones flying in one visit, but not all of them.