Well it's not really S.E.'s fault that you can't appreciate architecture, no offense. Not everything has to be over-the-top. And in any case, Limsa Lominsa isn't exactly subtle either. I mean, Limsa Lominsa is far from being "just caves". Next time you're there, maybe look around and appreciate what's around you.
When someone has to clarify a statement with no offense it's usually a good indicator of intended offense but anyway. Half of the nice looking places in limsa you'd can't actually access; the lighthouse, those buildings you see in the distance with the huge windows.

Aside from that the buildings are almost identical once you're inside them with exception of one that while identical it has a fish tank. Other than that everything is just cold and grey and the main feature of a city built on top of the sea would be the sea I'd imagine but we currently have a 2D sheet of carpet instead of a sea.

There's precisely 2 neat things about Limsa; the pirate ship and the walkways. They're redesigning the game to be a next gen MMO using a brand new engine we should expect more than what we already have and you shouldn't have to get defensive just because not everyone agrees Limsa is a shining bastion of design.