Once you complete a housing zones mini-quest you can Teleport to it using the Main Cities giant Aetheryte.

IE. New Gridania's giant aetheryte will give you an option to teleport to "Residential District Aethernet" which sends you to The Lavender Beds.