Its supposed to be a trade off. That's the point. You either send your airship out for a prolonged journey to collect goods for you or you keep it so you have the convenience of using it to access the Diadem.

Just keep one airship at port. You can still have 3 airships out collecting loot for you.