Well, not everything would be available if the camp towns were took over, look at the guilds they are supposed to have. These can be taken away if they are not under the city's control.

Which begs the question, how would one take the cities back? Why would garlean forces let random adventurers into the town if adventurer are going to storm them? Bit of a security breach, there.