I didn't know it was like that (not there yet) and completely agree with you. If I'm understanding you correctly wouldn't it be ok/better to limit it based on individual? Make that person the party leader, enter, take care of business and if someone else needs it later. Well they are party leader and use up their turn...that make sense?

That's how I remember it being done in a past game I played and I like that idea better than using the whole well you grouped once already so you're done for the week.