I don't know how feasible this is as I'm not a dev/coder, but allowing the vote-kick feature to work until the objectives are complete, then disable it once the free-for-all/gathering portion starts. If possible, I think this is the best way to manage the issue. This way, you can still kick people who refuse to help, but won't be kicked for gathering, etc. afterwards.