Well, if I'm tanking, I go where I want and usually that means everyone follows me. If I'm not tanking, then I carefully maneuver to avoid confrontations while still exploring as much of the area as I can, while ignoring the group unless they need my help.

If I can't find a silver chest within a reasonable amount of time before they activate the gate (and they want to go through the gate), then I give up my endeavor. Basically, this is what you should be doing. Every man for himself. No complaints. If you have different play styles then adhere to your limits to play individually until the time comes where progression means playing as a team.