We really shouldn't be penalized for leaving a group
Yes you should. Sorry that it sometimes sucks for a player stuck in a crappy group but on the whole it's for the better.