For those of you ditching and not getting the penalty, are you the first to ditch every time? I know if you ditch when the party isn't full you don't get the penalty. Though it mostly sound like this isn't the case.