There is already a Vote Abandon cooldown for each player, I think it's 10 or 15mins until someone can try to initiate it again. Restricting it outright though could cause more harm than good, after all if you couldn't get an Abandon approved, someone might starting kicking X or Y player to create an opening in not having Full Party thus allowing whoever to leave for free afterwards without any penalty.