At the moment it is possible for a player to get penalized because he was in party with people who Withdrew from duty. Even if the player in question always confirmed.