So you're suggesting you should receive no penalty/punishment for your personal issue, just the party? Don't forget - they still have to wait around for a new member, which can be a while for a tank/healer and even end in a disband.