Maybe not 24h, but the same 30 min penalty as if they left would be good, except if they are on a cutscene or something, then it would be harsh.