How about an afk timeout? Like if a player hasn't made an action in 30 seconds... 45 seconds... 60 seconds gone?