Honestly I am inclinded to think recruits have a time limit. If you don't recruit them fast enough I guess they might go away?