Try recruiting more members that are around your level, and on at the same times as you. Or put one of your other higher-ups in charge of recruiting, although that would defeat the "same times as you" portion.