Or, if you cast from Passive mode, it should automatically put you back to Passive mode after you cast, and not start the countdown until then. I agree, losing 5 seconds switching modes makes this skill less effective than I'm guessing it was intended to be.