Yeah there's diminishing returns on the stun. Once you've done the third that add needs to be dead or he'll cast.

Or someone else needs to do something else to stop the cast. Like WHM using Fluid Aura for the knockback.