I actually think high damage isn't a factor. The reason for this is because certain high-damage skills do NOT interrupt spells, such as a primal's limit break. Hellfire will never interrupt your spell, even if it does 90% of your health. Mistral Shriek, on the other hand, will always interrupt your cast, even if it does very little damage.