All you need is to practice your movements. It is to just remove the effect right before using a tp move if you are concerned with your aoe aggroing multiple mobs.

Steadfast is an awesome skill, especially since the latest patch.