Turn off all battle effects. I have gotten in several parties where someone has this issue and this made a big difference. Also, are you casting when this happens? Make sure you cancel your spell when you move out of aoe as well. There is a known bug with casting through an aoe where of you move while still performing the animation you will still get hit.