There is a thread where we discussed this already at length.
The current conclusion is that it has to do with your gear not being properly level appropriate for the fairy scaling. At max level with max gear for that level it should be ok again.

Or in short: ilevel compared to character level is incredibly important for the scaling of the fairy.