I will sometimes take defiance off for trash mobs in 4 man dungeons and in 8 man dungeons if I am the off tank. However for almost every boss I have it up, (except beginning of demon wall).