I think the potency loss is relative to how high the potency is for their other actions. MNK's attack potency are low, and lose 40-50 potency if not in the right position; a number that after all their buffs are applied is larger.