Potency is just a part of the formula for damage and healing. At low levels, you're gonna be hitting/healing way less than the potency, while at higher levels, you're gonna hit/heal more than the potency.
It really is just there so that you can tell how effective different skills and spells are compared to each other.