Potencies are best used for telling the difference in damage between skills.
You'll know that a 200 potency skill is gong to be roughly equal to twice as much damage than a 100 potency skill.