Potency is a linear factor used in the damage calculation.

Yes attack damage plays a relevant role.