I, too, haven't had any success in obtaining a difference in damage with my testing on fire potency.

I do know, however, that attack magic potency does not affect PGL stances and for that matter neither does magic accuracy.

It's best to think of these stances as Enfire and Enstone with additional bonuses to attack power and defense respectively. Still purely physical, but also elemental.