Only the first input counts.
If one (the first) leader says "Yes" it will replenish. If he says "cancel" it won't.

iirc you can activate the replenishment manually in the DF again if it was canceled.