Why does Anima being female have any bearing? Tozol Huatotl is a man who summons Garuda, a female deity. Kozol Nomotl also is known to preside over the summoning of the Lady of the Vortex, and is also a male Ixal. The Sahagin, a predominantly male society ruled by a Queen, summon the Lord of the Whorl. Both Ixali and Sahagin societies are matriarchal but summon Primals of different sexes--the summoner we know of, in both cases, is male. I can't recall meeting any summoners of Ramuh directly, and Amalj'aa care little and less about their varied sexes to matter.

More tenuously, Tiamat, a 'feminine' dragon calls upon her slain lover, Bahamut, a 'masculine' dragon.

Like, I'm certainly not on board the Anima train, but I have no idea why her being female factors in to it at all. Had we seen Ilberd take the Primal unto himself, there might be a case--both Ysale and Thordan summoned Primals of their matching sex though we have no evidence to suggest this is necessary.

Ilberd does say
A god has no need of faith when summoned by so pure a purpose!
but it's difficult to say (based on the EN script alone) that he specifically means a masculine deity.