Maybe Primals are a higher tier of summon than what's possible for one summoner to control, hence a group being required to use them. You can see in storyline cutscenes how many Ama'jaa it took to summon Ifrit. Expecting your character to have equal power to 4 or 5 beastman summoners using a crapload of crystals to aid them is egotistic and silly.