Wasn't the entire point of the story to prevent the primal from being summoned? Besides, it was said that they are literally harmful to the environment, because they consume massive aether and are summoned during times of chaos. I think they're taking so long, because they don't want to betray the lore of the game.