I was under the impression in the main storyline that Ramuh had already been summoned, but he wasn't seen as a threat, which was why the Scions didn't deal with him at that moment.