I just did this the other night, it wasn't that bad.

The Ogre and the Ahriman go down really easily.

For the part after you activate the Grimoire, you're supposed to focus on the small guys until the Roegadyn tells you to go with Jenlyns and attack the book. After that's done mop up any remaining adds and then kill the caster.