That's the whole challenge of the fight, not getting hit by ogre AoE's and avoiding the ghosts. Once you know what you're doing there is zero luck involved. If you took out the ghosts the fight would be a total joke.