You need to get to the captains quarters and clear the mobs there, which is pretty much after the ogre.

Oh and if you engage the last boss , you cant complete the quest on that run since the mobs go away on vacation.