You have to make sure the NPCs kill him, otherwise the fireball stays in the sky :/.