This is single handedly the biggest issue with FATEs. If they took as long as they were 'intended' to, it probably wouldn't be the most efficient way to level, and the rest of the content would actually get used. The fact that, in some cases, a NPC will spawn and die before you can get an instant cast skill off on them suggests that there is something very wrong.