That's just part of the danger, my friend.
The world around you doesn't stop existing just because a FATE has spawned.