He still needs to travel to the other shards to set them up if that's the case, and they don't seem to do that lightly. For whatever reason, they need (or at least greatly prefer) a mortal host, and they can't take the body with them so they seem to stay put on a single shard for as long as they're using it.
