Quote Originally Posted by Wiccan026 View Post
People from your own world are what causes the fate bar to fill.

Those who wander only contribute to your restoration progress for whatever they do during the FATE (as in if its a gold silver bronze or fail). That is the only time they have an impact on your world.
It said somewhere in the help text that whatever items you hand in are contributed to the world you are currently located on, not your home world.