Well someone like Ranjit wants to have a word with you about nothing stopping us. Also its not about exerting our will on other shards, its about visiting them, maybe we are even going to be the new guardian of these worlds and just make sure that the problems the Ascians have left behind are gone. Its not like we go around and force people to do what we want them to do.

The problems with the memories gone is: We as a player still remember. Its not like we also lose them. This will just end up being frustrating imo. Going from a blank cardboard box to a character with his own feelings and memories to a cardboard box again just feels bad to me.