and don't forget that Hermes' fragments are all flitting around in their reflections, including, presumably, the first. Assuming of course he didn't get hit by the wave of light and turned into a sin eater obviously.
Nah, they're going to have the memories from those few days scorched into them, they won't be as world shatteringly BAD for their ability to cope with reality but they're gonna have an impact.