I have gotten used to needing to make sure I update my portrait every time I swap a piece of gear, but sometimes this doesn't even work and I'm back at Default. Then I have to remove a piece of gear, update portrait. Then put the piece back on, and update portrait to fix it.
I wonder why we can't just freeze a portrait as whatever we were wearing at the time, or have it auto-update if it really needs to be current.