More immersive for one person can be more jarring for another. Job gear is very rarely in a style that suits what my character would wear, and I would find it more jarring to see her switched into it than wearing her current equipment.
It wouldn't even fix the problem of it being not what you were wearing at the time.