What would ruin my immersion is my character saying “wow look at that amazing ball gown” and your character saying “what ball gown?”.

Characters in the same world should see the same things.