I am not poor, not by any means but people keep confusing this with personal wealth.

This is not about personal wealth at all. It has nothing to do with how much money you have on your character.