Best to see it like this: we only see the what could be called the Commons part of the cities. Places like guild halls, markets and things people would use/work at every day. There are residential portions, but we don't visit them because we technically aren't citizens/residents of those cities.

Never mind the fact we've pulled their butts out of HOW MANY FIRES!?