The small house is the size of your inn room.

The medium house has I think 3 areas inside that you can walk in and out.

The largest house is indeed a sort of 'mansion' with several rooms and lots of space.

There is a BIG difference between each tier of housing.