as someone who just got a medium house(FC) and is planning on moving it when shirogane hits, the reason we aimed for a medium was because smalls themselves are CRAMPED for more than one person. With 15 people in a room, smalls feel tiny.