The difference being I can't think of anything else in this game that's zero-sum. Everything except housing is theoretically unlimited, so yes Oliver is denying other players housing.
I haven't seen anyone ridicule Oliver. Certainly a lot of rightfully deserved castigation though. Regardless of whether or not rules were actually broken, Oliver's actions are a tragedy of the commons. Perhaps it's my upbringing, but I've never been encouraged to take more than I need to the detriment of others, even if it was "allowed."