No. The system has a metric for taking away houses that people have. There is no good reason to extend it from the objective(they havent used it in x days) to the subjective(they dont use it well enough). Should my neighbor lose his house for putting up 6 of those namazu effigies that make the horrible grinding noise? Should anyone who ever put up a Paissa housing wall lose their house for bad taste? My yard looks nice and i craft there all the time(i visit my house daily), but my inside isnt finished yet so do i lose my house next?

Do yourself a favor. Dont go around looking at the seemingly empty houses. Nothing good comes of it. Tour the decorated ones for ideas you can use in your own house/apartment instead. Oh, and get an apartment. They dont get demo'd, and you can actually do a LOT more then you might think with one. Its small, but ive seen great work done.