You weren't using the house despite playing the game.
Someone who wants the house can now use it. You no longer need to worry about it, it's not big loss for yourself, as someone who didn't use it.

I fail to see the issue.