I don't understand how you can lose your house.

I'm go in every day, multiple times a day. I usually go to check on my retainers rather than a city. No crowded Retainer Bell with people standing on top of it making it hard to use.

I usually also like to craft inside my house, again it's quieter. MB is right outside by my residence too.

It sucks if you lost it to a bug though.