Yes there is a time limit it is 30 rl days.
You have to have someone enter the house at least once every 30 days to keep the plot. Cannot do that if there is no house.