You can't teleport someone else to your estate. It's a 1-person teleport.
Problem solved.