Why not then make the suggestion that you can invite specific people from other servers instead of crying foul and trying to shut it down?

That way, your friendships aren't limited to just your server?