Your "rights" will end when they start to deny other people's rights. That does not need ad hoc rules to deny the one thing you were doing. Legit things can be, and sometime are, abused. Legit use is a thing, abusing is another.

It is called "living in a community", you have basic rules that give you some freedom, and when you extend your freedom so far to reach the point you are limiting freedom of others, you're doing something wrong.

If you want your freedom in a game to be unlimited, solo games are your best place.