Except not everyone sees this game as a competitive race.
Some jerk yelling at you to "go faster" when you just want to take a evening stroll and watch the sunset, kind of sucks.
They do "restrict" people from shouting "Fire!" for no reason in a crowded cinema though.
