Results of a reddit job satisfaction poll

[Iscah]

The thing is, those people criticizing the survey, what form of feedback do they accept if that one wasn't enough? Do they value these forums more as a form of feedback? By their standards these forums would be completely meaningless.

A poll conducted across the entire playerbase sent to randomly selected players via email (with required-or-incentivised responses so everyone selected will respond) would be a far better representation of what everyone thinks of the game, not just the small intense few that frequent the forums.

Yes, 2700 votes is enough to tell you what a considerable number of people think of the game, but does not tell you whether they are representative of the entire playerbase. Certainly not enough to claim it sufficiently random to have a 95% confidence level that this accurately represents the whole, because it's inherently biased sampling.

This isn't even about the results of the poll, it's about being honest with the maths. If they all left glowing reviews I would still object to it being called a random sample and talking about how many people would be required to guarantee the accuracy of a random sample, because it isn't random. It's an opt-in poll on a single website.