Realistically, the numbers here are still small. It took time for the last one to accumulate a larger amount of scores, and ideally, you want at least 100 submissions of random players to get values within a decent margin of error for a game of this scale. 100 doesn't sound like many, but that supposedly places your survey within a 10% margin of error for a population in the millions. But let's talk about these results so far and what their responses might indicate on a larger scale.
If you return to the survey and select "see previous responses" you'll be able to view the total results in a graph for that question. Summoners looks like this:
This indicates a few things for me. The first is that there is a large sum of 0s, and since we can look at who is responding, we can see why. The 0s generate largely from former summoner players who found the rework was a major downgrade, and the feedback can be summarized in that the job is way too simple and needs more added to it, and that it plays too much like a physical ranged DPS. But even if we look passed the 0s, the range is still all over the place, gravitating toward 2 and 8, but is still highly inconsistent, and that's a problem. In a perfect world, you'd want a score like what black mage has:
This is the perfect scenario, where players are overwhelmingly satisfied with the state of the job, but at the same time, it's also quite difficult to achieve this across so many jobs in a game with such a large audience. Realistically, you want every job to have the majority of its scores gravitate toward somewhere around at least the 7-8 area. Red Mage showcases this very well:
Once things start gravitating toward 5s and 6s, it's time to start looking into what's not working for people, and where improvement could be made, and the lower that gets, the more critical things are. But I would also say that having a really inconsistent set of scores is also very concerning and should be investigated. That is a time where it's worth looking into what changes need to be made, or if something should even be rebuilt, in an effort to unify players in favor of that job. Look at what is appreciated by those that rate it highly, what's criticized by those who rate it low, and look at solutions that address the concerns of the low scorers without disrupting the liked aspects from the high scorers.





Reply With Quote




