Quote Originally Posted by cjbeagle View Post
I think we're a little lost in the weeds - I think it's important to note that polls are generally structured something like this:

The removal of Kaiten from samurai was an improvement to the job's gameplay.
1. Strongly Disagree
2. Disagree
3. Neutral / Don't Know
4. Agree
5. Strongly Agree

An improvement would be to separate Neutral from Don't Know to prevent artificial emphasis on neutrality from subjects who simply aren't familiar with the topic, but regardless of that, the point is that polls generally don't afford room for nuanced responses - just pick from the multiple-choice options provided.

There's no room for commentary from whatever wealth of knowledge the player has, just "how much do you agree with this statement?" or a general negative-to-positive scale.
I agree—this is likely how the polls would be structured. I suppose the conversation has shifted more into in-depth feedback commentary that would likely exist outside of a poll. Though open-ended questions are possible, they are a bit harder to consolidate into data depending on sample sizes.

Questions that have a 1-to-5 rating scale can be qualified a bit more with questions on experience levels.

“Do you play SAM in FFXIV?”
1. Yes
2. No

And then further questions like “How often do you play SAM” on a scale of Very infrequently/Never to Very frequently/All the time; and “what types of content do you play SAM in? Check all that apply.” So the qualifications can exist with more specific questions; data can then be filtered based on answers to the above.