Quote Originally Posted by Renathras View Post
I'd say there's a bit of a selection bias problem that's two parts here:

1) People aren't answering for all the Jobs - that is, looking at the respondent numbers, we know that it's not 100% of the people going through and responding to all of them. People are picking and choosing which to respond to, meaning people are probably mostly responding to the ones they either like or hate, not ones they're neutral towards or don't play much. [EDIT: A way to have fixed this would have been to have a single survey for all Jobs where people could rate them all overall, as at least then we'd have a lot more 4-6 ratings where people are "neutral" on Jobs they don't like/play, leading to the numbers being far more normalized than they are. This would have reduced the election bias of people mainly sticking to Jobs they either love or hate.]

2) This has been posted here, in FFXIV and FFXIVDiscussion on Reddit - so the sample is already going to be leaning a bit because of those communities not QUITE representing the whole playerbase. The general playerbase doesn't frequent these discussion boards, so the field is a bit based. Still a useful proxy to try and see what the playerbase thinks, but with the caveat it will typically have a leaning that isn't necessarily as representative as the whole as it should be.

So those are just good things to keep in mind while looking through the data.
I think it's better that people aren't forced to answer for jobs they don't play nor care about - I haven't touched the machinist quiz for example because I hardly touch it and thus cannot give any sensible data. This is naturally going to lead to people invested (ie those who play said job) answering the relevant questionnaire. Whether or not this kind of selection is good is debatable, but I reckon it boils down to whether or not you believe every job has to be for everyone.