For a sample size of 500 mobs, and assuming the drop rate of pugil scales is somewhere in the neighborhood of 20% (Wiki lists 16% for Sicklemoon Jagils in the same zone, though with a pitiful sample size; not really relevant, just need to know roughly where on the continuum the drop rate is likely to be), the 95% margin of error for that test is 3.5%.

That means that if the drop rate of the two runs differed by less than 3.5% then the test proves, literally, nothing. It is not statistically significant. If the drop rates differed by more than 3.5% but less than 7% there's still a chance that the two populations have identical 'real' rates, and the results are less than trustworthy. If the drop rates differed by more than 7% I'll be extremely surprised.

That said...

Quote Originally Posted by MarkovChain
Quote Originally Posted by Camate
2. TH9 vs. TH10
Since it would take a ridiculous amount of time to test this by manually increasing the Treasure Hunter effect to 9 or 10 via attacks and what not
Which basically means you guys are admitting that putting more than TH3 on a mob is useless, which basically means TH+ gear is useless. Give me a reason to bring a thf. (at least you admit TH9+ is useless, so why even implement it, make it cap at TH10).
Camate's statement does not have anything to do with your interpreted meaning. He's saying that if you want to sample 500 kills with TH 9 and TH 10 the old fashioned way, you have to get enough procs to reach those two tiers under normal fighting conditions. That means you'll have excess samples of TH 6/7/8, and maybe 11/12, and have to fight in such a way that the battles will last long enough to get said procs.

Since they were only interested in testing TH9 vs TH10, that's a huge amount of wasted time and effort. Of course if the players want to test those values they have to expend that effort, but the devs can skip past all that tediousness.

None of which has anything whatsoever to do with the usefulness or uselessness of any TH tier.