(and this is a big assumption)
The short answer is that 40 of your best secondary stat and 120 of your second best isnt better than 340 of your worst secondary stat

Without situations where only 2 substats add meaningful impact (Say ninja's had a stance with high uptime that makes everything DHit, but they cant crit), 3 extra materia slots will almost always beat better stat allocation.