As it stands, you are correct. Crafting and to even more extreme extent gathering, are too RNG to be heavily influenced by attributes. I notice practically no change after reallocating into the right stats for Botany, did 50 harvests as a test, and the results were not even noticeably better or easier to accomplish. I can also reallocate points for a specific craft, but it still can and has resulted in MORE failures.