The worst speed bump for the crafting/gathering I hit in the game was that initial 50-52 point for the gatherers. I didn't really have to spend any actual gil on crafting gear since you can get good stuff with Grand Company seals (I wore that stuff for so long), Beast Tribe currency, scrips, and through the job quests. Certain things I think could be initially explained better, but taking some time to sit down and read through all the tool tips should solve that and I don't think I've ever used specialist actions on my level 70s (although to be fair, I've been leveling crafters more so I can make housing stuff and non HQ glamour).

It definitely isn't for everyone, especially if you want to gather everything yourself as well, but generally there's always a way to keep costs down if you know all the resources open to you.