If it's a single use material, and you have little or no call to make the item, don't hoard the material. It's actually rather simple.
Outside of Culinarian, I'm able to hold all the necessary HW mats on one retainer, with some room for multiple stacks (things like Adamantite Ore and Aurum Regis Sand that get used a lot) and the occasional ARR material as well.