I'd actually bother with crafting to begin with if this was a thing. I'm not going to run around with a huge amount of mats in my inventory and constantly go back to my retainers just to get an item I suddenly need.

Let me access all the mats I have at anytime.