I think the crafting mats should drop from the mobs or include them in chests throughout the dungeon. Boss chests should drop gear or perhaps crafting materials that can only be found in that dungeon.