OK it seems you have to complete the quest of one the NPC near him. You have to have a crafting class 20+. Once i completed that quest I was able to remove materia.