When should I start working about putting materia into my gear. I am level 32 right now and I have had no problems on anything yet. Seems like a nice boost, but then again why put in the effort just to replace the gear?

Should I do it now, or just wait until I have some end game gear.