Yeah I personally would give up stats for aesthetics since a bulk of the stats will be in materia and I'd be able to balance out by putting more of a certain type of materia to make up for it.
As Roaran said, if we can get more colors available with either duplicate stat spreads or more varied stat spreads (ie: have a Purple robe with the stats of the Green and a Blue robe with the stats of the Red, or have them be in-betweens), there should be something to make most people happy.