The only thing not displaying numbers would do is prevent gear optimization.

Skills still have potency values, which is all one needs to calculate optimal rotations. That's why parsers have a "potency only" option so you can calculate PPS, not DPS.

So unless you mean you want to remove potency values from skill descriptions (which, would be stupid) then it wouldn't change anything