You are not alone! I wanted them to be colored for their element as well. When that didn't work, I wanted them to be colored for the region they were found in. Well that didn't work either. If there is some rhyme or reason behind why certain stones are certain colors, it's lost on me, and I want to know why!