I think if you removed a primal's believers, it might have a lack of power though. Certainly a number of the extreme fights imply at times that the strength comes from increased shows of devotion, not more crystals. That said I think they would still exist.

As far as Odin goes, who's to say the original Odin had those goals before picking up the sword.