Switching jobs?

[Ponno]

I haven't ever tried, but can you even take the soul stone OUT of your armory?

Yes, you can un-equip it and become say a level 60 conjurer or whatever.