Its not removed from your gearset, itll be registered as missing, if you want it to be removed then just switch to the class that had the piece and re register the gearset with the piece missing.But yes theres no warning, if you didnt intend to give that piece just put it back in your inventory and itll be like before