Have never had this happen with restarting my phone.

Now if you mean Resetting, that much would be obvious. BTW, you get a code to jot down to remove the software token, you should write it down somewhere.