You can remove it if you go to Mog Station, then your Square Enix Account Management, go to One-Time Password and there should be an Emergency Removal Password there. You can use that to remove your one time password device.