I lost my physical token in a move and was obviously unable to log in without it until I called SE customer service. I didn't save the serial number or anything, but they were able to confirm my identity with other info (Date of birth, billing card number, etc.) and removed the token from my account without any issue. All in all took about 15 minutes.