The Same person can not start a Vote Abandon again after the first is denied, so if you see one pop, fail, then a second, its another person entirely.

I'm not sure on the timer, but I believe its longer than 5mins.