The workflow for this should be:

Users blacklist someone -> Server keeps track of people who blacklist and who is blacklisted -> Server bans person after X number of blacklisters reached -> Server automatically removes name from blacklists of people who blacklisted said person.