If you have recently partied with them, you should still be able to block them via the Contacts menu.