As others have said, best solution is to Black list them, then they can't join your PF at all, it'd be greyed out to them.