It's kind of dumb that it's automatically assumed that if someone is removed from a cross-world PF that they were problematic and need to be blocked from joining the same PF again.

Leave it up to the party leader to decide whether or not they can come back by simply giving them an additional remove from party option specifically for problematic players.

It's not uncommon for temporary internet issues to force people out of parties and accidents can happen as well.