Yes, the specific suggestion to tell the other person they're an ass is incredibly rude. That aside, it's not possible to blacklist and move on--the inviter's name in the chat log is not a name link. It's plain text.
One should not have to send a tell just to be able to blacklist somebody. We should just be able to blacklist anyone we want to blacklist for any reason without having to interact with them first.