Maybe a crazy idea but instead of continue the rp they thought you were a mute by replying with emotes only, just ask not to be involved directly through party chat?