Communication Breakdown

[Niwashi]

I mean I don't mind using a keyboard if I can keep using the controller

A common pattern is to use the keyboard just for chat and the controller for everything else. You do need to keep the keyboard handy enough to switch back and forth that way, but it works pretty well.