Technically, it's possible if you're on a server with plenty of JP players, but personally, I know what it feels like to queue in a single language (English, of course), only to end up in a party that ends up needing some level of communication but where I'm literally the only person present who can speak English even though the others had to have queued in it too. It creates a needless language barrier for the purpose of gaming the system, so IMO you wouldn't be doing those JP players or yourself any favors as they'd expect you to be able to understand and communicate in Japanese if need be.