Connection issues are just one of those things you aren't going to get much sympathy for. When you have someone running a solid connection with 150 ms ping then they aren't going to want to deal with a party member stutter-stepping hither and yon with their teleport latency. Understand that you're at a performance deficit, and accept the reason for it and that some people are going to be caustic and judgmental asshats because performance issues effect the group, and sometimes groups don't want to deal with problems beyond their control.

That being said have you tried any of the US servers? I know some of them recently relocated to California which might help your latency, though honestly if you're in rural AUS then you could just have to deal with what you got.