Changing servers (unless to a new data centre) wont help you with DF problems, since when you que in DF you are matched with people across any server on that data center.

My advice? Take it at a comfortable pace, if someone gets upset, tough.
Youll find good people and bad people anywhere you go.