You're not always grouped with people from different world servers in the duty finder, but the reason they have that is because if they limited the pool to just your particular world server, then wait times for tanks and healers would be closer to how wait times are for damage dealers currently. And the wait times for damage dealers would multiply many-fold.