Why can't we group with players from other servers on the same Datacenter to do dungeons, raids and duty finder with them?

We can already do it randomly with Duty Finder, why not manually? I have friends from other servers. I would love to play with them whilst staying on my own server.