I would completely agree, i've come across some good players that i got on well with, would have loved to add them. Also use a cross-server party system and friend list within the duty finder matching groups, so you can play with them whenever. I think WoW did this and it is probably the best thing they ever did :P