I think the issue is less that the server population is low and more that the most active portion of the community burns through new content immediately and then never touches it again.

If 95% of Server A has their Delve drops and 95% of Server B has their Delve drops, you're still not going to find anyone willing to Delve with you once the two servers merge.