Yes it's random. You're just unlucky because people solo que for those dungeons and you get plopped with them