This is the kind of stuff you have to accept when using the Duty Finder. If it bugs you that much, form your groups up the old fashioned way.