When you queue as a party, any party member declining counts as entire party doing so. Your friend disconnecting and failing to accept the duty is taken the same as if you cancelled it yourself.