Open Duty Finder (on PC, shortcut is U button). There should be a button below that says Leave.