2 easy ideas to end all the grief:
1st: get rid of the leaving a duty penalty. the annoyance of backfilling a slot was far less then the griefing being done now. Adding time to penalties just makes them afk, troll ect

2nd: add an option to join a duty in progress only.

result of these two fixes: Someone wants out, let em leave and someone will jump right in to finish the fight