Since some time ago it has been possible to choose how many quests are shown in that thing. Can't recall now where but I'd look at character settings and UI portion. Also not sure what was the minimum amount, I seem to recall 0 but im not sure. That way the duty list still shows fates and dungeon info when applicable. A bit clunky solution but solution nonetheless.