Make sure all your party members have access to the duty. Maybe one of them hasn't unlocked the fight. Maybe one of them was on a class below level 50. Maybe one of them had a chocobo out.
If none of the above are the reason, then I'm sorry for wasting your time.