Well actually no
Ff5 they used swords
Strago used staffs and wasnt physical oriented
Ff7 enemy skill only had a few physical skills and wasnt cloud exclusive
Quistis used a whip and again only a few skills did physical damage
Quina used a fork and again werent necessarily physical spells
Khimari used a spear
11 had swords and physical spells
Tactics used swords
Bravely Default they used daggers natively and lots of physical magic so it fits
Bravely Second uses cats and physical weaponry so again fits your bill
So overall its a mix not just physical swords