Seeing as when you pull up the equip list for your off hand slot it shows your swords in it I'm sure one day (probably through the addition of Ninja and getting the dual wield trait) you'll be able to.

But still using a shield is much better DD if anything right now because of Phalanx damage.