You still thinking of it like "Gladiator" is anything other then "Sword User" its not. In Japanese it literally means "Sword User"

You can take your Thaumaturge, load it out with all the skills you want, then equip a sword, Yes you turn into a Gladiator (Sword User) but you can still use all the skills from thaum (minues a few weapon specifics)