Gladiator and Paladin don't rely much on cross-class skills as much as other classes/jobs do so you will be fine if you decide not to work on leveling side classes anytime soon. I'd say wait until 30 or work on them whenever you need a break from tanking.