I suppose it can be done but you really would be holding the team back i would think.
The keeping of certain cross class skills is not worth it at all over playing as the job instead.