If you have the time to invest on crafting then feel free to, you can always craft while waiting for friends or a party for your white mage and people mostly get crafting as a past time or for more money. Crafting doesnt affect the exp bonus of your combat class and the other way around but your highest combat class can affect another that is lower however.