Generally you will want to go INT all the way. There are some very specific fights at the very very endgame that you might appreciate some more VIT but it's not necessary if you gear up properly.