I've heard it said that you can experience every class (eventually) on a single character.

Is there truth to this, or do stat allocations (don't know how those work) mean its pointless to try a magic class after being a physical class, or visa versa?