Each class/job will have its own pool of stat points, and will gain them separately as they rank up. your rank 50 job may have 300 points available, but if you switch to a r10 job, you will only have 50 points available, stuff like that. so in all... your lower rank jobs are going to be as weak as if your physical level was the same as the rank.