You can leave at rank 1 if you wish, but a few of the best leves are in Uldah, so you'll be back around 33 all the way to 50.