If you're intending to raid just for the challenge of it, then you can be starting as early as level 50 after you clear ARR, with the first extreme trials and the Coils of Bahamut, and there is an additional set of raids at every "expansion endgame" stage after that.