Progression grinds attached to Chocobo Racing, TT and Sightseeing log were the reasons I didn't even consider doing it because I'd rather spend that time on leveling, raiding or gearing up. OP is totally right.
What was supposed to be a distraction ended up being progression for no reason other than "it's MMOey that way".