When you first join different class groups the NPCs often take note you are an adventurer and some even straight out declarr that there is no point giving you the time as day as adventurers never stick around - thus giving the feeling it is common in Eorzea for adventurer types to jump around and try out different classes.

Thats enough for me to make it all make sense. As you are the WOL you just excel at everything you try your hand at and arr able to take it to a high level