I would actually vote yes.
It would be nice to require a person to do a "boss battle" to progress with their job.

Similar to FF11's SMN.
If you had every summon, people could trust you when you said you knew how to kite things.