Starting multiple relic quest

I have a dilemma.

I started my relic weapon quest for my Scholar and decided during in progress to work on the Summoner's relic quest.

Apparently, I seem like I can not.

Has anyone found a solution to changing the relic quest midway?

Try abandon your current Relic quest and talk to the NPC again with your Summoner.

I have done that. Results: Red "!" Icon. Apparently, he will only let me have the Scholar quest or the quest I initially started on.

I see, that's too bad...