Have you completed all of the Bard job quests? The quest will only appear if you've completed them and talking to him with the Bard stone equipped.