Why should it impact the lore? Didn't they remove abilities from a lot of jobs already without impacting much of the lore and simply by changing a couple job quests to use an action instead of another?
Why should it be different if they change how bard works?