...by not playing the bard anymore.
Thank you SE for ruining one of my favourite jobs. Sure, I can turn it off and play like before but having a significant damage penalty is even less fun.
If I want to cast something I just switch to BLM for the same gameplay style but much more damage.