This is a game. If you aren't having fun, you are doing it wrong.
If you aren't running savage and the latest EX, then you can still jump on your BRD for some fun time and just skip WM. You can still come close on dps. That 30% boost is really maybe around 10% (was a dps loss when it was 20% boost). If you actually put in some effort in your rotation, you will exceed the dps of 90% of the WM bards you come across. If you actually play Foes, your party will be happy, and you will still get comms.

See how you do in SSS without WM. That will give you some idea whether you manage to still do reasonable dps.

If you want Savage and EX, kinda stuck with WM unless you go with an understanding premade.