Some jobs such as BRD or DNC use procs as part of their identity and some jobs don't. I don't think all jobs should use procs and RNG because then you have a choice over what you want. Proc gameplay is fun sometimes but a lot of people like a strict but lengthy rotation like PLD has right now (for the short time that remains) but with lots of different things making it up.

Your logic with raid buffs could even apply to self damage buffs, because it forces a job like GNB to fit in all its firepower into No Mercy instead of spreading it out and even if you find this fun (which I do), ping and skill speed and skill issues come into how much you fit into it.

But if I were to ask myself "should they get rid of all damage buffs", it just makes me ask what will replace it? With jobs having had so much stripped away already and game mechanics such as piercing and slashing vulnerability having been removed, a lack of damage buffs would start to make the gameplay very simple and lackluster.