Nevermind, I'm an idiot, lol...
This is the new "Enable Visual Alerts" feature...