I believe there is a notification option at the bottom of the party finder, just click on it and it should stop the alerts.