Removing the notifications won't help.

When you get one in progress, the window pops intantly. When not, it takes a few seconds to fill ranks.