It seems that full-screen mode does this. I usually play on Bordered Fullscreen now to avoid it.