I'm having this issue too. It seemed to me like it didn't happen until I watched a cutscene (one of the 2.1 Hildebrand ones to be specific, just after he returned to Ul'dah).

I play in fullscreen windowed as well, but I have two monitors so changing to fullscreen or not switching windows is not an option for me.