That's just the way the game is handed, apparently. Someone wrote a neat little program that keeps the game set to high priority and also organizes disorganized threads in multi core CPUs for (supposedly) better performance.

http://www.ffxivcore.com/topic/14676...fficial-topic/