Unjustified FPS drop

Hello, I am currently experiencing an fps drop that by all means should not be happening. I am currently running a rig with these specs: Windows 8.1 Pro, I7-3770k, GTX 770, 16 Gigabytes of RAM, 128 GB SSD which the game is installed on, 4TB 7200 RPM HDD, 1.5 TB 7200 RPM HDD. When I play the game I watch a utility made by GeForce that monitors my Graphics Card utilization and when I look into the distance in FFXIV my frames drop to around 35-40 while my GPU utilization is only at 40% any ideas on how to fix this other than lowering my settings? I know my rig should be able to easily run this game on Maximum but for some reason the game is having a problem fully utilizing my card.

EDIT: I am using the GeForce Experience's LED Visualizer's built in performance viewer on a separate monitor and windows 8 task manager to see my computers statistics in real time and they were never maxed out or even came close. I was wondering if it is an issue with the game or drivers.

I have the same problem, except only in certain areas. So far it is Quarrymill, and Camp Overlook that are unplayable because of the FPS drop