Hmm, other possibilities could be cooling related on your PC's end..you can try a free HW monitor, I use this one to monitor my temps, unlike most others its not loaded with bloatware or a trojan, the free ver will do everything you need and wont artificially inflate your values to try and get you to buy their 'fix' tools.
http://www.cpuid.com/softwares/hwmonitor.html

Basically anything over 50c for temps is usually bad, if your 1060 is overly hot you can a software program to manually adjust fan speeds and set up a custom fan curve, they are designed for overclocking purposes, so just ignore anything that's not fan speed related. My 1070 is EVGA, so I use the precisionX16, you can get it from the EVGA website, use the x16 one, the other one only works right with win10, but the auto update feature is dumb and will keep trying to update to the win 10 ver, so if you go with that one be sure yo uncheck auto updates.

Alternately you could be running the 32-bit client unknowingly, under the launcher settings change it to dx11 client, that could be a potential issue, if he dx11 fails to start (DX error) you will need to fix your DLL DX DLL files this tool will help you with that:
http://www.dependencywalker.com/

In the end driver updates on EVERYTHING is helpful, sound, network, video, chipset(MB) bios, if you feel comfortable with that, it seems you are having really bad hangups and if it isn't latency... I know resmon is kinda slow to update if you are using wireless that could be the issue there...

If you are concerned about your individual conn speed I would test it here: http://www.speedtest.net/
Pick a server 100 miles or few ideally, try multiple ones, if thers one held by your ISP it will generally be better or ones in larger cities.

If you have not already, turning your graphics settings to low, so see if maybe its a drastic FPS drop or something.

Last thing I can think of, given im quite tird now and trying to suggest many things to try, sending in a ticket to the online support, you will need to provide a copy of the System Info readout the game has, with everythign you normally have open and running with the game, run it (its found under the config option on the launcher or from the game folder: SquareEnix\FINAL FANTASY XIV - A Realm Reborn\boot directory, ffxivsysinfo64.exe for the 64-bit read out and the regular ffxivsysinfo.exe for 32-bit.

I'm sorry I wasn't able to fix this, but if all else fails the online support will usually fix your issue.