Alright so I reduced my graphic quality to Standard (desktop) a day ago and the dx11 error frequency seems to have gone down. It still happens just not as frequent. However that is a non solution since I've tested my PC's specs with the Shb benchmark and got a score of above 12k which means I should be able to play the game at least in High (Desktop) since I was getting 60fps in that setting even in heavily crowded areas (Behemoth was having a Carnaval celebration earlier this week and Gridania was super crowded and the game still run smoothly).

Here is the latest error I got 20 minutes ago if any dev still bothers to check this thread at all (doesn't seem like it since the last reply was on page 1)