Hello,
it seems like it was an overheating problem, for no apparent reason my GPU fans weren't going over 29% power when set to "auto". I put it on 100% manually and as of right now it seems like the problem is solved.
Thank you for the support.