I think I solved my issue.
For anyone who may be experiencing a similar issue it seems to be a problem with the current drivers for nvidia cards. I updated from 335.23 to the BETA 337.50 and the issue seems to be gone.
Hope my post helps someone.