After updating the enumerator driver it seems like my controller isn't phasing out anymore, at least so far. I've tried a trial, a raid and regular running around and it seems to be working. I suppose you can close this case for now and I'll reopen it or start a new one if it starts up again.

Thank you for all of your help!