Got some new information to this although I am not sure if its actually being read or not.

So far it seems this issue is only happening in DirectX 11. I decided to give Directx 9 a try to see if it fixed an FPS issue I was having and noticed that my controller hasn't yet disconnected.