Port forwarding as mentioned seems to have fixed my controller issues