Well, Thanks for the input guys, although that didnt come up to my mind till now lol.
Anyhow, having the companion unable to be withdrawn normal way(right click name -> withdraw) was the cause of the confusion.

Ill be sure to keybind that, Thanks again