I have done the same thing loll!!! Forgot all about them. Retainers are "ok" right now but they need more things to do than just bank/go fetch loot. Let them come with us to things like dungeons and other stuff.