Just now I tested summoning a retainer in a different ward. Works fine in Ironmongers ward. I think Masons ward gets overpopulated. The bug only happens to me in Masons ward.