I have hda this occur to me before. I think it means the ward is full, but instead of cancelling the summon of the retainer and giving you the message the game fritzes. Try moving to another ward and summoning it, if you can find one with space.