If you don't kill enough imperials before they withdraw, you won't get a reward. It's meant to be done with multiple people, but I don't think anyone's interested in it anymore.