According to SE anyone is free to engage or not engage any enemy at any time in an instance, so if you had managed to vote kick him, he could have reported you for abusing the vote kick system.