Except your character has essentially brought down the Inquisition's base for an attack by say the popularity. They can show some resistance to you and the struggles that Aymeric and the people now with a stronghold in Ishgard but you've already got your own in the House of Fortemps, the Commander of the Temple Knights, and even the lowborn. Anything they can do would be lesser than what was done to you for just a little bit with the end of 2.55.