I think I'm the only one who is suffering from this.
You're not. I am and so are many others.

This. I should be able to turn down the amount of characters displayed on my screen and the game should prioritize in this order : ME, Enemies, NPC's, Party Members, everyone else.
Party members should be ranked higher (preferably after "me"), but other than that, yes.

Would be nice, but seeing as how I still run into invisible hunts years later after they tried to make fixes to their loading orders, I can only assume that there's only so much SE can do in this regard.