IMO the pet shouldn't even exist in it's hitbox aggro'able form when mounted. It should be like just floating or running beside you but strictly and only in a visual sense. (Like how bird Companions are managed when we mount / dismount with them summoned).

But I'd take this idea as well!