I have to disagree.
For me Trusts add a lot to story immersion with their interactions and dialogue. Without them there would be something missing.
They also help me to learn the dungeon or trial in peace at my own pace which is why I usually do duties with Trusts whenever I run a dungeon or trial for the very first time.