Trusts were made for the exact reason of taking your own pace through a dungeon without asking 3 others what to do.

Coincidentally, the Trusts are basically those who "want to take it slow", and if you find you don't like that, rethink your position the next time you queue up for a dungeon and feel like single pulling.