Manually selecting the dungeon with only premade and no pickups will result in no penalty.
I don't think this is unfair and I don't see it being changed.