The DF prevents it. If you que with 3 of 4 the DF gives you the 4th and won't load in until a 4th joins.

Imo, every dungeon should have an entrance that we can walk into manually. So if we walk in the entrance with 3, we go in with 3 bypassing the DF completely.