yes this is very annoying, one day it took like 20 readychecks after we got in finally.
They should do it like in WoW LFR, people who accepted invite go inside, and game is filling the rest.