Do you have "join parties in progress" enabled?