I don't understand why you can't get them if you join something in progress. This seems counterintuitive to me. You should encourage people to enable the join party in progress, not turn it off.