I've started calling out players and kicking anyone clearly afk off my party. The ones actively playing loved me for it.