And I've seen AFK, offline, and generally someone harassing the party being kicked. How is that fair to the rest of the party to keep that person in the group?
You cannot make a single system that will benefit both points and have absolutely no way to abuse. In both cases, it is a community problem.