Yea I'm not a fan of punishing them either, I think the current party buff system is kind of rubbish to say the least, I have started another thread as to not high-jack this one.