Yes, you still get the penalty for pre-made parties.

Yes, you get the penalty if someone else has already left the party (abandoned the duty) and you leave after.

The only way to not get the penalty is to have the duty vote abandoned. That's it.