I've always been getting a penalty even if someone else has left first. What prompted me to write this was me literally experiencing this about half an hour ago.