This has been fixed as of today.

"An issue wherein players would not receive a penalty for leaving a duty while other players were still loading into the instance."