I've tested with countless times and it always happens, basically when you use time dilation, the buff extends on the person you cast it onto however it doesn't renew your own buff resulting in the buff still falling off on it's original duration from both people.