It doesn't falls off.
That happen if you only choose to display your own debuff on the target. Garuda being replaced by Bahamut, it's weird, but it's not considered as our own debuff anymore, but it's still here (can be checked by using focus target)