You need to feed him fruit until you get the message that he's "beginning to growing new feathers", or something to that effect. A single fruit will make the game prompt you that their plumage will change in six hours, but there will be no physical change without the message explicitly stating the new feathers are growing in.