You don't speak to him. There's a lady before the little path that leads up to him, she gives you the Unicorn quest. You should be talking to her to turn in the quest, or initiate the quest. Its a lv30 quest.