Fertilizing plants has an hour cooldown and it decreases the growing time by an hour. If you fertilize a plant every hour you'll cut the growing time in half. There is no diminishing returns, every time you fertilize will decrease the time by 1 hour.