I thought it was in reference to the classic musical "My Fair Lady"
There's a musical number in the movie called "Wouldn't it be loverly"
Putting the two together, Loverly Ladybird, bird in ref. to singing etc.. etc..
:P maybe it's just me as it was not intended at all i see
