Tl;dr: Your exp is being gimped for a little while, from 90% to 0% of experience depending on how much you ignore the yellow text.

Moreover, you can negate this by leveling a different skill. However, Physical level yellow text cannot be avoided, enjoy.