Smaller creatures grow up faster... so maybe Lalafells grow larger physically but are still children mentally...? That's how I rationalize it.