K-Function: Joint Pronunciation Transcription and Feedback for Evaluating Kids Language Function
Abstract
Evaluating young children's language is challenging for automatic speech recognizers due to high-pitched voices, prolonged sounds, and limited data. We introduce K-Function, a framework that combines accurate sub-word transcription with objective, Large Language Model (LLM)-driven scoring. Its core, Kids-Weighted Finite State Transducer (K-WFST), merges an acoustic phoneme encoder with a phoneme-similarity model to capture child-specific speech errors while remaining fully interpretable. K-WFST achieves a 1.39 % phoneme error rate on MyST and 8.61 % on Multitudes-an absolute improvement of 10.47 % and 7.06 % over a greedy-search decoder. These high-quality transcripts are used by an LLM to grade verbal skills, developmental milestones, reading, and comprehension, with results that align closely with human evaluators. Our findings show that precise phoneme recognition is essential for creating an effective assessment framework, enabling scalable language screening for children.
Keywords
Cite
@article{arxiv.2507.03043,
title = {K-Function: Joint Pronunciation Transcription and Feedback for Evaluating Kids Language Function},
author = {Shuhe Li and Chenxu Guo and Jiachen Lian and Cheol Jun Cho and Wenshuo Zhao and Xiner Xu and Ruiyu Jin and Xiaoyu Shi and Xuanru Zhou and Dingkun Zhou and Sam Wang and Grace Wang and Jingze Yang and Jingyi Xu and Ruohan Bao and Xingrui Chen and Elise Brenner and Brandon In and Francesca Pei and Maria Luisa Gorno-Tempini and Gopala Anumanchipalli},
journal= {arXiv preprint arXiv:2507.03043},
year = {2026}
}
Comments
Accepted to 2026 ICASSP