English

Improving child speech recognition with augmented child-like speech

Computation and Language 2025-01-09 v1 Sound Audio and Speech Processing

Abstract

State-of-the-art ASRs show suboptimal performance for child speech. The scarcity of child speech limits the development of child speech recognition (CSR). Therefore, we studied child-to-child voice conversion (VC) from existing child speakers in the dataset and additional (new) child speakers via monolingual and cross-lingual (Dutch-to-German) VC, respectively. The results showed that cross-lingual child-to-child VC significantly improved child ASR performance. Experiments on the impact of the quantity of child-to-child cross-lingual VC-generated data on fine-tuning (FT) ASR models gave the best results with two-fold augmentation for our FT-Conformer model and FT-Whisper model which reduced WERs with ~3% absolute compared to the baseline, and with six-fold augmentation for the model trained from scratch, which improved by an absolute 3.6% WER. Moreover, using a small amount of "high-quality" VC-generated data achieved similar results to those of our best-FT models.

Keywords

Cite

@article{arxiv.2406.10284,
  title  = {Improving child speech recognition with augmented child-like speech},
  author = {Yuanyuan Zhang and Zhengjun Yue and Tanvina Patel and Odette Scharenborg},
  journal= {arXiv preprint arXiv:2406.10284},
  year   = {2025}
}

Comments

5 pages, 1 figure Accepted to INTERSPEECH 2024

R2 v1 2026-06-28T17:06:36.978Z