English
Related papers

Related papers: Adaptation of Whisper models to child speech recog…

200 papers

Automatic Speech Recognition (ASR) systems have progressed significantly in their performance on adult speech data; however, transcribing child speech remains challenging due to the acoustic differences in the characteristics of child and…

Computation and Language · Computer Science 2023-11-10 Andrei Barcovschi , Rishabh Jain , Peter Corcoran

Despite recent advancements in deep learning technologies, Child Speech Recognition remains a challenging task. Current Automatic Speech Recognition (ASR) models require substantial amounts of annotated data for training, which is scarce.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-14 Rishabh Jain , Andrei Barcovschi , Mariam Yiwere , Dan Bigioi , Peter Corcoran , Horia Cucu

Recent advancements in Automatic Speech Recognition (ASR) systems, exemplified by Whisper, have demonstrated the potential of these systems to approach human-level performance given sufficient data. However, this progress doesn't readily…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-16 Ahmed Adel Attia , Jing Liu , Wei Ai , Dorottya Demszky , Carol Espy-Wilson

Automatic speech recognition systems have undoubtedly advanced with the integration of multilingual and multitask models such as Whisper, which have shown a promising ability to understand and process speech across a wide range of…

Computation and Language · Computer Science 2025-04-14 Xabier de Zuazo , Eva Navas , Ibon Saratxaga , Inma Hernáez Rioja

Automatic speech recognition (ASR) has the potential to substantially reduce manual annotation effort in child speech research by generating automatic transcriptions. However, obtaining reliably high-quality ASR transcriptions for child…

Computation and Language · Computer Science 2026-05-29 Gus Lathouwers , Lingyun Gao , Catia Cucchiarini , Helmer Strik

Recent techniques for speech deepfake detection often rely on pre-trained self-supervised models. These systems, initially developed for Automatic Speech Recognition (ASR), have proved their ability to offer a meaningful representation of…

Speech foundation models (SFMs) have achieved state-of-the-art results for various speech tasks in supervised (e.g. Whisper) or self-supervised systems (e.g. WavLM). However, the performance of SFMs for child ASR has not been systematically…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-18 Ruchao Fan , Natarajan Balaji Shankar , Abeer Alwan

Automatic Speech Recognition (ASR) systems are known to exhibit difficulties when transcribing children's speech. This can mainly be attributed to the absence of large children's speech corpora to train robust ASR models and the resulting…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Jenthe Thienpondt , Kris Demuynck

Voicebots have provided a new avenue for supporting the development of language skills, particularly within the context of second language learning. Voicebots, though, have largely been geared towards native adult speakers. We sought to…

Computation and Language · Computer Science 2024-07-24 Simone Wills , Yu Bai , Cristian Tejedor-Garcia , Catia Cucchiarini , Helmer Strik

We develop automatic speech recognition (ASR) systems for stories told by Afrikaans and isiXhosa preschool children. Oral narratives provide a way to assess children's language development before they learn to read. We consider a range of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-14 Christiaan Jacobs , Annelien Smith , Daleen Klop , Ondřej Klejch , Febe de Wet , Herman Kamper

A crucial part of an accurate and reliable spoken language assessment system is the underlying ASR model. Recently, large-scale pre-trained ASR foundation models such as Whisper have been made available. As the output of these models is…

Computation and Language · Computer Science 2023-10-11 Rao Ma , Mengjie Qian , Mark J. F. Gales , Kate M. Knill

The performance of child speech recognition is generally less satisfactory compared to adult speech due to limited amount of training data. Significant performance degradation is expected when applying an automatic speech recognition (ASR)…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-26 Wei Liu , Jingyu Li , Tan Lee

Speech impairments caused by conditions such as cerebral palsy or genetic disorders pose significant challenges for automatic speech recognition (ASR) systems. Despite recent advances, ASR models like Whisper struggle with non-normative…

Computation and Language · Computer Science 2025-06-30 Niclas Pokel , Pehuén Moure , Roman Boehringer , Yingqiang Gao

Whispering is a distinct form of speech known for its soft, breathy, and hushed characteristics, often used for private communication. The acoustic characteristics of whispered speech differ substantially from normally phonated speech and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-08 Zhaofeng Lin , Tanvina Patel , Odette Scharenborg

Automatic Speech Recognition (ASR) models have achieved remarkable accuracy in general settings, yet their performance often degrades in domain-specific applications due to data mismatch and linguistic variability. This challenge is…

Reliable transcription of child-adult conversations in clinical settings is crucial for diagnosing developmental disorders like Autism. Recent advances in deep learning and availability of large scale transcribed data has led to development…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-15 Aditya Ashvin , Rimita Lahiri , Aditya Kommineni , Somer Bishop , Catherine Lord , Sudarsana Reddy Kadiri , Shrikanth Narayanan

Despite the growing advancements in Automatic Speech Recognition (ASR) models, the development of robust models for underrepresented languages, such as Nepali, remains a challenge. This research focuses on making an exhaustive and…

Computation and Language · Computer Science 2024-11-20 Sanjay Rijal , Shital Adhikari , Manish Dahal , Manish Awale , Vaghawan Ojha

Whisper is a multitask and multilingual speech model covering 99 languages. It yields commendable automatic speech recognition (ASR) results in a subset of its covered languages, but the model still underperforms on a non-negligible number…

Computation and Language · Computer Science 2024-05-03 Thomas Palmeira Ferraz

State-of-the-art ASRs show suboptimal performance for child speech. The scarcity of child speech limits the development of child speech recognition (CSR). Therefore, we studied child-to-child voice conversion (VC) from existing child…

Computation and Language · Computer Science 2025-01-09 Yuanyuan Zhang , Zhengjun Yue , Tanvina Patel , Odette Scharenborg

Self-supervised learning (SSL) is a powerful tool that allows learning of underlying representations from unlabeled data. Transformer based models such as wav2vec 2.0 and HuBERT are leading the field in the speech domain. Generally these…

Computation and Language · Computer Science 2022-02-08 Bethan Thomas , Samuel Kessler , Salah Karout
‹ Prev 1 2 3 10 Next ›