English
Related papers

Related papers: Synthetic Voice Data for Automatic Speech Recognit…

200 papers

Africa has a very low doctor-to-patient ratio. At very busy clinics, doctors could see 30+ patients per day -- a heavy patient burden compared with developed countries -- but productivity tools such as clinical automatic speech recognition…

Developing Automatic Speech Recognition (ASR) for low-resource languages is a challenge due to the small amount of transcribed audio data. For many such languages, audio and text are available separately, but not audio with transcriptions.…

Computation and Language · Computer Science 2022-07-21 Nathaniel Robinson , Perez Ogayo , Swetha Gangu , David R. Mortensen , Shinji Watanabe

Building an accurate automatic speech recognition (ASR) system requires a large dataset that contains many hours of labeled speech samples produced by a diverse set of speakers. The lack of such open free datasets is one of the main issues…

Computation and Language · Computer Science 2018-11-05 Jason Li , Ravi Gadde , Boris Ginsburg , Vitaly Lavrukhin

We explore cross-lingual multi-speaker speech synthesis and cross-lingual voice conversion applied to data augmentation for automatic speech recognition (ASR) systems in low/medium-resource scenarios. Through extensive experiments, we show…

Indigenous languages are a fundamental legacy in the development of human communication, embodying the unique identity and culture of local communities in America. The Second AmericasNLP (Americas Natural Language Processing) Competition…

Computation and Language · Computer Science 2024-09-24 Monica Romero , Sandra Gomez , Ivan G. Torre

We investigate continued pretraining (CPT) for adapting wav2vec2-bert-2.0 to Swahili automatic speech recognition (ASR). Our approach combines unlabeled audio with limited labeled data through pseudo-labeled CPT followed by supervised…

Sound · Computer Science 2026-03-13 Hillary Mutisya , John Mugane

This paper introduces the first standardized benchmark for evaluating Automatic Speech Recognition (ASR) in the Bambara language, utilizing one hour of professionally recorded Malian constitutional text. Designed as a controlled reference…

Computation and Language · Computer Science 2026-02-11 Seydou Diallo , Yacouba Diarra , Mamadou K. Keita , Panga Azazia Kamaté , Adam Bouno Kampo , Aboubacar Ouattara

Accents play a pivotal role in shaping human communication, enhancing our ability to convey and comprehend messages with clarity and cultural nuance. While there has been significant progress in Automatic Speech Recognition (ASR),…

Computation and Language · Computer Science 2025-06-24 Bonaventure F. P. Dossou

Recent publications on automatic-speech-recognition (ASR) have a strong focus on attention encoder-decoder (AED) architectures which tend to suffer from over-fitting in low resource scenarios. One solution to tackle this issue is to…

Computation and Language · Computer Science 2021-07-14 Nick Rossenbach , Mohammad Zeineldeen , Benedikt Hilmes , Ralf Schlüter , Hermann Ney

We develop automatic speech recognition (ASR) systems for stories told by Afrikaans and isiXhosa preschool children. Oral narratives provide a way to assess children's language development before they learn to read. We consider a range of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-14 Christiaan Jacobs , Annelien Smith , Daleen Klop , Ondřej Klejch , Febe de Wet , Herman Kamper

Automatic Speech Recognition (ASR) for low-resource Dravidian languages like Telugu and Kannada faces significant challenges in specialized medical domains due to limited annotated data and morphological complexity. This work proposes a…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-23 Sri Charan Devarakonda , Ravi Sastry Kolluru , Manjula Sri Rayudu , Rashmi Kapoor , Madhu G , Anil Kumar Vuppala

Speech technologies are transforming interactions across various sectors, from healthcare to call centers and robots, yet their performance on African-accented conversations remains underexplored. We introduce Afrispeech-Dialog, a benchmark…

Augmenting the training data of automatic speech recognition (ASR) systems with synthetic data generated by text-to-speech (TTS) or voice conversion (VC) has gained popularity in recent years. Several works have demonstrated improvements in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-13 Sewade Ogun , Vincent Colotte , Emmanuel Vincent

Speech synthesis (text to speech, TTS) and recognition (automatic speech recognition, ASR) are important speech tasks, and require a large amount of text and speech pairs for model training. However, there are more than 6,000 languages in…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-11 Jin Xu , Xu Tan , Yi Ren , Tao Qin , Jian Li , Sheng Zhao , Tie-Yan Liu

While massively multilingual speech models like wav2vec 2.0 XLSR-128 can be directly fine-tuned for automatic speech recognition (ASR), downstream performance can still be relatively poor on languages that are under-represented in the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-06 Nay San , Georgios Paraskevopoulos , Aryaman Arora , Xiluo He , Prabhjot Kaur , Oliver Adams , Dan Jurafsky

We study training a single acoustic model for multiple languages with the aim of improving automatic speech recognition (ASR) performance on low-resource languages, and over-all simplifying deployment of ASR systems that support diverse…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-09 Vineel Pratap , Anuroop Sriram , Paden Tomasello , Awni Hannun , Vitaliy Liptchinsky , Gabriel Synnaeve , Ronan Collobert

In this work, we present AfriHuBERT, an extension of mHuBERT-147, a compact self-supervised learning (SSL) model pretrained on 147 languages. While mHuBERT-147 covered 16 African languages, we expand this to 1,226 through continued…

Computation and Language · Computer Science 2025-06-03 Jesujoba O. Alabi , Xuechen Liu , Dietrich Klakow , Junichi Yamagishi

Automatic speech recognition (ASR) is a crucial tool for linguists aiming to perform a variety of language documentation tasks. However, modern ASR systems use data-hungry transformer architectures, rendering them generally unusable for…

Computation and Language · Computer Science 2025-10-09 Massimo Daul , Alessio Tosolini , Claire Bowern

End-to-end (E2E) automatic speech recognition (ASR) models have recently demonstrated superior performance over the traditional hybrid ASR models. Training an E2E ASR model requires a large amount of data which is not only expensive but may…

Machine Learning · Computer Science 2021-06-16 Amin Fazel , Wei Yang , Yulan Liu , Roberto Barra-Chicote , Yixiong Meng , Roland Maas , Jasha Droppo

Automatic Speech Recognition (ASR) can play a crucial role in enhancing the accessibility of spoken languages worldwide. In this paper, we build a set of ASR tools for Amharic, a language spoken by more than 50 million people primarily in…

Computation and Language · Computer Science 2024-04-23 Samuael Adnew , Paul Pu Liang