English
Related papers

Related papers: Frustratingly Easy Data Augmentation for Low-Resou…

200 papers

This study investigates the efficacy of data augmentation techniques for low-resource automatic speech recognition (ASR), focusing on two endangered Austronesian languages, Amis and Seediq. Recognizing the potential of self-supervised…

Computation and Language · Computer Science 2025-10-01 Yao-Fei Cheng , Li-Wei Chen , Hung-Shin Lee , Hsin-Min Wang

Speech technology remains out of reach for most of the over 2300 languages in Africa. We present the first systematic assessment of large-scale synthetic voice corpora for African ASR. We apply a three-step process: LLM-driven text…

Computation and Language · Computer Science 2025-11-10 Brian DeRenzi , Anna Dixon , Mohamed Aymane Farhi , Christian Resch

Automatic recognition of disordered speech remains a highly challenging task to date due to data scarcity. This paper presents a reinforcement learning (RL) based on-the-fly data augmentation approach for training state-of-the-art PyChain…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-15 Zengrui Jin , Xurong Xie , Tianzi Wang , Mengzhe Geng , Jiajun Deng , Guinan Li , Shujie Hu , Xunying Liu

Although contextualized automatic speech recognition (ASR) systems are commonly used to improve the recognition of uncommon words, their effectiveness is hindered by the inherent limitations of speech-text data availability. To address this…

Sound · Computer Science 2024-06-17 Naijun Zheng , Xucheng Wan , Kai Liu , Ziqing Du , Zhou Huan

Recent advances in automatic speech recognition (ASR) have combined speech encoders with large language models (LLMs) through projection, forming Speech LLMs with strong performance. However, adapting them to new domains remains…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-24 Yangui Fang , Jing Peng , Xu Li , Yu Xi , Chengwei Zhang , Guohui Zhong , Kai Yu

Training a robust Automatic Speech Recognition (ASR) system for children's speech recognition is a challenging task due to inherent differences in acoustic attributes of adult and child speech and scarcity of publicly available children's…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-15 Vishwanath Pratap Singh , Hardik Sailor , Supratik Bhattacharya , Abhishek Pandey

This paper addresses the challenge of integrating low-resource languages into multilingual automatic speech recognition (ASR) systems. We introduce a novel application of weighted cross-entropy, typically used for unbalanced datasets, to…

Automatic speech recognition (ASR) performance has improved drastically in recent years, mainly enabled by self-supervised learning (SSL) based acoustic models such as wav2vec2 and large-scale multi-lingual training like Whisper. A huge…

Bootstrapping speech recognition on limited data resources has been an area of active research for long. The recent transition to all-neural models and end-to-end (E2E) training brought along particular challenges as these models are known…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-21 Manuel Giollo , Deniz Gunceler , Yulan Liu , Daniel Willett

Previous work has shown that for low-resource source languages, automatic speech-to-text translation (AST) can be improved by pretraining an end-to-end model on automatic speech recognition (ASR) data from a high-resource language. However,…

Computation and Language · Computer Science 2020-02-11 Mihaela C. Stoian , Sameer Bansal , Sharon Goldwater

This paper presents KIT's submissions to the IWSLT 2025 low-resource track. We develop both cascaded systems, consisting of Automatic Speech Recognition (ASR) and Machine Translation (MT) models, and end-to-end (E2E) Speech Translation (ST)…

Computation and Language · Computer Science 2026-01-29 Zhaolin Li , Yining Liu , Danni Liu , Tuan Nam Nguyen , Enes Yavuz Ugan , Tu Anh Dinh , Carlos Mullov , Alexander Waibel , Jan Niehues

This paper presents a novel multistage fine-tuning strategy designed to enhance automatic speech recognition (ASR) performance in low-resource languages using OpenAI's Whisper model. In this approach we aim to build ASR model for languages…

Computation and Language · Computer Science 2024-11-08 Leena G Pillai , Kavya Manohar , Basil K Raju , Elizabeth Sherly

In recent years, several text-to-speech systems have been proposed to synthesize natural speech in zero-shot, few-shot, and low-resource scenarios. However, these methods typically require training with data from many different speakers.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Kishor Kayyar Lakshminarayana , Frank Zalkow , Christian Dittmar , Nicola Pia , Emanuel A. P. Habets

In this paper, we propose a self-training approach for automatic speech recognition (ASR) for low-resource settings. While self-training approaches have been extensively developed and evaluated for high-resource languages such as English,…

Computation and Language · Computer Science 2023-08-11 Satwinder Singh , Feng Hou , Ruili Wang

Self-supervised learning (SSL) techniques have achieved remarkable results in various speech processing tasks. Nonetheless, a significant challenge remains in reducing the reliance on vast amounts of speech data for pre-training. This paper…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-05 Po-chun Hsu , Ali Elkahky , Wei-Ning Hsu , Yossi Adi , Tu Anh Nguyen , Jade Copet , Emmanuel Dupoux , Hung-yi Lee , Abdelrahman Mohamed

In this paper, we propose a text-to-speech (TTS)-driven data augmentation method for improving the quality of a non-autoregressive (AR) TTS system. Recently proposed non-AR models, such as FastSpeech 2, have successfully achieved fast…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Min-Jae Hwang , Ryuichi Yamamoto , Eunwoo Song , Jae-Min Kim

Text Augmentation is an important task for low-resource languages. It helps deal with the problem of data scarcity. A data augmentation strategy is used to deal with the problem of data scarcity. Through the years, much work has been done…

Computation and Language · Computer Science 2024-01-25 Onkar Litake , Niraj Yagnik , Shreyas Labhsetwar

Translation to or from low-resource languages LRLs poses challenges for machine translation in terms of both adequacy and fluency. Data augmentation utilizing large amounts of monolingual data is regarded as an effective way to alleviate…

Computation and Language · Computer Science 2019-06-11 Mengzhou Xia , Xiang Kong , Antonios Anastasopoulos , Graham Neubig

This paper proposes a novel linear prediction coding-based data aug-mentation method for children's low and zero resource dialect ASR. The data augmentation procedure consists of perturbing the formant peaks of the LPC spectrum during LPC…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-23 Alexander Johnson , Ruchao Fan , Robin Morris , Abeer Alwan

This paper proposes two innovative methodologies to construct customized Common Voice datasets for low-resource languages like Hindi. The first methodology leverages Bark, a transformer-based text-to-audio model developed by Suno, and…

Sound · Computer Science 2024-01-11 Anand Kamble , Aniket Tathe , Suyash Kumbharkar , Atharva Bhandare , Anirban C. Mitra