English
Related papers

Related papers: Speech Synthesis as Augmentation for Low-Resource …

200 papers

In recent years, automatic speech recognition (ASR) models greatly improved transcription performance both in clean, low noise, acoustic conditions and in reverberant environments. However, all these systems rely on the availability of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-18 Francesco Nespoli , Daniel Barreda , Patrick A. Naylor

Data augmentation is a widely adopted technique utilized to improve the robustness of automatic speech recognition (ASR). Employing a fixed data augmentation strategy for all training data is a common practice. However, it is important to…

Sound · Computer Science 2024-12-03 Hongxuan Lu , Biao Li

Automatic Speech Recognition (ASR) systems are pivotal in transcribing speech into text, yet the errors they introduce can significantly degrade the performance of downstream tasks like summarization. This issue is particularly pronounced…

Children's speech recognition is considered a low-resource task mainly due to the lack of publicly available data. There are several reasons for such data scarcity, including expensive data collection and annotation processes, and data…

Computation and Language · Computer Science 2024-06-25 Vrunda N. Sukhadia , Shammur Absar Chowdhury

Although Automatic Speech Recognition (ASR) systems have achieved human-like performance for a few languages, the majority of the world's languages do not have usable systems due to the lack of large speech datasets to train these models.…

Computation and Language · Computer Science 2022-02-28 Hemant Yadav , Sunayana Sitaram

There are significant challenges for speaker adaptation in text-to-speech for languages that are not widely spoken or for speakers with accents or dialects that are not well-represented in the training data. To address this issue, we…

Sound · Computer Science 2023-05-30 Ambuj Mehrish , Abhinav Ramesh Kashyap , Li Yingting , Navonil Majumder , Soujanya Poria

Response generation is a task in natural language processing (NLP) where a model is trained to respond to human statements. Conversational response generators take this one step further with the ability to respond within the context of…

Computation and Language · Computer Science 2022-04-07 Gabriel Louis Tan , Adrian Paule Ty , Schuyler Ng , Denzel Adrian Co , Jan Christian Blaise Cruz , Charibeth Cheng

Recent publications on automatic-speech-recognition (ASR) have a strong focus on attention encoder-decoder (AED) architectures which tend to suffer from over-fitting in low resource scenarios. One solution to tackle this issue is to…

Computation and Language · Computer Science 2021-07-14 Nick Rossenbach , Mohammad Zeineldeen , Benedikt Hilmes , Ralf Schlüter , Hermann Ney

In low resource settings, data augmentation strategies are commonly leveraged to improve performance. Numerous approaches have attempted document-level augmentation (e.g., text classification), but few studies have explored token-level…

Computation and Language · Computer Science 2022-10-04 Arie Pratama Sutiono , Gus Hahn-Powell

Sequence-to-Sequence (S2S) models recently started to show state-of-the-art performance for automatic speech recognition (ASR). With these large and deep models overfitting remains the largest problem, outweighing performance improvements…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-04 Thai-Son Nguyen , Sebastian Stueker , Jan Niehues , Alex Waibel

Speech synthesis technology has witnessed significant advancements in recent years, enabling the creation of natural and expressive synthetic speech. One area of particular interest is the generation of synthetic child speech, which…

Sound · Computer Science 2023-11-09 Rishabh Jain , Peter Corcoran

Automatic speech recognition (ASR) systems often falter while processing stuttering-related disfluencies -- such as involuntary blocks and word repetitions -- yielding inaccurate transcripts. A critical barrier to progress is the scarcity…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-03 Dena Mujtaba , Nihar R. Mahapatra , Megan Arney , J. Scott Yaruss , Caryn Herring , Jia Bin

We investigate the potential of LLM-generated synthetic data for improving low-resource Machine Translation (MT). Focusing on seven diverse target languages, we construct a document-level synthetic corpus from English Europarl, and extend…

Computation and Language · Computer Science 2025-09-23 Ona de Gibert , Joseph Attieh , Teemu Vahtola , Mikko Aulamo , Zihao Li , Raúl Vázquez , Tiancheng Hu , Jörg Tiedemann

In this paper, we propose a text-to-speech (TTS)-driven data augmentation method for improving the quality of a non-autoregressive (AR) TTS system. Recently proposed non-AR models, such as FastSpeech 2, have successfully achieved fast…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Min-Jae Hwang , Ryuichi Yamamoto , Eunwoo Song , Jae-Min Kim

Enhancing speech quality is an indispensable yet difficult task as it is often complicated by a range of degradation factors. In addition to additive noise, reverberation, clipping, and speech attenuation can all adversely affect speech…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-01 Jaeuk Byun , Youna Ji , Soo Whan Chung , Soyeon Choe , Min Seok Choi

Synthesized speech is common today due to the prevalence of virtual assistants, easy-to-use tools for generating and modifying speech signals, and remote work practices. Synthesized speech can also be used for nefarious purposes, including…

Sound · Computer Science 2022-05-05 Emily R. Bartusiak , Edward J. Delp

Speech enhancement has seen great improvement in recent years mainly through contributions in denoising, speaker separation, and dereverberation methods that mostly deal with environmental effects on vocal audio. To enhance speech beyond…

Sound · Computer Science 2021-02-02 Adam Polyak , Lior Wolf , Yossi Adi , Ori Kabeli , Yaniv Taigman

End-to-end speech recognition systems have achieved competitive results compared to traditional systems. However, the complex transformations involved between layers given highly variable acoustic signals are hard to analyze. In this paper,…

Computation and Language · Computer Science 2019-11-05 Chung-Yi Li , Pei-Chieh Yuan , Hung-Yi Lee

The difficulty of acquiring abundant, high-quality data, especially in multi-lingual contexts, has sparked interest in addressing low-resource scenarios. Moreover, current literature rely on fixed expressions from language IDs, which…

Sound · Computer Science 2024-09-30 Youngjae Kim , Yejin Jeon , Gary Geunbae Lee

Deep learning technologies have significantly advanced the performance of target speaker extraction (TSE) tasks. To enhance the generalization and robustness of these algorithms when training data is insufficient, data augmentation is a…

Sound · Computer Science 2024-09-17 Junjie Li , Ke Zhang , Shuai Wang , Haizhou Li , Man-Wai Mak , Kong Aik Lee