English
Related papers

Related papers: Distribution augmentation for low-resource express…

200 papers

Building Automatic Speech Recognition (ASR) systems for code-switched speech has recently gained renewed attention due to the widespread use of speech technologies in multilingual communities worldwide. End-to-end ASR systems are a natural…

Computation and Language · Computer Science 2020-10-13 Yash Sharma , Basil Abraham , Karan Taneja , Preethi Jyothi

Neural text-to-speech (TTS) models can synthesize natural human speech when trained on large amounts of transcribed speech. However, collecting such large-scale transcribed data is expensive. This paper proposes an unsupervised pre-training…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-29 Seongyeon Park , Myungseo Song , Bohyung Kim , Tae-Hyun Oh

When the available data of a target speaker is insufficient to train a high quality speaker-dependent neural text-to-speech (TTS) system, we can combine data from multiple speakers and train a multi-speaker TTS model instead. Many studies…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-09 Hieu-Thi Luong , Xin Wang , Junichi Yamagishi , Nobuyuki Nishizawa

Creating synthetic voices with found data is challenging, as real-world recordings often contain various types of audio degradation. One way to address this problem is to pre-enhance the speech with an enhancement model and then use the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-03 Yusheng Tian , Wei Liu , Tan Lee

Recent advancements in Text-to-Speech (TTS) technology have led to natural-sounding speech for English, primarily due to the availability of large-scale, high-quality web data. However, many other languages lack access to such resources,…

Computation and Language · Computer Science 2024-10-24 Srija Anand , Praveen Srinivasa Varadhan , Mehak Singal , Mitesh M. Khapra

Many neural text-to-speech architectures can synthesize nearly natural speech from text inputs. These architectures must be trained with tens of hours of annotated and high-quality speech data. Compiling such large databases for every new…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-21 Kishor Kayyar Lakshminarayana , Christian Dittmar , Nicola Pia , Emanuël Habets

High-quality and intelligible speech is essential to text-to-speech (TTS) model training, however, obtaining high-quality data for low-resource languages is challenging and expensive. Applying speech enhancement on Automatic Speech…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-20 Zhaoheng Ni , Sravya Popuri , Ning Dong , Kohei Saijo , Xiaohui Zhang , Gael Le Lan , Yangyang Shi , Vikas Chandra , Changhan Wang

Recent advances in text-to-speech (TTS) led to the development of flexible multi-speaker end-to-end TTS systems. We extend state-of-the-art attention-based automatic speech recognition (ASR) systems with synthetic audio generated by a TTS…

Computation and Language · Computer Science 2020-02-18 Nick Rossenbach , Albert Zeyer , Ralf Schlüter , Hermann Ney

Text-to-speech (TTS) systems offer the opportunity to compensate for a hearing loss at the source rather than correcting for it at the receiving end. This removes limitations such as time constraints for algorithms that amplify a sound in a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-23 Josef Schlittenlacher , Thomas Baer

The rapid growth of voice assistants powered by large language models (LLM) has highlighted a need for speech instruction data to train these systems. Despite the abundance of speech recognition data, there is a notable scarcity of speech…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-26 Alan Dao , Dinh Bach Vu , Huy Hoang Ha , Tuan Le Duc Anh , Shreyas Gopal , Yue Heng Yeo , Warren Keng Hoong Low , Eng Siong Chng , Jia Qi Yip

Automatic speech recognition (ASR) research has achieved impressive performance in recent years and has significant potential for enabling access for people with dysarthria (PwD) in augmentative and alternative communication (AAC) and home…

Sound · Computer Science 2024-06-14 Wing-Zin Leung , Mattias Cross , Anton Ragni , Stefan Goetze

We investigate the use of zero-shot text-to-speech (ZS-TTS) as a data augmentation source for low-resource personalized speech synthesis. While synthetic augmentation can provide linguistically rich and phonetically diverse speech, naively…

Sound · Computer Science 2026-03-05 Youngwon Choi , Jinwoo Oh , Hwayeon Kim , Hyeonyu Kim

Recent advances in synthetic speech quality have enabled us to train text-to-speech (TTS) systems by using synthetic corpora. However, merely increasing the amount of synthetic data is not always advantageous for improving training…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-01 Eunwoo Song , Ryuichi Yamamoto , Ohsung Kwon , Chan-Ho Song , Min-Jae Hwang , Suhyeon Oh , Hyun-Wook Yoon , Jin-Seob Kim , Jae-Min Kim

While neural text-to-speech (TTS) has achieved human-like natural synthetic speech, multilingual TTS systems are limited to resource-rich languages due to the need for paired text and studio-quality audio data. This paper proposes a method…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-30 Takaaki Saeki , Soumi Maiti , Xinjian Li , Shinji Watanabe , Shinnosuke Takamichi , Hiroshi Saruwatari

Automatic speech recognition (ASR) for conversational code-switching speech remains challenging due to the scarcity of realistic, high-quality labeled speech data. This paper explores multilingual text-to-speech (TTS) models as an effective…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-06 Yue Heng Yeo , Yuchen Hu , Shreyas Gopal , Yizhou Peng , Hexin Liu , Eng Siong Chng

Recent language model-based text-to-speech (TTS) frameworks demonstrate scalability and in-context learning capabilities. However, they suffer from robustness issues due to the accumulation of errors in speech unit predictions during…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Kun Zhou , Shengkui Zhao , Yukun Ma , Chong Zhang , Hao Wang , Dianwen Ng , Chongjia Ni , Nguyen Trung Hieu , Jia Qi Yip , Bin Ma

Text-to-speech (TTS) technology has achieved impressive results for widely spoken languages, yet many under-resourced languages remain challenged by limited data and linguistic complexities. In this paper, we present a novel methodology…

Sound · Computer Science 2025-04-11 Yizhong Geng , Jizhuo Xu , Zeyu Liang , Jinghan Yang , Xiaoyi Shi , Xiaoyu Shen

Nowadays, the main problem of deep learning techniques used in the development of automatic speech recognition (ASR) models is the lack of transcribed data. The goal of this research is to propose a new data augmentation method to improve…

Computation and Language · Computer Science 2022-04-04 Rodolfo Zevallos

Artificial speech synthesis has made a great leap in terms of naturalness as recent Text-to-Speech (TTS) systems are capable of producing speech with similar quality to human recordings. However, not all speaking styles are easy to model:…

Neural text-to-speech (TTS) can provide quality close to natural speech if an adequate amount of high-quality speech material is available for training. However, acquiring speech data for TTS training is costly and time-consuming,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-29 Tuomo Raitio , Javier Latorre , Andrea Davis , Tuuli Morrill , Ladan Golipour