English
Related papers

Related papers: Improving Few-Shot Learning for Talking Face Syste…

200 papers

In this paper, we propose a text-to-speech (TTS)-driven data augmentation method for improving the quality of a non-autoregressive (AR) TTS system. Recently proposed non-AR models, such as FastSpeech 2, have successfully achieved fast…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Min-Jae Hwang , Ryuichi Yamamoto , Eunwoo Song , Jae-Min Kim

While recent neural text-to-speech (TTS) systems perform remarkably well, they typically require a substantial amount of recordings from the target speaker reading in the desired speaking style. In this work, we present a novel 3-step…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-03 Goeric Huybrechts , Thomas Merritt , Giulia Comini , Bartek Perz , Raahil Shah , Jaime Lorenzo-Trueba

While automatic speech recognition (ASR) systems have achieved remarkable performance with large-scale datasets, their efficacy remains inadequate in low-resource settings, encompassing dialects, accents, minority languages, and long-tail…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-23 Guanrou Yang , Fan Yu , Ziyang Ma , Zhihao Du , Zhifu Gao , Shiliang Zhang , Xie Chen

This paper presents a novel data augmentation technique for text-to-speech (TTS), that allows to generate new (text, audio) training examples without requiring any additional data. Our goal is to increase diversity of text conditionings…

This paper investigates the use of unsupervised text-to-speech synthesis (TTS) as a data augmentation method to improve accented speech recognition. TTS systems are trained with a small amount of accented speech training data and their…

Computation and Language · Computer Science 2024-07-08 Cong-Thanh Do , Shuhei Imai , Rama Doddipatla , Thomas Hain

Few-shot speaker adaptation is a specific Text-to-Speech (TTS) system that aims to reproduce a novel speaker's voice with a few training data. While numerous attempts have been made to the few-shot speaker adaptation system, there is still…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-17 Ji-Hoon Kim , Sang-Hoon Lee , Ji-Hyun Lee , Hong-Gyu Jung , Seong-Whan Lee

Recent advances in text-to-speech (TTS) led to the development of flexible multi-speaker end-to-end TTS systems. We extend state-of-the-art attention-based automatic speech recognition (ASR) systems with synthetic audio generated by a TTS…

Computation and Language · Computer Science 2020-02-18 Nick Rossenbach , Albert Zeyer , Ralf Schlüter , Hermann Ney

Spoken language understanding (SLU) systems often exhibit suboptimal performance in processing atypical speech, typically caused by neurological conditions and motor impairments. Recent advancements in Text-to-Speech (TTS) synthesis-based…

High-quality and intelligible speech is essential to text-to-speech (TTS) model training, however, obtaining high-quality data for low-resource languages is challenging and expensive. Applying speech enhancement on Automatic Speech…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-20 Zhaoheng Ni , Sravya Popuri , Ning Dong , Kohei Saijo , Xiaohui Zhang , Gael Le Lan , Yangyang Shi , Vikas Chandra , Changhan Wang

The performance of automatic speech recognition (ASR) systems has advanced substantially in recent years, particularly for languages for which a large amount of transcribed speech is available. Unfortunately, for low-resource languages,…

Computation and Language · Computer Science 2023-05-22 Martijn Bartelds , Nay San , Bradley McDonnell , Dan Jurafsky , Martijn Wieling

We address the problem of cross-speaker style transfer for text-to-speech (TTS) using data augmentation via voice conversion. We assume to have a corpus of neutral non-expressive data from a target speaker and supporting conversational…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-11 Manuel Sam Ribeiro , Julian Roth , Giulia Comini , Goeric Huybrechts , Adam Gabrys , Jaime Lorenzo-Trueba

Automatic speech recognition (ASR) for conversational code-switching speech remains challenging due to the scarcity of realistic, high-quality labeled speech data. This paper explores multilingual text-to-speech (TTS) models as an effective…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-06 Yue Heng Yeo , Yuchen Hu , Shreyas Gopal , Yizhou Peng , Hexin Liu , Eng Siong Chng

Data augmentation is one of the most effective ways to make end-to-end automatic speech recognition (ASR) perform close to the conventional hybrid approach, especially when dealing with low-resource tasks. Using recent advances in speech…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-21 Aleksandr Laptev , Roman Korostik , Aleksey Svischev , Andrei Andrusenko , Ivan Medennikov , Sergey Rybin

Conventional text-to-speech (TTS) research has predominantly focused on enhancing the quality of synthesized speech for speakers in the training dataset. The challenge of synthesizing lifelike speech for unseen, out-of-dataset speakers,…

Sound · Computer Science 2024-04-30 Wenbin Wang , Yang Song , Sanjay Jha

When the available data of a target speaker is insufficient to train a high quality speaker-dependent neural text-to-speech (TTS) system, we can combine data from multiple speakers and train a multi-speaker TTS model instead. Many studies…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-09 Hieu-Thi Luong , Xin Wang , Junichi Yamagishi , Nobuyuki Nishizawa

Text-to-Speech (TTS) synthesis using deep learning relies on voice quality. Modern TTS models are advanced, but they need large amount of data. Given the growing computational complexity of these models and the scarcity of large,…

Sound · Computer Science 2023-10-10 Ze Liu

While neural text-to-speech (TTS) has achieved human-like natural synthetic speech, multilingual TTS systems are limited to resource-rich languages due to the need for paired text and studio-quality audio data. This paper proposes a method…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-30 Takaaki Saeki , Soumi Maiti , Xinjian Li , Shinji Watanabe , Shinnosuke Takamichi , Hiroshi Saruwatari

In recent years, Text-To-Speech (TTS) has been used as a data augmentation technique for speech recognition to help complement inadequacies in the training data. Correspondingly, we investigate the use of a multi-speaker TTS system to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-25 Yiling Huang , Yutian Chen , Jason Pelecanos , Quan Wang

The availability of data in expressive styles across languages is limited, and recording sessions are costly and time consuming. To overcome these issues, we demonstrate how to build low-resource, neural text-to-speech (TTS) voices with…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-01 Giulia Comini , Goeric Huybrechts , Manuel Sam Ribeiro , Adam Gabrys , Jaime Lorenzo-Trueba

For personalized speech generation, a neural text-to-speech (TTS) model must be successfully implemented with limited data from a target speaker. To this end, the baseline TTS model needs to be amply generalized to out-of-domain data (i.e.,…

Sound · Computer Science 2023-08-30 Hyungchan Yoon , Changhwan Kim , Eunwoo Song , Hyun-Wook Yoon , Hong-Goo Kang
‹ Prev 1 2 3 10 Next ›