English
Related papers

Related papers: Training Text-To-Speech Systems From Synthetic Dat…

200 papers

Neural text-to-speech (TTS) can provide quality close to natural speech if an adequate amount of high-quality speech material is available for training. However, acquiring speech data for TTS training is costly and time-consuming,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-29 Tuomo Raitio , Javier Latorre , Andrea Davis , Tuuli Morrill , Ladan Golipour

It has been known that direct speech-to-speech translation (S2ST) models usually suffer from the data scarcity issue because of the limited existing parallel materials for both source and target speech. Therefore to train a direct S2ST…

Sound · Computer Science 2023-04-11 Jiatong Shi , Yun Tang , Ann Lee , Hirofumi Inaguma , Changhan Wang , Juan Pino , Shinji Watanabe

Text-to-Speech (TTS) has recently seen great progress in synthesizing high-quality speech owing to the rapid development of parallel TTS systems, but producing speech with naturalistic prosodic variations, speaking styles and emotional…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-21 Yinghao Aaron Li , Cong Han , Nima Mesgarani

Recent Text-to-Speech (TTS) systems trained on reading or acted corpora have achieved near human-level naturalness. The diversity of human speech, however, often goes beyond the coverage of these corpora. We believe the ability to handle…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-09 Li-Wei Chen , Shinji Watanabe , Alexander Rudnicky

Text-to-speech (TTS) systems offer the opportunity to compensate for a hearing loss at the source rather than correcting for it at the receiving end. This removes limitations such as time constraints for algorithms that amplify a sound in a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-23 Josef Schlittenlacher , Thomas Baer

Text-to-speech synthesis (TTS) is a task to convert texts into speech. Two of the factors that have been driving TTS are the advancements of probabilistic models and latent representation learning. We propose a TTS method based on latent…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-19 Yusuke Yasuda , Tomoki Toda

In this paper we investigate cross-lingual Text-To-Speech (TTS) synthesis through the lens of adapters, in the context of lightweight TTS systems. In particular, we compare the tasks of unseen speaker and language adaptation with the goal…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-26 Alessio Falai , Ziyao Zhang , Akos Gangoly

Traditional voice conversion (VC) methods typically attempt to separate speaker identity and linguistic information into distinct representations, which are then combined to reconstruct the audio. However, effectively disentangling these…

Sound · Computer Science 2025-10-13 Huu Tuong Tu , Huan Vu , cuong tien nguyen , Dien Hy Ngo , Nguyen Thi Thu Trang

The language diversity in India's education sector poses a significant challenge, hindering inclusivity. Despite the democratization of knowledge through online educational content, the dominance of English, as the internet's lingua franca,…

Computation and Language · Computer Science 2024-03-08 Sai Akarsh , Vamshi Raghusimha , Anindita Mondal , Anil Vuppala

The cross-speaker emotion transfer task in text-to-speech (TTS) synthesis particularly aims to synthesize speech for a target speaker with the emotion transferred from reference speech recorded by another (source) speaker. During the…

Sound · Computer Science 2022-04-11 Tao Li , Xinsheng Wang , Qicong Xie , Zhichao Wang , Lei Xie

Speech synthesis and music audio generation from symbolic input differ in many aspects but share some similarities. In this study, we investigate how text-to-speech synthesis techniques can be used for piano MIDI-to-audio synthesis tasks.…

Sound · Computer Science 2022-02-25 Erica Cooper , Xin Wang , Junichi Yamagishi

This paper presents a novel data augmentation technique for text-to-speech (TTS), that allows to generate new (text, audio) training examples without requiring any additional data. Our goal is to increase diversity of text conditionings…

While neural text-to-speech (TTS) has achieved human-like natural synthetic speech, multilingual TTS systems are limited to resource-rich languages due to the need for paired text and studio-quality audio data. This paper proposes a method…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-30 Takaaki Saeki , Soumi Maiti , Xinjian Li , Shinji Watanabe , Shinnosuke Takamichi , Hiroshi Saruwatari

The goal of cross-speaker style transfer in TTS is to transfer a speech style from a source speaker with expressive data to a target speaker with only neutral data. In this context, we propose using a pre-trained singing voice conversion…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-10 Leonardo B. de M. M. Marques , Lucas H. Ueda , Mário U. Neto , Flávio O. Simões , Fernando Runstein , Bianca Dal Bó , Paula D. P. Costa

Recurrent Neural Networks (RNNs) have become the standard modeling technique for sequence data, and are used in a number of novel text-to-speech models. However, training a TTS model including RNN components has certain requirements for GPU…

Computation and Language · Computer Science 2023-04-18 Ziqi Liang

In this work, we address the Text-to-Speech (TTS) task by proposing a non-autoregressive architecture called EfficientTTS. Unlike the dominant non-autoregressive TTS models, which are trained with the need of external aligners, EfficientTTS…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-08 Chenfeng Miao , Shuang Liang , Zhencheng Liu , Minchuan Chen , Jun Ma , Shaojun Wang , Jing Xiao

In this project, we aim to build a Text-to-Speech system able to produce speech with a controllable emotional expressiveness. We propose a methodology for solving this problem in three main steps. The first is the collection of emotional…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-08 Noé Tits

Many neural text-to-speech architectures can synthesize nearly natural speech from text inputs. These architectures must be trained with tens of hours of annotated and high-quality speech data. Compiling such large databases for every new…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-21 Kishor Kayyar Lakshminarayana , Christian Dittmar , Nicola Pia , Emanuël Habets

Tibetan text-to-speech (TTS) has long been challenged by scarce speech resources, significant dialectal variation, and the complex mapping between written text and spoken pronunciation. To address these issues, this work presents, to the…

Sound · Computer Science 2026-05-05 Jiaxu He , Chao Wang , Jie Lian , Yuqing Cai , Yongxiang Li , Renzeg Duojie , Jie Li

Traditional Text-to-Speech (TTS) systems rely on studio-quality speech recorded in controlled settings.a Recently, an effort known as noisy-TTS training has emerged, aiming to utilize in-the-wild data. However, the lack of dedicated…