English
Related papers

Related papers: RyanSpeech: A Corpus for Conversational Text-to-Sp…

200 papers

Most text-to-speech (TTS) methods use high-quality speech corpora recorded in a well-designed environment, incurring a high cost for data collection. To solve this problem, existing noise-robust TTS methods are intended to use noisy speech…

Sound · Computer Science 2022-06-30 Takaaki Saeki , Kentaro Tachibana , Ryuichi Yamamoto

We aim to characterize how different speakers contribute to the perceived output quality of multi-speaker Text-to-Speech (TTS) synthesis. We automatically rate the quality of TTS using a neural network (NN) trained on human mean opinion…

Computation and Language · Computer Science 2020-04-28 Jennifer Williams , Joanna Rownicka , Pilar Oplustil , Simon King

Speech synthesis has come a long way as current text-to-speech (TTS) models can now generate natural human-sounding speech. However, most of the TTS research focuses on using adult speech data and there has been very limited work done on…

Sound · Computer Science 2022-04-05 Rishabh Jain , Mariam Yiwere , Dan Bigioi , Peter Corcoran , Horia Cucu

An unsupervised text-to-speech synthesis (TTS) system learns to generate speech waveforms corresponding to any written sentence in a language by observing: 1) a collection of untranscribed speech waveforms in that language; 2) a collection…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-17 Junrui Ni , Liming Wang , Heting Gao , Kaizhi Qian , Yang Zhang , Shiyu Chang , Mark Hasegawa-Johnson

The Common Voice corpus is a massively-multilingual collection of transcribed speech intended for speech technology research and development. Common Voice is designed for Automatic Speech Recognition purposes but can be useful in other…

The increasing adoption of text-to-speech technologies has led to a growing demand for natural and emotive voices that adapt to a conversation's context and emotional tone. The Emotive Narrative Storytelling (EMNS) corpus is a unique speech…

Computation and Language · Computer Science 2023-05-26 Kari Ali Noriy , Xiaosong Yang , Jian Jun Zhang

Training a text-to-speech (TTS) model requires a large scale text labeled speech corpus, which is troublesome to collect. In this paper, we propose a transfer learning framework for TTS that utilizes a large amount of unlabeled speech…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-07 Minchan Kim , Myeonghun Jeong , Byoung Jin Choi , Sunghwan Ahn , Joun Yeop Lee , Nam Soo Kim

This paper presents an augmentation of MSCOCO dataset where speech is added to image and text. Speech captions are generated using text-to-speech (TTS) synthesis resulting in 616,767 spoken captions (more than 600h) paired with images.…

Computation and Language · Computer Science 2020-11-24 William Havard , Laurent Besacier , Olivier Rosec

In this paper, we propose a text-to-speech (TTS)-driven data augmentation method for improving the quality of a non-autoregressive (AR) TTS system. Recently proposed non-AR models, such as FastSpeech 2, have successfully achieved fast…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Min-Jae Hwang , Ryuichi Yamamoto , Eunwoo Song , Jae-Min Kim

Dubbed series are gaining a lot of popularity in recent years with strong support from major media service providers. Such popularity is fueled by studies that showed that dubbed versions of TV shows are more popular than their subtitled…

Computation and Language · Computer Science 2022-03-08 Massa Baali , Wassim El-Hajj , Ahmed Ali

Whisper generation is constrained by the difficulty of data collection. Because whispered speech has low acoustic amplitude, high-fidelity recording is challenging. In this paper, we introduce WhispSynth, a large-scale multilingual corpus…

Sound · Computer Science 2026-03-17 Tianyi Tan , Jiaxin Ye , Yuanming Zhang , Xiaohuai Le , Xianjun Xia , Chuanzeng Huang , Jing Lu

It is well known that many machine learning systems demonstrate bias towards specific groups of individuals. This problem has been studied extensively in the Facial Recognition area, but much less so in Automatic Speech Recognition (ASR).…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-22 Chunxi Liu , Michael Picheny , Leda Sarı , Pooja Chitkara , Alex Xiao , Xiaohui Zhang , Mark Chou , Andres Alvarado , Caner Hazirbas , Yatharth Saraf

Recent advances in text-to-speech (TTS) models show impressive speech naturalness and quality, yet the role of large-scale open data in driving this progress remains underexplored. In this work, we introduce Raon-OpenTTS, an open TTS model…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-21 Semin Kim , Seungjun Chung , Taehong Moon , Sangheon Lee , Minyoung Ahn , Keon Lee , Nam Soo Kim , Jaewoong Cho , Ludwig Schmidt , Kangwook Lee , Dongmin Park

Transformer-based text to speech (TTS) model (e.g., Transformer TTS~\cite{li2019neural}, FastSpeech~\cite{ren2019fastspeech}) has shown the advantages of training and inference efficiency over RNN-based model (e.g.,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-04 Mingjian Chen , Xu Tan , Yi Ren , Jin Xu , Hao Sun , Sheng Zhao , Tao Qin , Tie-Yan Liu

This paper presents TTSOps, a fully automated closed-loop framework for constructing multi-speaker text-to-speech (TTS) systems from noisy, uncurated web-scale speech data, often referred to as ``dark data,'' such as online videos.…

Sound · Computer Science 2025-11-12 Kentaro Seki , Shinnosuke Takamichi , Takaaki Saeki , Hiroshi Saruwatari

Modern text-to-speech (TTS) systems use deep learning to synthesize speech increasingly approaching human quality, but they require a database of high quality audio-text sentence pairs for training. Malayalam, the official language of the…

Sound · Computer Science 2022-11-24 Deepa P Gopinath , Thennal D K , Vrinda V Nair , Swaraj K S , Sachin G

Recently, there has been a growing interest in the field of controllable Text-to-Speech (TTS). While previous studies have relied on users providing specific style factor values based on acoustic knowledge or selecting reference speeches…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-26 Shengpeng Ji , Jialong Zuo , Minghui Fang , Ziyue Jiang , Feiyang Chen , Xinyu Duan , Baoxing Huai , Zhou Zhao

Automatic speech recognition (ASR) performs well for high-resource languages with abundant paired audio-transcript data, but its accuracy degrades sharply for most languages due to limited publicly available aligned data. To this end, we…

Computation and Language · Computer Science 2026-05-12 Antonis Asonitis , Luca A. Lanzendörfer , Frédéric Berdoz , Roger Wattenhofer

Spoken dialogue generation is crucial for applications like podcasts, dynamic commentary, and entertainment content, but poses significant challenges compared to single-utterance text-to-speech (TTS). Key requirements include accurate…

Comparing with traditional text-to-speech (TTS) systems, conversational TTS systems are required to synthesize speeches with proper speaking style confirming to the conversational context. However, state-of-the-art context modeling methods…

Sound · Computer Science 2022-04-01 Jingbei Li , Yi Meng , Chenyi Li , Zhiyong Wu , Helen Meng , Chao Weng , Dan Su