English
Related papers

Related papers: StyleTTS: A Style-Based Generative Model for Natur…

200 papers

We present ParrotTTS, a modularized text-to-speech synthesis model leveraging disentangled self-supervised speech representations. It can train a multi-speaker variant effectively using transcripts from a single speaker. ParrotTTS adapts to…

Computation and Language · Computer Science 2023-12-19 Neil Shah , Saiteja Kosgi , Vishal Tambrahalli , Neha Sahipjohn , Niranjan Pedanekar , Vineet Gandhi

This paper presents an accented text-to-speech (TTS) synthesis framework with limited training data. We study two aspects concerning accent rendering: phonetic (phoneme difference) and prosodic (pitch pattern and phoneme duration)…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-09 Xuehao Zhou , Mingyang Zhang , Yi Zhou , Zhizheng Wu , Haizhou Li

This paper aims to build a multi-speaker expressive TTS system, synthesizing a target speaker's speech with multiple styles and emotions. To this end, we propose a novel contrastive learning-based TTS approach to transfer style and emotion…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-26 Xinfa Zhu , Yuke Li , Yi Lei , Ning Jiang , Guoqing Zhao , Lei Xie

Most existing text-to-speech (TTS) systems either synthesize speech sentence by sentence and stitch the results together, or drive synthesis from plain-text dialogues alone. Both approaches leave models with little understanding of global…

While recent text to speech (TTS) models perform very well in synthesizing reading-style (e.g., audiobook) speech, it is still challenging to synthesize spontaneous-style speech (e.g., podcast or conversation), mainly because of two…

Sound · Computer Science 2021-07-07 Yuzi Yan , Xu Tan , Bohan Li , Guangyan Zhang , Tao Qin , Sheng Zhao , Yuan Shen , Wei-Qiang Zhang , Tie-Yan Liu

We introduce SupertonicTTS, a novel text-to-speech (TTS) system designed for efficient and streamlined speech synthesis. SupertonicTTS comprises three components: a speech autoencoder for continuous latent representation, a text-to-latent…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-24 Hyeongju Kim , Jinhyeok Yang , Yechan Yu , Seunghun Ji , Jacob Morton , Frederik Bous , Joon Byun , Juheon Lee

The recent text-to-speech (TTS) has achieved quality comparable to that of humans; however, its application in spoken dialogue has not been widely studied. This study aims to realize a TTS that closely resembles human dialogue. First, we…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-27 Kentaro Mitsui , Tianyu Zhao , Kei Sawada , Yukiya Hono , Yoshihiko Nankaku , Keiichi Tokuda

Unlike human speakers, typical text-to-speech (TTS) systems are unable to produce multiple distinct renditions of a given sentence. This has previously been addressed by adding explicit external control. In contrast, generative models are…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-04 Zack Hodari , Oliver Watts , Simon King

To further improve the speaking styles of synthesized speeches, current text-to-speech (TTS) synthesis systems commonly employ reference speeches to stylize their outputs instead of just the input texts. These reference speeches are…

Sound · Computer Science 2023-08-31 Yi Meng , Xiang Li , Zhiyong Wu , Tingtian Li , Zixun Sun , Xinyu Xiao , Chi Sun , Hui Zhan , Helen Meng

Neural Text-to-speech (TTS) synthesis is a powerful technology that can generate speech using neural networks. One of the most remarkable features of TTS synthesis is its capability to produce speech in the voice of different speakers. This…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-19 Vinotha R , Hepsiba D , L. D. Vijay Anand , Deepak John Reji

Text-to-speech (TTS) synthesis is a technology that converts written text into spoken words, enabling a natural and accessible means of communication. This abstract explores the key aspects of TTS synthesis, encompassing its underlying…

Software Engineering · Computer Science 2024-01-26 Harini s , Manoj G M

This paper presents SelfTTS, a text-to-speech (TTS) model designed for cross-speaker style transfer that eliminates the need for external pre-trained speaker or emotion encoders. The architecture achieves emotional expressivity in neutral…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-24 Lucas H. Ueda , João G. T. Lima , Pedro R. Corrêa , Flávio O. Simões , Mário U. Neto , Paula D. P. Costa

Recent Text-to-Speech (TTS) systems trained on reading or acted corpora have achieved near human-level naturalness. The diversity of human speech, however, often goes beyond the coverage of these corpora. We believe the ability to handle…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-09 Li-Wei Chen , Shinji Watanabe , Alexander Rudnicky

Neural network based end-to-end Text-to-Speech (TTS) has greatly improved the quality of synthesized speech. While how to use massive spontaneous speech without transcription efficiently still remains an open problem. In this paper, we…

Sound · Computer Science 2022-02-07 Dabiao Ma , Yitong Zhang , Meng Li , Feng Ye

Zero-shot Text-to-Speech (TTS) has recently advanced significantly, enabling models to synthesize speech from text using short, limited-context prompts. These prompts serve as voice exemplars, allowing the model to mimic speaker identity,…

Sound · Computer Science 2025-10-06 Hieu-Nghia Huynh-Nguyen , Huynh Nguyen Dang , Ngoc-Son Nguyen , Van Nguyen

This paper proposes a neural sequence-to-sequence text-to-speech (TTS) model which can control latent attributes in the generated speech that are rarely annotated in the training data, such as speaking style, accent, background noise, and…

Computation and Language · Computer Science 2018-12-31 Wei-Ning Hsu , Yu Zhang , Ron J. Weiss , Heiga Zen , Yonghui Wu , Yuxuan Wang , Yuan Cao , Ye Jia , Zhifeng Chen , Jonathan Shen , Patrick Nguyen , Ruoming Pang

Expressive Text-to-Speech (TTS) using reference speech has been studied extensively to synthesize natural speech, but there are limitations to obtaining well-represented styles and improving model generalization ability. In this study, we…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-28 Hyun Joon Park , Jin Sob Kim , Wooseok Shin , Sung Won Han

Text-to-speech synthesis (TTS) is a task to convert texts into speech. Two of the factors that have been driving TTS are the advancements of probabilistic models and latent representation learning. We propose a TTS method based on latent…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-19 Yusuke Yasuda , Tomoki Toda

Controlling the style and characteristics of speech synthesis is crucial for adapting the output to specific contexts and user requirements. Previous Text-to-speech (TTS) works have focused primarily on the technical aspects of producing…

Sound · Computer Science 2025-09-04 Jiawei Zhang , Tian-Hao Zhang , Jun Wang , Jiaran Gao , Xinyuan Qian , Xu-Cheng Yin

Incorporating cross-speaker style transfer in text-to-speech (TTS) models is challenging due to the need to disentangle speaker and style information in audio. In low-resource expressive data scenarios, voice conversion (VC) can generate…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-27 Lucas H. Ueda , Leonardo B. de M. M. Marques , Flávio O. Simões , Mário U. Neto , Fernando Runstein , Bianca Dal Bó , Paula D. P. Costa