English
Related papers

Related papers: VECL-TTS: Voice identity and Emotional style contr…

200 papers

While modern TTS technologies have made significant advancements in audio quality, there is still a lack of behavior naturalness compared to conversing with people. We propose a style-embedded TTS system that generates styled responses…

Sound · Computer Science 2020-09-23 Yang Gao , Weiyi Zheng , Zhaojun Yang , Thilo Kohler , Christian Fuegen , Qing He

With the demand for autonomous control and personalized speech generation, the style control and transfer in Text-to-Speech (TTS) is becoming more and more important. In this paper, we propose a new TTS system that can perform style…

Sound · Computer Science 2023-07-12 Wenhao Guan , Tao Li , Yishuang Li , Hukai Huang , Qingyang Hong , Lin Li

The goal of expressive Text-to-speech (TTS) is to synthesize natural speech with desired content, prosody, emotion, or timbre, in high expressiveness. Most of previous studies attempt to generate speech from given labels of styles and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-29 Jianhong Tu , Zeyu Cui , Xiaohuan Zhou , Siqi Zheng , Kai Hu , Ju Fan , Chang Zhou

Text-to-speech (TTS) has advanced from generating natural-sounding speech to enabling fine-grained control over attributes like emotion, timbre, and style. Driven by rising industrial demand and breakthroughs in deep learning, e.g.,…

Computation and Language · Computer Science 2025-08-26 Tianxin Xie , Yan Rong , Pengfei Zhang , Wenwu Wang , Li Liu

This paper presents a novel framework to build a voice conversion (VC) system by learning from a text-to-speech (TTS) synthesis system, that is called TTS-VC transfer learning. We first develop a multi-speaker speech synthesis system with…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-07 Mingyang Zhang , Yi Zhou , Li Zhao , Haizhou Li

Machine-generated speech is characterized by its limited or unnatural emotional variation. Current text to speech systems generates speech with either a flat emotion, emotion selected from a predefined set, average variation learned from…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-10 Sarath Sivaprasad , Saiteja Kosgi , Vineet Gandhi

Emotional Text-to-Speech (E-TTS) synthesis has garnered significant attention in recent years due to its potential to revolutionize human-computer interaction. However, current E-TTS approaches often struggle to capture the intricacies of…

Computation and Language · Computer Science 2025-02-20 Zhi-Qi Cheng , Xiang Li , Jun-Yan He , Junyao Chen , Xiaomao Fan , Xiaojiang Peng , Alexander G. Hauptmann

Recent advances in expressive text-to-speech (TTS) have introduced diverse methods based on style embedding extracted from reference speech. However, synthesizing high-quality expressive speech remains challenging. We propose Spotlight-TTS,…

Sound · Computer Science 2025-07-01 Nam-Gyu Kim , Deok-Hyeon Cho , Seung-Bin Kim , Seong-Whan Lee

Text-to-speech (TTS) systems are an important component in voice-based e-commerce applications. These applications include end-to-end voice assistant and customer experience (CX) voice bot. Code-mixed TTS is also relevant in these…

Machine Learning · Computer Science 2023-12-05 Raviraj Joshi , Nikesh Garera

The control of perceptual voice qualities in a text-to-speech (TTS) system is of interest for applications where unmanipu- lated and manipulated speech probes can serve to illustrate pho- netic concepts that are otherwise difficult to…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-10 Frederik Rautenberg , Fritz Seebauer , Jana Wiechmann , Michael Kuhlmann , Petra Wagner , Reinhold Haeb-Umbach

Recently, there has been a growing interest in the field of controllable Text-to-Speech (TTS). While previous studies have relied on users providing specific style factor values based on acoustic knowledge or selecting reference speeches…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-26 Shengpeng Ji , Jialong Zuo , Minghui Fang , Ziyue Jiang , Feiyang Chen , Xinyu Duan , Baoxing Huai , Zhou Zhao

While emotional text-to-speech (TTS) has made significant progress, most existing research remains limited to utterance-level emotional expression and fails to support word-level control. Achieving word-level expressive control poses…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-13 Tianrui Wang , Haoyu Wang , Meng Ge , Cheng Gong , Chunyu Qiang , Ziyang Ma , Zikang Huang , Guanrou Yang , Xiaobao Wang , Eng Siong Chng , Xie Chen , Longbiao Wang , Jianwu Dang

Accented text-to-speech (TTS) synthesis seeks to generate speech with an accent (L2) as a variant of the standard version (L1). Accented TTS synthesis is challenging as L2 is different from L1 in both in terms of phonetic rendering and…

Sound · Computer Science 2022-09-23 Rui Liu , Berrak Sisman , Guanglai Gao , Haizhou Li

Expressive text-to-speech (TTS) aims to synthesize different speaking style speech according to human's demands. Nowadays, there are two common ways to control speaking styles: (1) Pre-defining a group of speaking style and using…

Sound · Computer Science 2023-06-27 Dongchao Yang , Songxiang Liu , Rongjie Huang , Chao Weng , Helen Meng

Conversational text-to-speech (TTS) aims to synthesize speech with proper prosody of reply based on the historical conversation. However, it is still a challenge to comprehensively model the conversation, and a majority of conversational…

Sound · Computer Science 2023-05-04 Jinlong Xue , Yayue Deng , Fengping Wang , Ya Li , Yingming Gao , Jianhua Tao , Jianqing Sun , Jiaen Liang

Text-to-Speech (TTS) models have advanced significantly, aiming to accurately replicate human speech's diversity, including unique speaker identities and linguistic nuances. Despite these advancements, achieving an optimal balance between…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-28 Jinhyeok Yang , Junhyeok Lee , Hyeong-Seok Choi , Seunghun Ji , Hyeongju Kim , Juheon Lee

We explore cross-dialect text-to-speech (CD-TTS), a task to synthesize learned speakers' voices in non-native dialects, especially in pitch-accent languages. CD-TTS is important for developing voice agents that naturally communicate with…

Sound · Computer Science 2024-09-12 Kazuki Yamauchi , Yuki Saito , Hiroshi Saruwatari

Data augmentation via voice conversion (VC) has been successfully applied to low-resource expressive text-to-speech (TTS) when only neutral data for the target speaker are available. Although the quality of VC is crucial for this approach,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-06 Ryo Terashima , Ryuichi Yamamoto , Eunwoo Song , Yuma Shirahata , Hyun-Wook Yoon , Jae-Min Kim , Kentaro Tachibana

Emotional text-to-speech synthesis (TTS) aims to generate realistic emotional speech from input text. However, quantitatively controlling multi-level emotion rendering remains challenging. In this paper, we propose a flow-matching based…

Sound · Computer Science 2025-06-24 Sho Inoue , Kun Zhou , Shuai Wang , Haizhou Li

Different languages have distinct phonetic systems and vary in their prosodic features making it challenging to develop a Text-to-Speech (TTS) model that can effectively synthesise speech in multilingual settings. Furthermore, TTS…

Computation and Language · Computer Science 2024-06-26 Yingting Li , Ambuj Mehrish , Bryan Chew , Bo Cheng , Soujanya Poria