English
Related papers

Related papers: MAGIC-TTS: Fine-Grained Controllable Speech Synthe…

200 papers

Text-to-speech (TTS) has shown great progress in recent years. However, most existing TTS systems offer only coarse and rigid emotion control, typically via discrete emotion labels or a carefully crafted and detailed emotional text prompt,…

Sound · Computer Science 2025-10-28 Tianxin Xie , Shan Yang , Chenxing Li , Dong Yu , Li Liu

Incremental text-to-speech (TTS) synthesis generates utterances in small linguistic units for the sake of real-time and low-latency applications. We previously proposed an incremental TTS method that leverages a large pre-trained language…

Sound · Computer Science 2021-09-23 Takaaki Saeki , Shinnosuke Takamichi , Hiroshi Saruwatari

Accented text-to-speech (TTS) synthesis seeks to generate speech with an accent (L2) as a variant of the standard version (L1). Accented TTS synthesis is challenging as L2 is different from L1 in both in terms of phonetic rendering and…

Sound · Computer Science 2022-09-23 Rui Liu , Berrak Sisman , Guanglai Gao , Haizhou Li

Scaling text-to-speech to a large and wild dataset has been proven to be highly effective in achieving timbre and speech style generalization, particularly in zero-shot TTS. However, previous works usually encode speech into latent using…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-07 Ziyue Jiang , Yi Ren , Zhenhui Ye , Jinglin Liu , Chen Zhang , Qian Yang , Shengpeng Ji , Rongjie Huang , Chunfeng Wang , Xiang Yin , Zejun Ma , Zhou Zhao

Token-based text-to-speech (TTS) models have emerged as a promising avenue for generating natural and realistic speech, yet they grapple with low pronunciation accuracy, speaking style and timbre inconsistency, and a substantial need for…

Sound · Computer Science 2024-03-12 Chunhui Wang , Chang Zeng , Bowen Zhang , Ziyang Ma , Yefan Zhu , Zifeng Cai , Jian Zhao , Zhonglin Jiang , Yong Chen

While recent work in controllable text-to-audio (TTA) generation has achieved fine-grained control through timestamp conditioning, its scope remains limited by audio quality and input format. These models often suffer from poor audio…

Sound · Computer Science 2025-10-14 Zihao Zheng , Zeyu Xie , Xuenan Xu , Wen Wu , Chao Zhang , Mengyue Wu

Modern sequence to sequence neural TTS systems provide close to natural speech quality. Such systems usually comprise a network converting linguistic/phonetic features sequence to an acoustic features sequence, cascaded with a neural…

Audio and Speech Processing · Electrical Eng. & Systems 2019-09-26 Slava Shechtman , Alex Sorin

This technical report presents MOSS-TTS, a speech generation foundation model built on a scalable recipe: discrete audio tokens, autoregressive modeling, and large-scale pretraining. Built on MOSS-Audio-Tokenizer, a causal Transformer…

This work proposes GLM-TTS, a production-level TTS system designed for efficiency, controllability, and high-fidelity speech generation. GLM-TTS follows a two-stage architecture, consisting of a text-to-token autoregressive model and a…

Spontaneous speech has many affective and pragmatic functions that are interesting and challenging to model in TTS. However, the presence of reduced articulation, fillers, repetitions, and other disfluencies in spontaneous speech make the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-02 Harm Lameris , Shivam Mehta , Gustav Eje Henter , Joakim Gustafson , Éva Székely

Neural Text-to-Speech (TTS) systems find broad applications in voice assistants, e-learning, and audiobook creation. The pursuit of modern models, like Diffusion Models (DMs), holds promise for achieving high-fidelity, real-time speech…

Sound · Computer Science 2024-04-02 Xiang Li , Fan Bu , Ambuj Mehrish , Yingting Li , Jiale Han , Bo Cheng , Soujanya Poria

This letter presents an incremental text-to-speech (TTS) method that performs synthesis in small linguistic units while maintaining the naturalness of output speech. Incremental TTS is generally subject to a trade-off between latency and…

Sound · Computer Science 2021-05-26 Takaaki Saeki , Shinnosuke Takamichi , Hiroshi Saruwatari

Test-time scaling (TTS) has enhanced the performance of Reasoning Models (RMs) on various tasks such as math and coding, yet its efficacy in machine translation (MT) remains underexplored. This paper investigates whether increased…

Computation and Language · Computer Science 2026-01-13 Zihao Li , Shaoxiong Ji , Jörg Tiedemann

We propose a novel description-based controllable text-to-speech (TTS) method with cross-lingual control capability. To address the lack of audio-description paired data in the target language, we combine a TTS model trained on the target…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-27 Ryuichi Yamamoto , Yuma Shirahata , Masaya Kawamura , Kentaro Tachibana

Stuttering is a speech disorder where the natural flow of speech is interrupted by blocks, repetitions or prolongations of syllables, words and phrases. The majority of existing automatic speech recognition (ASR) interfaces perform poorly…

We introduce StyleFusion-TTS, a prompt and/or audio referenced, style and speaker-controllable, zero-shot text-to-speech (TTS) synthesis system designed to enhance the editability and naturalness of current research literature. We propose a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-25 Zhiyong Chen , Xinnuo Li , Zhiqi Ai , Shugong Xu

Controllable text-to-speech (TTS) systems face significant challenges in achieving independent manipulation of speaker timbre and speaking style, often suffering from entanglement between these attributes. We present DMP-TTS, a latent…

Sound · Computer Science 2025-12-11 Kang Yin , Chunyu Qiang , Sirui Zhao , Xiaopeng Wang , Yuzhe Liang , Pengfei Cai , Tong Xu , Chen Zhang , Enhong Chen

We introduce Matcha-TTS, a new encoder-decoder architecture for speedy TTS acoustic modelling, trained using optimal-transport conditional flow matching (OT-CFM). This yields an ODE-based decoder capable of high output quality in fewer…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-11 Shivam Mehta , Ruibo Tu , Jonas Beskow , Éva Székely , Gustav Eje Henter

While generative text-to-speech (TTS) models approach human-level quality, monolithic metrics fail to diagnose fine-grained acoustic artifacts or explain perceptual collapse. To address this, we propose TTS-PRISM, a multi-dimensional…

Computation and Language · Computer Science 2026-04-27 Xi Wang , Jie Wang , Xingchen Song , Baijun Song , Jingran Xie , Jiahe Shao , Zijian Lin , Di Wu , Meng Meng , Jian Luan , Zhiyong Wu

Speaker-adaptive Text-to-Speech (TTS) synthesis has attracted considerable attention due to its broad range of applications, such as personalized voice assistant services. While several approaches have been proposed, they often exhibit high…

Sound · Computer Science 2024-12-31 Wooseok Han , Minki Kang , Changhun Kim , Eunho Yang