English
Related papers

Related papers: Emphasis control for parallel neural TTS

200 papers

Conversational text-to-speech (TTS) aims to synthesize speech with proper prosody of reply based on the historical conversation. However, it is still a challenge to comprehensively model the conversation, and a majority of conversational…

Sound · Computer Science 2023-05-04 Jinlong Xue , Yayue Deng , Fengping Wang , Ya Li , Yingming Gao , Jianhua Tao , Jianqing Sun , Jiaen Liang

This paper describes a novel text-to-speech (TTS) technique based on deep convolutional neural networks (CNN), without use of any recurrent units. Recurrent neural networks (RNN) have become a standard technique to model sequential data…

Sound · Computer Science 2020-10-01 Hideyuki Tachibana , Katsuya Uenoyama , Shunsuke Aihara

Generating expressive and contextually appropriate prosody remains a challenge for modern text-to-speech (TTS) systems. This is particularly evident for long, multi-sentence inputs. In this paper, we examine simple extensions to a…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-30 Peter Makarov , Ammar Abbas , Mateusz Łajszczak , Arnaud Joly , Sri Karlapati , Alexis Moinet , Thomas Drugman , Penny Karanasou

We aim to characterize how different speakers contribute to the perceived output quality of multi-speaker Text-to-Speech (TTS) synthesis. We automatically rate the quality of TTS using a neural network (NN) trained on human mean opinion…

Computation and Language · Computer Science 2020-04-28 Jennifer Williams , Joanna Rownicka , Pilar Oplustil , Simon King

This paper proposes an effective emotion control method for an end-to-end text-to-speech (TTS) system. To flexibly control the distinct characteristic of a target emotion category, it is essential to determine embedding vectors representing…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-07 Se-Yun Um , Sangshin Oh , Kyungguen Byun , Inseon Jang , Chunghyun Ahn , Hong-Goo Kang

Emotional text-to-speech synthesis (TTS) aims to generate realistic emotional speech from input text. However, quantitatively controlling multi-level emotion rendering remains challenging. In this paper, we propose a flow-matching based…

Sound · Computer Science 2025-06-24 Sho Inoue , Kun Zhou , Shuai Wang , Haizhou Li

Syntactic structure of a sentence text is correlated with the prosodic structure of the speech that is crucial for improving the prosody and naturalness of a text-to-speech (TTS) system. Nowadays TTS systems usually try to incorporate…

Computation and Language · Computer Science 2020-12-15 Changhe Song , Jingbei Li , Yixuan Zhou , Zhiyong Wu , Helen Meng

Neural network based end-to-end Text-to-Speech (TTS) has greatly improved the quality of synthesized speech. While how to use massive spontaneous speech without transcription efficiently still remains an open problem. In this paper, we…

Sound · Computer Science 2022-02-07 Dabiao Ma , Yitong Zhang , Meng Li , Feng Ye

For text-to-speech (TTS) synthesis, prosodic structure prediction (PSP) plays an important role in producing natural and intelligible speech. Although inter-utterance linguistic information can influence the speech interpretation of the…

Sound · Computer Science 2023-09-01 Jie Chen , Changhe Song , Deyi Tuo , Xixin Wu , Shiyin Kang , Zhiyong Wu , Helen Meng

Recent language model-based text-to-speech (TTS) frameworks demonstrate scalability and in-context learning capabilities. However, they suffer from robustness issues due to the accumulation of errors in speech unit predictions during…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Kun Zhou , Shengkui Zhao , Yukun Ma , Chong Zhang , Hao Wang , Dianwen Ng , Chongjia Ni , Nguyen Trung Hieu , Jia Qi Yip , Bin Ma

Different languages have distinct phonetic systems and vary in their prosodic features making it challenging to develop a Text-to-Speech (TTS) model that can effectively synthesise speech in multilingual settings. Furthermore, TTS…

Computation and Language · Computer Science 2024-06-26 Yingting Li , Ambuj Mehrish , Bryan Chew , Bo Cheng , Soujanya Poria

Parallel test-time scaling (TTS) is a pivotal approach for enhancing large language models (LLMs), typically by sampling multiple token-based chains-of-thought in parallel and aggregating outcomes through voting or search. Recent advances…

Computation and Language · Computer Science 2026-04-21 Runyang You , Yongqi Li , Meng Liu , Wenjie Wang , Liqiang Nie , Wenjie Li

This research paper presents a comprehensive review-based study on various Text-to-Speech (TTS) technologies. TTS technology is an important aspect of human-computer interaction, enabling machines to convert written text into audible…

Sound · Computer Science 2023-12-20 Md. Jalal Uddin Chowdhury , Ashab Hussan

Conversational Text-to-Speech (CTTS) aims to accurately express an utterance with the appropriate style within a conversational setting, which attracts more attention nowadays. While recognizing the significance of the CTTS task, prior…

Computation and Language · Computer Science 2024-10-15 Rui Liu , Zhenqi Jia , Jie Yang , Yifan Hu , Haizhou Li

Controlling speaking style in text-to-speech (TTS) systems has become a growing focus in both academia and industry. While many existing approaches rely on reference audio to guide style generation, such methods are often impractical due to…

Sound · Computer Science 2025-10-22 Haowei Lou , Hye-Young Paik , Wen Hu , Lina Yao

Token-based text-to-speech (TTS) models have emerged as a promising avenue for generating natural and realistic speech, yet they grapple with low pronunciation accuracy, speaking style and timbre inconsistency, and a substantial need for…

Sound · Computer Science 2024-03-12 Chunhui Wang , Chang Zeng , Bowen Zhang , Ziyang Ma , Yefan Zhu , Zifeng Cai , Jian Zhao , Zhonglin Jiang , Yong Chen

Text-to-speech (TTS) methods have shown promising results in voice cloning, but they require a large number of labeled text-speech pairs. Minimally-supervised speech synthesis decouples TTS by combining two types of discrete speech…

Sound · Computer Science 2023-12-19 Chunyu Qiang , Hao Li , Yixin Tian , Yi Zhao , Ying Zhang , Longbiao Wang , Jianwu Dang

Pause insertion, also known as phrase break prediction and phrasing, is an essential part of TTS systems because proper pauses with natural duration significantly enhance the rhythm and intelligibility of synthetic speech. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-28 Dong Yang , Tomoki Koriyama , Yuki Saito , Takaaki Saeki , Detai Xin , Hiroshi Saruwatari

With the popularity of deep neural network, speech synthesis task has achieved significant improvements based on the end-to-end encoder-decoder framework in the recent days. More and more applications relying on speech synthesis technology…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-23 Dongyang Dai , Li Chen , Yuping Wang , Mu Wang , Rui Xia , Xuchen Song , Zhiyong Wu , Yuxuan Wang

This paper presents a simple yet effective method to achieve prosody transfer from a reference speech signal to synthesized speech. The main idea is to incorporate well-known acoustic correlates of prosody such as pitch and loudness…

Sound · Computer Science 2020-05-19 Siddharth Gururani , Kilol Gupta , Dhaval Shah , Zahra Shakeri , Jervis Pinto