English
Related papers

Related papers: Multi-interaction TTS toward professional recordin…

200 papers

This paper explores multi-modal controllable Text-to-Speech Synthesis (TTS) where the voice can be generated from face image, and the characteristics of output speech (e.g., pace, noise level, distance, tone, place) can be controllable with…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-27 Minsu Kim , Pingchuan Ma , Honglie Chen , Stavros Petridis , Maja Pantic

Controllable TTS models with natural language prompts often lack the ability for fine-grained control and face a scarcity of high-quality data. We propose a two-stage style-controllable TTS system with language models, utilizing a quantized…

Multimedia · Computer Science 2025-06-04 Yongqi Wang , Chunlei Zhang , Hangting Chen , Zhou Zhao , Dong Yu

Text-to-speech (TTS) synthesis is a technology that converts written text into spoken words, enabling a natural and accessible means of communication. This abstract explores the key aspects of TTS synthesis, encompassing its underlying…

Software Engineering · Computer Science 2024-01-26 Harini s , Manoj G M

In recent years, Text-To-Speech (TTS) has been used as a data augmentation technique for speech recognition to help complement inadequacies in the training data. Correspondingly, we investigate the use of a multi-speaker TTS system to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-25 Yiling Huang , Yutian Chen , Jason Pelecanos , Quan Wang

With the similarity between music and speech synthesis from symbolic input and the rapid development of text-to-speech (TTS) techniques, it is worthwhile to explore ways to improve the MIDI-to-audio performance by borrowing from TTS…

Sound · Computer Science 2023-03-22 Xuan Shi , Erica Cooper , Xin Wang , Junichi Yamagishi , Shrikanth Narayanan

Neural text-to-speech (TTS) can provide quality close to natural speech if an adequate amount of high-quality speech material is available for training. However, acquiring speech data for TTS training is costly and time-consuming,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-29 Tuomo Raitio , Javier Latorre , Andrea Davis , Tuuli Morrill , Ladan Golipour

In recent years, there has been significant progress in Text-to-Speech (TTS) synthesis technology, enabling the high-quality synthesis of voices in common scenarios. In unseen situations, adaptive TTS requires a strong generalization…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-10 Zhipeng Li , Xiaofen Xing , Jun Wang , Shuaiqi Chen , Guoqiao Yu , Guanglu Wan , Xiangmin Xu

This letter presents an incremental text-to-speech (TTS) method that performs synthesis in small linguistic units while maintaining the naturalness of output speech. Incremental TTS is generally subject to a trade-off between latency and…

Sound · Computer Science 2021-05-26 Takaaki Saeki , Shinnosuke Takamichi , Hiroshi Saruwatari

The recent text-to-speech (TTS) has achieved quality comparable to that of humans; however, its application in spoken dialogue has not been widely studied. This study aims to realize a TTS that closely resembles human dialogue. First, we…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-27 Kentaro Mitsui , Tianyu Zhao , Kei Sawada , Yukiya Hono , Yoshihiko Nankaku , Keiichi Tokuda

In this project, we aim to build a Text-to-Speech system able to produce speech with a controllable emotional expressiveness. We propose a methodology for solving this problem in three main steps. The first is the collection of emotional…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-08 Noé Tits

Text-to-Speech (TTS) has recently seen great progress in synthesizing high-quality speech owing to the rapid development of parallel TTS systems, but producing speech with naturalistic prosodic variations, speaking styles and emotional…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-21 Yinghao Aaron Li , Cong Han , Nima Mesgarani

Text-to-speech (TTS) synthesis is the process of producing synthesized speech from text or phoneme input. Traditional TTS models contain multiple processing steps and require external aligners, which provide attention alignments of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-08 Hyunseung Chung , Sang-Hoon Lee , Seong-Whan Lee

This paper aims to build a multi-speaker expressive TTS system, synthesizing a target speaker's speech with multiple styles and emotions. To this end, we propose a novel contrastive learning-based TTS approach to transfer style and emotion…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-26 Xinfa Zhu , Yuke Li , Yi Lei , Ning Jiang , Guoqing Zhao , Lei Xie

With the popularity of deep neural network, speech synthesis task has achieved significant improvements based on the end-to-end encoder-decoder framework in the recent days. More and more applications relying on speech synthesis technology…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-23 Dongyang Dai , Li Chen , Yuping Wang , Mu Wang , Rui Xia , Xuchen Song , Zhiyong Wu , Yuxuan Wang

Deep learning models are becoming predominant in many fields of machine learning. Text-to-Speech (TTS), the process of synthesizing artificial speech from text, is no exception. To this end, a deep neural network is usually trained using a…

Sound · Computer Science 2021-02-11 Giuseppe Ruggiero , Enrico Zovato , Luigi Di Caro , Vincent Pollet

Accented text-to-speech (TTS) synthesis seeks to generate speech with an accent (L2) as a variant of the standard version (L1). Accented TTS synthesis is challenging as L2 is different from L1 in both in terms of phonetic rendering and…

Sound · Computer Science 2022-09-23 Rui Liu , Berrak Sisman , Guanglai Gao , Haizhou Li

State-of-the-art Text-To-Speech (TTS) models are capable of producing high-quality speech. The generated speech, however, is usually neutral in emotional expression, whereas very often one would want fine-grained emotional control of words…

Sound · Computer Science 2023-03-14 Shijun Wang , Jón Guðnason , Damian Borth

Conversational text-to-speech (TTS) aims to synthesize speech with proper prosody of reply based on the historical conversation. However, it is still a challenge to comprehensively model the conversation, and a majority of conversational…

Sound · Computer Science 2023-05-04 Jinlong Xue , Yayue Deng , Fengping Wang , Ya Li , Yingming Gao , Jianhua Tao , Jianqing Sun , Jiaen Liang

Artificial speech synthesis has made a great leap in terms of naturalness as recent Text-to-Speech (TTS) systems are capable of producing speech with similar quality to human recordings. However, not all speaking styles are easy to model:…

While recent neural text-to-speech (TTS) systems perform remarkably well, they typically require a substantial amount of recordings from the target speaker reading in the desired speaking style. In this work, we present a novel 3-step…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-03 Goeric Huybrechts , Thomas Merritt , Giulia Comini , Bartek Perz , Raahil Shah , Jaime Lorenzo-Trueba
‹ Prev 1 2 3 10 Next ›