中文
相关论文

相关论文: FPETS : Fully Parallel End-to-End Text-to-Speech S…

200 篇论文

This letter presents an incremental text-to-speech (TTS) method that performs synthesis in small linguistic units while maintaining the naturalness of output speech. Incremental TTS is generally subject to a trade-off between latency and…

声音 · 计算机科学 2021-05-26 Takaaki Saeki , Shinnosuke Takamichi , Hiroshi Saruwatari

Different languages have distinct phonetic systems and vary in their prosodic features making it challenging to develop a Text-to-Speech (TTS) model that can effectively synthesise speech in multilingual settings. Furthermore, TTS…

计算与语言 · 计算机科学 2024-06-26 Yingting Li , Ambuj Mehrish , Bryan Chew , Bo Cheng , Soujanya Poria

We propose a novel text-to-speech (TTS) framework centered around a neural transducer. Our approach divides the whole TTS pipeline into semantic-level sequence-to-sequence (seq2seq) modeling and fine-grained acoustic modeling stages,…

音频与语音处理 · 电气工程与系统科学 2024-10-28 Minchan Kim , Myeonghun Jeong , Byoung Jin Choi , Semin Kim , Joun Yeop Lee , Nam Soo Kim

We introduce a text-to-speech(TTS) framework based on a neural transducer. We use discretized semantic tokens acquired from wav2vec2.0 embeddings, which makes it easy to adopt a neural transducer for the TTS framework enjoying its monotonic…

音频与语音处理 · 电气工程与系统科学 2023-11-09 Minchan Kim , Myeonghun Jeong , Byoung Jin Choi , Dongjune Lee , Nam Soo Kim

We present F5R-TTS, a novel text-to-speech (TTS) system that integrates Group Relative Policy Optimization (GRPO) into a flow-matching based architecture. By reformulating the deterministic outputs of flow-matching TTS into probabilistic…

声音 · 计算机科学 2025-04-23 Xiaohui Sun , Ruitong Xiao , Jianye Mo , Bowen Wu , Qun Yu , Baoxun Wang

Current text-to-speech (TTS) models face a persistent limitation: autoregressive (AR) models suffer from low generation efficiency, while modern non-autoregressive (NAR) models experience high latency due to their unordered temporal nature.…

声音 · 计算机科学 2026-03-17 Zhengyan Sheng , Zhihao Du , Shiliang Zhang , Zhijie Yan , Liping Chen

This research paper presents a comprehensive review-based study on various Text-to-Speech (TTS) technologies. TTS technology is an important aspect of human-computer interaction, enabling machines to convert written text into audible…

声音 · 计算机科学 2023-12-20 Md. Jalal Uddin Chowdhury , Ashab Hussan

Recent parallel neural text-to-speech (TTS) synthesis methods are able to generate speech with high fidelity while maintaining high performance. However, these systems often lack control over the output prosody, thus restricting the…

音频与语音处理 · 电气工程与系统科学 2022-03-30 Shreyas Seshadri , Tuomo Raitio , Dan Castellani , Jiangchuan Li

The end-to-end TTS, which can predict speech directly from a given sequence of graphemes or phonemes, has shown improved performance over the conventional TTS. However, its predicting capability is still limited by the acoustic/phonetic…

计算与语言 · 计算机科学 2019-04-10 Haohan Guo , Frank K. Soong , Lei He , Lei Xie

Incremental text-to-speech, also known as streaming TTS, has been increasingly applied to online speech applications that require ultra-low response latency to provide an optimal user experience. However, most of the existing speech…

声音 · 计算机科学 2022-12-06 Muyang Du , Chuan Liu , Jiaxing Qi , Junjie Lai

We propose Easy End-to-End Diffusion-based Text to Speech, a simple and efficient end-to-end text-to-speech model based on diffusion. E3 TTS directly takes plain text as input and generates an audio waveform through an iterative refinement…

声音 · 计算机科学 2023-11-03 Yuan Gao , Nobuyuki Morioka , Yu Zhang , Nanxin Chen

Recent language model-based text-to-speech (TTS) frameworks demonstrate scalability and in-context learning capabilities. However, they suffer from robustness issues due to the accumulation of errors in speech unit predictions during…

音频与语音处理 · 电气工程与系统科学 2024-06-13 Kun Zhou , Shengkui Zhao , Yukun Ma , Chong Zhang , Hao Wang , Dianwen Ng , Chongjia Ni , Nguyen Trung Hieu , Jia Qi Yip , Bin Ma

Text to speech (TTS), or speech synthesis, which aims to synthesize intelligible and natural speech given text, is a hot research topic in speech, language, and machine learning communities and has broad applications in the industry. As the…

音频与语音处理 · 电气工程与系统科学 2021-07-26 Xu Tan , Tao Qin , Frank Soong , Tie-Yan Liu

In this paper, we propose a text-to-speech (TTS)-driven data augmentation method for improving the quality of a non-autoregressive (AR) TTS system. Recently proposed non-AR models, such as FastSpeech 2, have successfully achieved fast…

音频与语音处理 · 电气工程与系统科学 2020-10-27 Min-Jae Hwang , Ryuichi Yamamoto , Eunwoo Song , Jae-Min Kim

Emotional Text-to-Speech (E-TTS) synthesis has garnered significant attention in recent years due to its potential to revolutionize human-computer interaction. However, current E-TTS approaches often struggle to capture the intricacies of…

计算与语言 · 计算机科学 2025-02-20 Zhi-Qi Cheng , Xiang Li , Jun-Yan He , Junyao Chen , Xiaomao Fan , Xiaojiang Peng , Alexander G. Hauptmann

Incremental text-to-speech (TTS) synthesis generates utterances in small linguistic units for the sake of real-time and low-latency applications. We previously proposed an incremental TTS method that leverages a large pre-trained language…

声音 · 计算机科学 2021-09-23 Takaaki Saeki , Shinnosuke Takamichi , Hiroshi Saruwatari

Recent advances in neural multi-speaker text-to-speech (TTS) models have enabled the generation of reasonably good speech quality with a single model and made it possible to synthesize the speech of a speaker with limited training data.…

音频与语音处理 · 电气工程与系统科学 2021-06-30 Jinhyeok Yang , Jae-Sung Bae , Taejun Bak , Youngik Kim , Hoon-Young Cho

Text-to-speech (TTS) systems have seen significant advancements in recent years, driven by improvements in deep learning and neural network architectures. Viewing the output speech as a data distribution, previous approaches often employ…

We introduce a technique for augmenting neural text-to-speech (TTS) with lowdimensional trainable speaker embeddings to generate different voices from a single model. As a starting point, we show improvements over the two state-ofthe-art…

计算与语言 · 计算机科学 2017-09-22 Sercan Arik , Gregory Diamos , Andrew Gibiansky , John Miller , Kainan Peng , Wei Ping , Jonathan Raiman , Yanqi Zhou

Data availability is crucial for advancing artificial intelligence applications, including voice-based technologies. As content creation, particularly in social media, experiences increasing demand, translation and text-to-speech (TTS)…

音频与语音处理 · 电气工程与系统科学 2024-02-27 Ahmet Gunduz , Kamer Ali Yuksel , Kareem Darwish , Golara Javadi , Fabio Minazzi , Nicola Sobieski , Sebastien Bratieres