中文
相关论文

相关论文: Conditional Variational Autoencoder with Adversari…

200 篇论文

This study aims at designing an environment-aware text-to-speech (TTS) system that can generate speech to suit specific acoustic environments. It is also motivated by the desire to leverage massive data of speech audio from heterogeneous…

音频与语音处理 · 电气工程与系统科学 2022-08-09 Daxin Tan , Guangyan Zhang , Tan Lee

Purpose: This work explores the use of external phrase break prediction models to enhance listener comprehension in End-to-End Text-to-Speech (TTS) systems. Methods: The effectiveness of these models is evaluated based on listener…

音频与语音处理 · 电气工程与系统科学 2025-01-31 Anandaswarup Vadapalli

Incremental text-to-speech (TTS) synthesis generates utterances in small linguistic units for the sake of real-time and low-latency applications. We previously proposed an incremental TTS method that leverages a large pre-trained language…

声音 · 计算机科学 2021-09-23 Takaaki Saeki , Shinnosuke Takamichi , Hiroshi Saruwatari

This paper proposes a neural sequence-to-sequence text-to-speech (TTS) model which can control latent attributes in the generated speech that are rarely annotated in the training data, such as speaking style, accent, background noise, and…

End-to-end text-to-speech synthesis systems achieved immense success in recent times, with improved naturalness and intelligibility. However, the end-to-end models, which primarily depend on the attention-based alignment, do not offer an…

音频与语音处理 · 电气工程与系统科学 2021-10-07 Giridhar Pamisetty , K. Sri Rama Murty

Multi-speaker text-to-speech (TTS) using a few adaption data is a challenge in practical applications. To address that, we propose a zero-shot multi-speaker TTS, named nnSpeech, that could synthesis a new speaker voice without fine-tuning…

声音 · 计算机科学 2022-02-23 Botao Zhao , Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

To simplify the generation process, several text-to-speech (TTS) systems implicitly learn intermediate latent representations instead of relying on predefined features (e.g., mel-spectrogram). However, their generation quality is…

声音 · 计算机科学 2023-08-29 Hyungchan Yoon , Seyun Um , Changwhan Kim , Hong-Goo Kang

This paper proposes a controllable end-to-end text-to-speech (TTS) system to control the speaking speed (speed-controllable TTS; SCTTS) of synthesized speech with sentence-level speaking-rate value as an additional input. The speaking-rate…

音频与语音处理 · 电气工程与系统科学 2020-08-14 Jae-Sung Bae , Hanbin Bae , Young-Sun Joo , Junmo Lee , Gyeong-Hoon Lee , Hoon-Young Cho

We propose a novel training algorithm for a multi-speaker neural text-to-speech (TTS) model based on multi-task adversarial training. A conventional generative adversarial network (GAN)-based training algorithm significantly improves the…

声音 · 计算机科学 2022-09-27 Yusuke Nakai , Yuki Saito , Kenta Udagawa , Hiroshi Saruwatari

We aim to characterize how different speakers contribute to the perceived output quality of multi-speaker Text-to-Speech (TTS) synthesis. We automatically rate the quality of TTS using a neural network (NN) trained on human mean opinion…

计算与语言 · 计算机科学 2020-04-28 Jennifer Williams , Joanna Rownicka , Pilar Oplustil , Simon King

This letter presents an incremental text-to-speech (TTS) method that performs synthesis in small linguistic units while maintaining the naturalness of output speech. Incremental TTS is generally subject to a trade-off between latency and…

声音 · 计算机科学 2021-05-26 Takaaki Saeki , Shinnosuke Takamichi , Hiroshi Saruwatari

This paper presents an accented text-to-speech (TTS) synthesis framework with limited training data. We study two aspects concerning accent rendering: phonetic (phoneme difference) and prosodic (pitch pattern and phoneme duration)…

音频与语音处理 · 电气工程与系统科学 2023-05-09 Xuehao Zhou , Mingyang Zhang , Yi Zhou , Zhizheng Wu , Haizhou Li

We describe an end-to-end speech synthesis system that uses generative adversarial training. We train our Vocoder for raw phoneme-to-audio conversion, using explicit phonetic, pitch and duration modeling. We experiment with several…

机器学习 · 计算机科学 2023-10-17 Tiberiu Boros , Stefan Daniel Dumitrescu , Ionut Mironica , Radu Chivereanu

Although text-to-speech (TTS) systems have significantly improved, most TTS systems still have limitations in synthesizing speech with appropriate phrasing. For natural speech synthesis, it is important to synthesize the speech with a…

音频与语音处理 · 电气工程与系统科学 2023-06-14 Ji-Sang Hwang , Sang-Hoon Lee , Seong-Whan Lee

Whilst recent neural text-to-speech (TTS) approaches produce high-quality speech, they typically require a large amount of recordings from the target speaker. In previous work, a 3-step method was proposed to generate high-quality TTS while…

Text-to-Speech (TTS) system is a system where speech is synthesized from a given text following any particular approach. Concatenative synthesis, Hidden Markov Model (HMM) based synthesis, Deep Learning (DL) based synthesis with multiple…

声音 · 计算机科学 2021-08-03 Prithwiraj Bhattacharjee , Rajan Saha Raju , Arif Ahmad , M. Shahidur Rahman

Although recent neural text-to-speech (TTS) systems have achieved high-quality speech synthesis, there are cases where a TTS system generates low-quality speech, mainly caused by limited training data or information loss during knowledge…

音频与语音处理 · 电气工程与系统科学 2022-05-26 Yeunju Choi , Youngmoon Jung , Youngjoo Suh , Hoirin Kim

Modern text-to-speech (TTS) systems are able to generate audio that sounds almost as natural as human speech. However, the bar of developing high-quality TTS systems remains high since a sizable set of studio-quality <text, audio> pairs is…

计算与语言 · 计算机科学 2019-06-19 Wei Fang , Yu-An Chung , James Glass

Many recently published Text-to-Speech (TTS) systems produce audio close to real speech. However, TTS evaluation needs to be revisited to make sense of the results obtained with the new architectures, approaches and datasets. We propose…

音频与语音处理 · 电气工程与系统科学 2024-12-03 Christoph Minixhofer , Ondřej Klejch , Peter Bell

In neural text-to-speech (TTS), two-stage system or a cascade of separately learned models have shown synthesis quality close to human speech. For example, FastSpeech2 transforms an input text to a mel-spectrogram and then HiFi-GAN…

音频与语音处理 · 电气工程与系统科学 2022-07-05 Dan Lim , Sunghee Jung , Eesung Kim