中文
相关论文

相关论文: Investigating context features hidden in End-to-En…

200 篇论文

Accented text-to-speech (TTS) synthesis seeks to generate speech with an accent (L2) as a variant of the standard version (L1). Accented TTS synthesis is challenging as L2 is different from L1 in both in terms of phonetic rendering and…

声音 · 计算机科学 2022-09-23 Rui Liu , Berrak Sisman , Guanglai Gao , Haizhou Li

We present a multi-speaker Japanese audiobook text-to-speech (TTS) system that leverages multimodal context information of preceding acoustic context and bilateral textual context to improve the prosody of synthetic speech. Previous work…

State-of-the-art text-to-speech (TTS) systems realize high naturalness in monolingual environments, synthesizing speech with correct multilingual accents (especially for Indic languages) and context-relevant emotions still poses difficulty…

机器学习 · 计算机科学 2025-06-23 Pranav Pawar , Akshansh Dwivedi , Jenish Boricha , Himanshu Gohil , Aditya Dubey

We introduce a text-to-speech(TTS) framework based on a neural transducer. We use discretized semantic tokens acquired from wav2vec2.0 embeddings, which makes it easy to adopt a neural transducer for the TTS framework enjoying its monotonic…

音频与语音处理 · 电气工程与系统科学 2023-11-09 Minchan Kim , Myeonghun Jeong , Byoung Jin Choi , Dongjune Lee , Nam Soo Kim

Modern text-to-speech (TTS) systems are able to generate audio that sounds almost as natural as human speech. However, the bar of developing high-quality TTS systems remains high since a sizable set of studio-quality <text, audio> pairs is…

计算与语言 · 计算机科学 2019-06-19 Wei Fang , Yu-An Chung , James Glass

We propose a novel text-to-speech (TTS) framework centered around a neural transducer. Our approach divides the whole TTS pipeline into semantic-level sequence-to-sequence (seq2seq) modeling and fine-grained acoustic modeling stages,…

音频与语音处理 · 电气工程与系统科学 2024-10-28 Minchan Kim , Myeonghun Jeong , Byoung Jin Choi , Semin Kim , Joun Yeop Lee , Nam Soo Kim

Current end-to-end autoregressive TTS systems (e.g. Tacotron 2) have outperformed traditional parallel approaches on the quality of synthesized speech. However, they introduce new problems at the same time. Due to the autoregressive nature,…

音频与语音处理 · 电气工程与系统科学 2020-08-07 Yahuan Cong , Ran Zhang , Jian Luan

We introduce SupertonicTTS, a novel text-to-speech (TTS) system designed for efficient and streamlined speech synthesis. SupertonicTTS comprises three components: a speech autoencoder for continuous latent representation, a text-to-latent…

音频与语音处理 · 电气工程与系统科学 2025-09-24 Hyeongju Kim , Jinhyeok Yang , Yechan Yu , Seunghun Ji , Jacob Morton , Frederik Bous , Joon Byun , Juheon Lee

Spoken meaning often depends not only on what is said, but also on which word is emphasized. The same sentence can convey correction, contrast, or clarification depending on where emphasis falls. Although modern text-to-speech (TTS) systems…

计算与语言 · 计算机科学 2026-04-14 Arnon Turetzky , Avihu Dekel , Hagai Aronowitz , Ron Hoory , Yossi Adi

Recent studies have outlined the accessibility challenges faced by blind or visually impaired, and less-literate people, in interacting with social networks, in-spite of facilitating technologies such as monotone text-to-speech (TTS) screen…

社会与信息网络 · 计算机科学 2024-10-28 Suparna De , Ionut Bostan , Nishanth Sastry

In modern speech synthesis, paralinguistic information--such as a speaker's vocal timbre, emotional state, and dynamic prosody--plays a critical role in conveying nuance beyond mere semantics. Traditional Text-to-Speech (TTS) systems rely…

计算与语言 · 计算机科学 2025-06-23 Kexin Huang , Qian Tu , Liwei Fan , Chenchen Yang , Dong Zhang , Shimin Li , Zhaoye Fei , Qinyuan Cheng , Xipeng Qiu

Current text to speech (TTS) systems usually leverage a cascaded acoustic model and vocoder pipeline with mel-spectrograms as the intermediate representations, which suffer from two limitations: 1) the acoustic model and vocoder are…

声音 · 计算机科学 2022-07-12 Yanqing Liu , Ruiqing Xue , Lei He , Xu Tan , Sheng Zhao

Although text-to-speech (TTS) systems have significantly improved, most TTS systems still have limitations in synthesizing speech with appropriate phrasing. For natural speech synthesis, it is important to synthesize the speech with a…

音频与语音处理 · 电气工程与系统科学 2023-06-14 Ji-Sang Hwang , Sang-Hoon Lee , Seong-Whan Lee

In this work, we explore multiple architectures and training procedures for developing a multi-speaker and multi-lingual neural TTS system with the goals of a) improving the quality when the available data in the target language is limited…

计算与语言 · 计算机科学 2021-08-18 Javier Latorre , Charlotte Bailleul , Tuuli Morrill , Alistair Conkie , Yannis Stylianou

A text-to-speech synthesis system typically consists of multiple stages, such as a text analysis frontend, an acoustic model and an audio synthesis module. Building these components often requires extensive domain expertise and may contain…

Text-to-Speech (TTS) has recently seen great progress in synthesizing high-quality speech owing to the rapid development of parallel TTS systems, but producing speech with naturalistic prosodic variations, speaking styles and emotional…

音频与语音处理 · 电气工程与系统科学 2023-11-21 Yinghao Aaron Li , Cong Han , Nima Mesgarani

Building text-to-speech (TTS) synthesisers for Indian languages is a difficult task owing to a large number of active languages. Indian languages can be classified into a finite set of families, prominent among them, Indo-Aryan and…

音频与语音处理 · 电气工程与系统科学 2022-11-01 Anusha Prakash , Hema A Murthy

In recent years, Text-To-Speech (TTS) has been used as a data augmentation technique for speech recognition to help complement inadequacies in the training data. Correspondingly, we investigate the use of a multi-speaker TTS system to…

音频与语音处理 · 电气工程与系统科学 2020-11-25 Yiling Huang , Yutian Chen , Jason Pelecanos , Quan Wang

We present an end-to-end text-to-speech (TTS) synthesis system that generates audio and synchronized tongue motion directly from text. This is achieved by adapting a 3D model of the tongue surface to an articulatory dataset and training a…

人机交互 · 计算机科学 2018-04-17 Ingmar Steiner , Sébastien Le Maguer , Alexander Hewer

Text to speech (TTS) has made rapid progress in both academia and industry in recent years. Some questions naturally arise that whether a TTS system can achieve human-level quality, how to define/judge that quality and how to achieve it. In…

音频与语音处理 · 电气工程与系统科学 2022-05-11 Xu Tan , Jiawei Chen , Haohe Liu , Jian Cong , Chen Zhang , Yanqing Liu , Xi Wang , Yichong Leng , Yuanhao Yi , Lei He , Frank Soong , Tao Qin , Sheng Zhao , Tie-Yan Liu