中文
相关论文

相关论文: Creating an African American-Sounding TTS: Guideli…

200 篇论文

This work introduces TTS-Transducer - a novel architecture for text-to-speech, leveraging the strengths of audio codec models and neural transducers. Transducers, renowned for their superior quality and robustness in speech recognition, are…

音频与语音处理 · 电气工程与系统科学 2025-04-16 Vladimir Bataev , Subhankar Ghosh , Vitaly Lavrukhin , Jason Li

We propose PromptTTS++, a prompt-based text-to-speech (TTS) synthesis system that allows control over speaker identity using natural language descriptions. To control speaker identity within the prompt-based TTS framework, we introduce the…

音频与语音处理 · 电气工程与系统科学 2023-12-29 Reo Shimizu , Ryuichi Yamamoto , Masaya Kawamura , Yuma Shirahata , Hironori Doi , Tatsuya Komatsu , Kentaro Tachibana

Modern TTS systems are capable of creating highly realistic and natural-sounding speech. Despite these developments, the process of customizing TTS voices remains a complex task, mostly requiring the expertise of specialists within the…

While automatic speech recognition (ASR) systems have achieved remarkable performance with large-scale datasets, their efficacy remains inadequate in low-resource settings, encompassing dialects, accents, minority languages, and long-tail…

音频与语音处理 · 电气工程与系统科学 2024-10-23 Guanrou Yang , Fan Yu , Ziyang Ma , Zhihao Du , Zhifu Gao , Shiliang Zhang , Xie Chen

This paper presents a method for end-to-end cross-lingual text-to-speech (TTS) which aims to preserve the target language's pronunciation regardless of the original speaker's language. The model used is based on a non-attentive Tacotron…

Previous multilingual text-to-speech (TTS) approaches have considered leveraging monolingual speaker data to enable cross-lingual speech synthesis. However, such data-efficient approaches have ignored synthesizing emotional aspects of…

音频与语音处理 · 电气工程与系统科学 2023-08-01 Xinfa Zhu , Yi Lei , Tao Li , Yongmao Zhang , Hongbin Zhou , Heng Lu , Lei Xie

Several high-resource Text to Speech (TTS) systems currently produce natural, well-established human-like speech. In contrast, low-resource languages, including Arabic, have very limited TTS systems due to the lack of resources. We propose…

计算与语言 · 计算机科学 2023-01-27 Massa Baali , Tomoki Hayashi , Hamdy Mubarak , Soumi Maiti , Shinji Watanabe , Wassim El-Hajj , Ahmed Ali

An unsupervised text-to-speech synthesis (TTS) system learns to generate speech waveforms corresponding to any written sentence in a language by observing: 1) a collection of untranscribed speech waveforms in that language; 2) a collection…

音频与语音处理 · 电气工程与系统科学 2022-08-17 Junrui Ni , Liming Wang , Heting Gao , Kaizhi Qian , Yang Zhang , Shiyu Chang , Mark Hasegawa-Johnson

Recent advances in large language models (LLMs) have significantly improved text-to-speech (TTS) systems, enhancing control over speech style, naturalness, and emotional expression, which brings TTS Systems closer to human-level…

The aim of this workshop is two-fold. First, it aims to establish a research community focused on design and evaluation of synthetic speech (TTS) interfaces that are tailored not only to goal oriented tasks (e.g., food ordering, online…

人机交互 · 计算机科学 2024-02-27 Mateusz Dubiel , Matthew Aylett , Anuschka Schmitt , Zilin Ma , Gary Hsieh , Thiemo Wambsganss

We highlight the challenges faced by non-native speakers when using AI writing assistants to paraphrase text. Through an interview study with 15 non-native English speakers (NNESs) with varying levels of English proficiency, we observe that…

计算与语言 · 计算机科学 2023-04-06 Yewon Kim , Mina Lee , Donghwi Kim , Sung-Ju Lee

Accent Conversion (AC) seeks to change the accent of speech from one (source) to another (target) while preserving the speech content and speaker identity. However, many AC approaches rely on source-target parallel speech data. We propose a…

音频与语音处理 · 电气工程与系统科学 2023-05-24 Yi Zhou , Zhizheng Wu , Mingyang Zhang , Xiaohai Tian , Haizhou Li

Similar to text-based Large Language Models (LLMs), Speech-LLMs exhibit emergent abilities and context awareness. However, whether these similarities extend to gender bias remains an open question. This study proposes a methodology…

计算与语言 · 计算机科学 2025-08-20 Dariia Puhach , Amir H. Payberah , Éva Székely

The goal of expressive Text-to-speech (TTS) is to synthesize natural speech with desired content, prosody, emotion, or timbre, in high expressiveness. Most of previous studies attempt to generate speech from given labels of styles and…

音频与语音处理 · 电气工程与系统科学 2022-11-29 Jianhong Tu , Zeyu Cui , Xiaohuan Zhou , Siqi Zheng , Kai Hu , Ju Fan , Chang Zhou

This scoping literature review examines how fairness, bias, and equity are conceptualized and operationalized in Automatic Speech Recognition (ASR) and adjacent speech and language technologies (SLT) for African American English (AAE)…

音频与语音处理 · 电气工程与系统科学 2025-08-27 Jay L. Cunningham , Adinawa Adjagbodjou , Jeffrey Basoah , Jainaba Jawara , Kowe Kadoma , Aaleyah Lewis

Voice faking, driven primarily by recent advances in text-to-speech (TTS) synthesis technology, poses significant societal challenges. Currently, the prevailing assumption is that unaltered human speech can be considered genuine, while fake…

This paper proposes a method for selecting training data for text-to-speech (TTS) synthesis from dark data. TTS models are typically trained on high-quality speech corpora that cost much time and money for data collection, which makes it…

声音 · 计算机科学 2022-10-27 Kentaro Seki , Shinnosuke Takamichi , Takaaki Saeki , Hiroshi Saruwatari

Instruction-guided text-to-speech (ITTS) enables users to control speech generation through natural language prompts, offering a more intuitive interface than traditional TTS. However, the alignment between user style instructions and…

音频与语音处理 · 电气工程与系统科学 2026-04-28 Yi-Cheng Lin , Huang-Cheng Chou , Tzu-Chieh Wei , Kuan-Yu Chen , Hung-yi Lee

Recent advancements in Text-to-Speech (TTS) technology have led to natural-sounding speech for English, primarily due to the availability of large-scale, high-quality web data. However, many other languages lack access to such resources,…

计算与语言 · 计算机科学 2024-10-24 Srija Anand , Praveen Srinivasa Varadhan , Mehak Singal , Mitesh M. Khapra

Recent studies have introduced end-to-end TTS, which integrates the production of context and acoustic features in statistical parametric speech synthesis. As a result, a single neural network replaced laborious feature engineering with…

机器学习 · 计算机科学 2019-02-26 Kohki Mametani , Tsuneo Kato , Seiichi Yamamoto