English
Related papers

Related papers: Creating an African American-Sounding TTS: Guideli…

200 papers

Benefiting from the development of deep learning, text-to-speech (TTS) techniques using clean speech have achieved significant performance improvements. The data collected from real scenes often contains noise and generally needs to be…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-06 Qiushi Zhu , Yu Gu , Rilin Chen , Chao Weng , Yuchen Hu , Lirong Dai , Jie Zhang

We introduce SPEAR-TTS, a multi-speaker text-to-speech (TTS) system that can be trained with minimal supervision. By combining two types of discrete speech representations, we cast TTS as a composition of two sequence-to-sequence tasks:…

Mindfulness-based therapies have been shown to be effective in improving mental health, and technology-based methods have the potential to expand the accessibility of these therapies. To enable real-time personalized content generation for…

Human-Computer Interaction · Computer Science 2024-01-09 Zhonghao Shi , Han Chen , Anna-Maria Velentza , Siqi Liu , Nathaniel Dennler , Allison O'Connell , Maja Matarić

This study investigates whether phonological features can be applied in text-to-speech systems to generate native and non-native speech in English and Mandarin. We present a mapping of ARPABET/pinyin to SAMPA/SAMPA-SC and then to…

Computation and Language · Computer Science 2021-10-12 Cong Zhang , Huinan Zeng , Huang Liu , Jiewen Zheng

We present a fully convolutional wav-to-wav network for converting between speakers' voices, without relying on text. Our network is based on an encoder-decoder architecture, where the encoder is pre-trained for the task of Automatic Speech…

Sound · Computer Science 2020-07-28 Adam Polyak , Lior Wolf , Yaniv Taigman

Text-to-Speech (TTS) synthesis plays an important role in human-computer interaction. Currently, most TTS technologies focus on the naturalness of speech, namely,making the speeches sound like humans. However, the key tasks of the…

Sound · Computer Science 2021-05-11 Jinyin Chen , Linhui Ye , Zhaoyan Ming

Previous approaches on accent conversion (AC) mainly aimed at making non-native speech sound more native while maintaining the original content and speaker identity. However, non-native speakers sometimes have pronunciation issues, which…

Sound · Computer Science 2025-03-05 Tuan Nam Nguyen , Seymanur Akti , Ngoc Quan Pham , Alexander Waibel

Zero-shot multi-speaker Text-to-Speech (TTS) generates target speaker voices given an input text and the corresponding speaker embedding. In this work, we investigate the effectiveness of the TTS reconstruction objective to improve…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-23 Jaejin Cho , Piotr Zelasko , Jesus Villalba , Shinji Watanabe , Najim Dehak

Text-to-speech (TTS) technology has achieved impressive results for widely spoken languages, yet many under-resourced languages remain challenged by limited data and linguistic complexities. In this paper, we present a novel methodology…

Sound · Computer Science 2025-04-11 Yizhong Geng , Jizhuo Xu , Zeyu Liang , Jinghan Yang , Xiaoyi Shi , Xiaoyu Shen

Text-to-Speech (TTS) synthesis using deep learning relies on voice quality. Modern TTS models are advanced, but they need large amount of data. Given the growing computational complexity of these models and the scarcity of large,…

Sound · Computer Science 2023-10-10 Ze Liu

Neural network based end-to-end Text-to-Speech (TTS) has greatly improved the quality of synthesized speech. While how to use massive spontaneous speech without transcription efficiently still remains an open problem. In this paper, we…

Sound · Computer Science 2022-02-07 Dabiao Ma , Yitong Zhang , Meng Li , Feng Ye

We present the first text-to-speech (TTS) system tailored to second language (L2) speakers. We use duration differences between American English tense (longer) and lax (shorter) vowels to create a "clarity mode" for Matcha-TTS. Our…

Sound · Computer Science 2025-09-04 Paige Tuttösí , H. Henny Yeung , Yue Wang , Jean-Julien Aucouturier , Angelica Lim

State-of-the-art generative text-to-image models are known to exhibit social biases and over-represent certain groups like people of perceived lighter skin tones and men in their outcomes. In this work, we propose a method to mitigate such…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Piero Esposito , Parmida Atighehchian , Anastasis Germanidis , Deepti Ghadiyaram

Synthesizing the voices of unseen speakers remains a persisting challenge in multi-speaker text-to-speech (TTS). Existing methods model speaker characteristics through speaker conditioning during training, leading to increased model…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-18 Ismail Rasim Ulgen , Shreeram Suresh Chandra , Junchen Lu , Berrak Sisman

We present a new neural text to speech (TTS) method that is able to transform text to speech in voices that are sampled in the wild. Unlike other systems, our solution is able to deal with unconstrained voice samples and without requiring…

Machine Learning · Computer Science 2018-02-02 Yaniv Taigman , Lior Wolf , Adam Polyak , Eliya Nachmani

With the similarity between music and speech synthesis from symbolic input and the rapid development of text-to-speech (TTS) techniques, it is worthwhile to explore ways to improve the MIDI-to-audio performance by borrowing from TTS…

Sound · Computer Science 2023-03-22 Xuan Shi , Erica Cooper , Xin Wang , Junichi Yamagishi , Shrikanth Narayanan

The increased adoption of digital assistants makes text-to-speech (TTS) synthesis systems an indispensable feature of modern mobile devices. It is hence desirable to build a system capable of generating highly intelligible speech in the…

Sound · Computer Science 2020-08-14 Dipjyoti Paul , Muhammed PV Shifas , Yannis Pantazis , Yannis Stylianou

Bots are software systems designed to support users by automating a specific process, task, or activity. When such systems implement a conversational component to interact with the users, they are also known as conversational agents. Bots,…

Software Engineering · Computer Science 2025-03-18 Stefano Lambiase , Gemma Catolino , Fabio Palomba , Filomena Ferrucci

When deploying a Chinese neural text-to-speech (TTS) synthesis system, one of the challenges is to synthesize Chinese utterances with English phrases or words embedded. This paper looks into the problem in the encoder-decoder framework when…

Computation and Language · Computer Science 2019-08-23 Liumeng Xue , Wei Song , Guanghui Xu , Lei Xie , Zhizheng Wu

In this technical report, we describe our submission for the WildSpoof Challenge TTS Track: Text-to-Speech with In-the-Wild Data. We introduce F5-TTS-DPS, a model built upon the F5-TTS architecture. Our approach integrates Exponential…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-25 Renhe Sun , Jiayi Zhou , Haolin He , Yueying Feng , Jian Liu