English
Related papers

Related papers: Unsupervised Data Selection for TTS: Using Arabic …

200 papers

This paper proposes an audio-conditioned phonemic and prosodic annotation model for building text-to-speech (TTS) datasets from unlabeled speech samples. For creating a TTS dataset that consists of label-speech paired data, the proposed…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Yuma Shirahata , Byeongseon Park , Ryuichi Yamamoto , Kentaro Tachibana

This paper introduces BnTTS (Bangla Text-To-Speech), the first framework for Bangla speaker adaptation-based TTS, designed to bridge the gap in Bangla speech synthesis using minimal training data. Building upon the XTTS architecture, our…

Few-shot speaker adaptation is a specific Text-to-Speech (TTS) system that aims to reproduce a novel speaker's voice with a few training data. While numerous attempts have been made to the few-shot speaker adaptation system, there is still…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-17 Ji-Hoon Kim , Sang-Hoon Lee , Ji-Hyun Lee , Hong-Gyu Jung , Seong-Whan Lee

While neural methods for text-to-speech (TTS) have shown great advances in modeling multiple speakers, even in zero-shot settings, the amount of data needed for those approaches is generally not feasible for the vast majority of the world's…

Computation and Language · Computer Science 2022-10-25 Florian Lux , Julia Koch , Ngoc Thang Vu

Arabic spans over 30 spoken varieties, yet no open-source text-to-speech system unifies them. Key barriers include substantial cross-dialect lexical and phonological divergence, scarce synthesis-grade data, and the absence of a standardized…

Computation and Language · Computer Science 2026-04-01 Yushen Chen , Junzhe Liu , Yujie Tu , Zhikang Niu , Yuzhe Liang , Chunyu Qiang , Chen Zhang , Kai Yu , Xie Chen

Data sparsity is a main problem hindering the development of code-switching (CS) NLP systems. In this paper, we investigate data augmentation techniques for synthesizing dialectal Arabic-English CS text. We perform lexical replacements…

Computation and Language · Computer Science 2023-04-05 Injy Hamed , Nizar Habash , Slim Abdennadher , Ngoc Thang Vu

TTS, or text-to-speech, is a complicated process that can be accomplished through appropriate modeling using deep learning methods. In order to implement deep learning models, a suitable dataset is required. Since there is a scarce amount…

Computation and Language · Computer Science 2023-04-10 Mohammd Hasan Shamgholi , Vahid Saeedi , Javad Peymanfard , Leila Alhabib , Hossein Zeinali

Text to speech (TTS) has been broadly used to synthesize natural and intelligible speech in different scenarios. Deploying TTS in various end devices such as mobile phones or embedded devices requires extremely small memory usage and…

Sound · Computer Science 2021-02-09 Renqian Luo , Xu Tan , Rui Wang , Tao Qin , Jinzhu Li , Sheng Zhao , Enhong Chen , Tie-Yan Liu

Recent advances in Text-To-Speech (TTS) technology have enabled synthetic speech to mimic human voices with remarkable realism, raising significant security concerns. This underscores the need for traceable TTS models-systems capable of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-08 Yuxiang Zhao , Yunchong Xiao , Yushen Chen , Zhikang Niu , Shuai Wang , Kai Yu , Xie Chen

The performance of learning models heavily relies on the availability and adequacy of training data. To address the dataset adequacy issue, researchers have extensively explored data augmentation (DA) as a promising approach. DA generates…

Computation and Language · Computer Science 2023-08-22 Dania Refai , Saleh Abo-Soud , Mohammad Abdel-Rahman

Custom voice, a specific text to speech (TTS) service in commercial speech platforms, aims to adapt a source TTS model to synthesize personal voice for a target speaker using few speech data. Custom voice presents two unique challenges for…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-02 Mingjian Chen , Xu Tan , Bohan Li , Yanqing Liu , Tao Qin , Sheng Zhao , Tie-Yan Liu

We present a neural text-to-speech (TTS) method that models natural vocal effort variation to improve the intelligibility of synthetic speech in the presence of noise. The method consists of first measuring the spectral tilt of unlabeled…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-30 Tuomo Raitio , Petko Petkov , Jiangchuan Li , Muhammed Shifas , Andrea Davis , Yannis Stylianou

The perceptual quality of neural text-to-speech (TTS) is highly dependent on the choice of the model during training. Selecting the model using a training-objective metric such as the least mean squared error does not always correlate with…

Text-to-speech (TTS) systems are an important component in voice-based e-commerce applications. These applications include end-to-end voice assistant and customer experience (CX) voice bot. Code-mixed TTS is also relevant in these…

Machine Learning · Computer Science 2023-12-05 Raviraj Joshi , Nikesh Garera

In this paper, we proposed Adapitch, a multi-speaker TTS method that makes adaptation of the supervised module with untranscribed data. We design two self supervised modules to train the text encoder and mel decoder separately with…

Sound · Computer Science 2022-10-26 Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

Data availability is crucial for advancing artificial intelligence applications, including voice-based technologies. As content creation, particularly in social media, experiences increasing demand, translation and text-to-speech (TTS)…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-27 Ahmet Gunduz , Kamer Ali Yuksel , Kareem Darwish , Golara Javadi , Fabio Minazzi , Nicola Sobieski , Sebastien Bratieres

Zero-shot Text-To-Speech (TTS) synthesis shows great promise for personalized voice customization through voice cloning. However, current methods for achieving zero-shot TTS heavily rely on large model scales and extensive training datasets…

Sound · Computer Science 2025-01-16 Qianniu Chen , Xiaoyang Hao , Bowen Li , Yue Liu , Li Lu

Producing synthetic voice, similar to human-like sound, is an emerging novelty of modern interactive media systems. Text-To-Speech (TTS) systems try to generate synthetic and authentic voices via text input. Besides, well known and familiar…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-24 Mohammad Reza Hasanabadi

Expressive text-to-speech (TTS) aims to synthesize different speaking style speech according to human's demands. Nowadays, there are two common ways to control speaking styles: (1) Pre-defining a group of speaking style and using…

Sound · Computer Science 2023-06-27 Dongchao Yang , Songxiang Liu , Rongjie Huang , Chao Weng , Helen Meng

While deep learning-based text-to-speech (TTS) models such as VITS have shown excellent results, they typically require a sizable set of high-quality <text, audio> pairs to train, which is expensive to collect. So far, most languages in the…

Sound · Computer Science 2023-01-05 Xin Yuan , Robin Feng , Mingming Ye