English
Related papers

Related papers: Multilingual Text-to-Speech Synthesis for Turkic L…

200 papers

The rapid development of neural text-to-speech (TTS) systems enabled its usage in other areas of natural language processing such as automatic speech recognition (ASR) or spoken language translation (SLT). Due to the large number of…

Computation and Language · Computer Science 2024-08-01 Nick Rossenbach , Ralf Schlüter , Sakriani Sakti

Code-switching---the intra-utterance use of multiple languages---is prevalent across the world. Within text-to-speech (TTS), multilingual models have been found to enable code-switching. By modifying the linguistic input to…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-17 Marlene Staib , Tian Huey Teh , Alexandra Torresquintero , Devang S Ram Mohan , Lorenzo Foglianti , Raphael Lenain , Jiameng Gao

In this work, we explore multiple architectures and training procedures for developing a multi-speaker and multi-lingual neural TTS system with the goals of a) improving the quality when the available data in the target language is limited…

Computation and Language · Computer Science 2021-08-18 Javier Latorre , Charlotte Bailleul , Tuuli Morrill , Alistair Conkie , Yannis Stylianou

YourTTS brings the power of a multilingual approach to the task of zero-shot multi-speaker TTS. Our method builds upon the VITS model and adds several novel modifications for zero-shot multi-speaker and multilingual training. We achieved…

Text-to-Speech (TTS) system is a system where speech is synthesized from a given text following any particular approach. Concatenative synthesis, Hidden Markov Model (HMM) based synthesis, Deep Learning (DL) based synthesis with multiple…

Sound · Computer Science 2021-08-03 Prithwiraj Bhattacharjee , Rajan Saha Raju , Arif Ahmad , M. Shahidur Rahman

We work to create a multilingual speech synthesis system which can generate speech with the proper accent while retaining the characteristics of an individual voice. This is challenging to do because it is expensive to obtain bilingual…

Deep learning based text-to-speech (TTS) systems have been evolving rapidly with advances in model architectures, training methodologies, and generalization across speakers and languages. However, these advances have not been thoroughly…

Computation and Language · Computer Science 2023-02-20 Gokul Karthik Kumar , Praveen S , Pratyush Kumar , Mitesh M. Khapra , Karthik Nandakumar

Large language models (LLMs) have transformed natural language processing, yet their capabilities remain uneven across languages. Most multilingual models are trained primarily on high-resource languages, leaving many languages with large…

Computation and Language · Computer Science 2026-04-09 O. Ibrahimzade , K. Tabasaransky

When the available data of a target speaker is insufficient to train a high quality speaker-dependent neural text-to-speech (TTS) system, we can combine data from multiple speakers and train a multi-speaker TTS model instead. Many studies…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-09 Hieu-Thi Luong , Xin Wang , Junichi Yamagishi , Nobuyuki Nishizawa

Deep learning models are becoming predominant in many fields of machine learning. Text-to-Speech (TTS), the process of synthesizing artificial speech from text, is no exception. To this end, a deep neural network is usually trained using a…

Sound · Computer Science 2021-02-11 Giuseppe Ruggiero , Enrico Zovato , Luigi Di Caro , Vincent Pollet

In this work we present our expert system of Automatic reading or speech synthesis based on a text written in Standard Arabic, our work is carried out in two great stages: the creation of the sound data base, and the transformation of the…

Computation and Language · Computer Science 2014-05-09 Tebbi Hanane , Azzoune Hamid

We present a model of text analysis for text-to-speech (TTS) synthesis based on (weighted) finite-state transducers, which serves as the text-analysis module of the multilingual Bell Labs TTS system. The transducers are constructed using a…

cmp-lg · Computer Science 2008-02-03 Richard Sproat

This paper presents a novel framework to build a voice conversion (VC) system by learning from a text-to-speech (TTS) synthesis system, that is called TTS-VC transfer learning. We first develop a multi-speaker speech synthesis system with…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-07 Mingyang Zhang , Yi Zhou , Li Zhao , Haizhou Li

We present a meta-learning approach for adaptive text-to-speech (TTS) with few data. During training, we learn a multi-speaker model using a shared conditional WaveNet core and independent learned embeddings for each speaker. The aim of…

The diversity of speaker profiles in multi-speaker TTS systems is a crucial aspect of its performance, as it measures how many different speaker profiles TTS systems could possibly synthesize. However, this important aspect is often…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-08 Jie Pu , Yixiong Meng , Oguz Elibol

Text-to-Speech (TTS) synthesis for low-resource languages is an attractive research issue in academia and industry nowadays. Mongolian is the official language of the Inner Mongolia Autonomous Region and a representative low-resource…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-03 Kailin Liang , Bin Liu , Yifan Hu , Rui Liu , Feilong Bao , Guanglai Gao

Different languages have distinct phonetic systems and vary in their prosodic features making it challenging to develop a Text-to-Speech (TTS) model that can effectively synthesise speech in multilingual settings. Furthermore, TTS…

Computation and Language · Computer Science 2024-06-26 Yingting Li , Ambuj Mehrish , Bryan Chew , Bo Cheng , Soujanya Poria

Tibetan text-to-speech (TTS) has long been challenged by scarce speech resources, significant dialectal variation, and the complex mapping between written text and spoken pronunciation. To address these issues, this work presents, to the…

Sound · Computer Science 2026-05-05 Jiaxu He , Chao Wang , Jie Lian , Yuqing Cai , Yongxiang Li , Renzeg Duojie , Jie Li

Zero-shot multi-speaker Text-to-Speech (TTS) generates target speaker voices given an input text and the corresponding speaker embedding. In this work, we investigate the effectiveness of the TTS reconstruction objective to improve…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-23 Jaejin Cho , Piotr Zelasko , Jesus Villalba , Shinji Watanabe , Najim Dehak

People may be puzzled by the fact that voice over recordings data sets exist in addition to Text-to-Speech (TTS), Synthesis system advancements, albeit this is not the case. The goal of this study is to explain the relevance of TTS as well…

Sound · Computer Science 2022-04-08 Hala Al Masri , Muhy Eddin Za'ter