中文
相关论文

相关论文: MnTTS: An Open-Source Mongolian Text-to-Speech Syn…

200 篇论文

Modern speech synthesis techniques can produce natural-sounding speech given sufficient high-quality data and compute resources. However, such data is not readily available for many languages. This paper focuses on speech synthesis for…

计算与语言 · 计算机科学 2022-07-05 Perez Ogayo , Graham Neubig , Alan W Black

Most Zero-shot Multi-speaker TTS (ZS-TTS) systems support only a single language. Although models like YourTTS, VALL-E X, Mega-TTS 2, and Voicebox explored Multilingual ZS-TTS they are limited to just a few high/medium resource languages,…

音频与语音处理 · 电气工程与系统科学 2024-06-10 Edresson Casanova , Kelly Davis , Eren Gölge , Görkem Göknar , Iulian Gulea , Logan Hart , Aya Aljafari , Joshua Meyer , Reuben Morais , Samuel Olayemi , Julian Weber

Deep learning based text-to-speech (TTS) systems have been evolving rapidly with advances in model architectures, training methodologies, and generalization across speakers and languages. However, these advances have not been thoroughly…

计算与语言 · 计算机科学 2023-02-20 Gokul Karthik Kumar , Praveen S , Pratyush Kumar , Mitesh M. Khapra , Karthik Nandakumar

Data availability is crucial for advancing artificial intelligence applications, including voice-based technologies. As content creation, particularly in social media, experiences increasing demand, translation and text-to-speech (TTS)…

音频与语音处理 · 电气工程与系统科学 2024-02-27 Ahmet Gunduz , Kamer Ali Yuksel , Kareem Darwish , Golara Javadi , Fabio Minazzi , Nicola Sobieski , Sebastien Bratieres

Transformer-based text to speech (TTS) model (e.g., Transformer TTS~\cite{li2019neural}, FastSpeech~\cite{ren2019fastspeech}) has shown the advantages of training and inference efficiency over RNN-based model (e.g.,…

音频与语音处理 · 电气工程与系统科学 2020-08-04 Mingjian Chen , Xu Tan , Yi Ren , Jin Xu , Hao Sun , Sheng Zhao , Tao Qin , Tie-Yan Liu

In this paper, we propose a text-to-speech (TTS)-driven data augmentation method for improving the quality of a non-autoregressive (AR) TTS system. Recently proposed non-AR models, such as FastSpeech 2, have successfully achieved fast…

音频与语音处理 · 电气工程与系统科学 2020-10-27 Min-Jae Hwang , Ryuichi Yamamoto , Eunwoo Song , Jae-Min Kim

Neural Text-to-Speech (TTS) systems find broad applications in voice assistants, e-learning, and audiobook creation. The pursuit of modern models, like Diffusion Models (DMs), holds promise for achieving high-fidelity, real-time speech…

声音 · 计算机科学 2024-04-02 Xiang Li , Fan Bu , Ambuj Mehrish , Yingting Li , Jiale Han , Bo Cheng , Soujanya Poria

Instruction-following text-to-speech (TTS) has emerged as an important capability for controllable and expressive speech generation, yet its evaluation remains underdeveloped due to limited benchmark coverage, weak diagnostic granularity,…

音频与语音处理 · 电气工程与系统科学 2026-04-21 Huakang Chen , Jingbin Hu , Liumeng Xue , Qirui Zhan , Wenhao Li , Guobin Ma , Hanke Xie , Dake Guo , Linhan Ma , Yuepeng Jiang , Bengu Wu , Pengyuan Xie , Chuan Xie , Qiang Zhang , Lei Xie

Text-to-speech (TTS) systems are being built using end-to-end deep learning approaches. However, these systems require huge amounts of training data. We present our approach to built production quality TTS and perform speaker adaptation in…

机器学习 · 计算机科学 2023-12-05 Raviraj Joshi , Nikesh Garera

Recently, large language model (LLM) based text-to-speech (TTS) systems have gradually become the mainstream in the industry due to their high naturalness and powerful zero-shot voice cloning capabilities.Here, we introduce the IndexTTS…

声音 · 计算机科学 2025-02-11 Wei Deng , Siyi Zhou , Jingchen Shu , Jinchao Wang , Lu Wang

While neural text-to-speech (TTS) has achieved human-like natural synthetic speech, multilingual TTS systems are limited to resource-rich languages due to the need for paired text and studio-quality audio data. This paper proposes a method…

音频与语音处理 · 电气工程与系统科学 2023-05-30 Takaaki Saeki , Soumi Maiti , Xinjian Li , Shinji Watanabe , Shinnosuke Takamichi , Hiroshi Saruwatari

End-to-end text-to-speech (TTS) systems have been developed for European languages like English and Spanish with state-of-the-art speech quality, prosody, and naturalness. However, development of end-to-end TTS for Indian languages is…

计算与语言 · 计算机科学 2022-12-08 Ankur Debnath , Shridevi S Patil , Gangotri Nadiger , Ramakrishnan Angarai Ganesan

Recent advancements in text-to-speech (TTS) models have been driven by the integration of large language models (LLMs), enhancing semantic comprehension and improving speech naturalness. However, existing LLM-based TTS models often lack…

声音 · 计算机科学 2025-04-29 Xin Li , Kaikai Jia , Hao Sun , Jun Dai , Ziyang Jiang

Scaling text-to-speech (TTS) to large-scale, multi-speaker, and in-the-wild datasets is important to capture the diversity in human speech such as speaker identities, prosodies, and styles (e.g., singing). Current large TTS systems usually…

音频与语音处理 · 电气工程与系统科学 2023-05-31 Kai Shen , Zeqian Ju , Xu Tan , Yanqing Liu , Yichong Leng , Lei He , Tao Qin , Sheng Zhao , Jiang Bian

This work proposes GLM-TTS, a production-level TTS system designed for efficiency, controllability, and high-fidelity speech generation. GLM-TTS follows a two-stage architecture, consisting of a text-to-token autoregressive model and a…

This work aims to build a multilingual text-to-speech (TTS) synthesis system for ten lower-resourced Turkic languages: Azerbaijani, Bashkir, Kazakh, Kyrgyz, Sakha, Tatar, Turkish, Turkmen, Uyghur, and Uzbek. We specifically target the…

音频与语音处理 · 电气工程与系统科学 2023-05-26 Rustem Yeshpanov , Saida Mussakhojayeva , Yerbolat Khassanov

YourTTS brings the power of a multilingual approach to the task of zero-shot multi-speaker TTS. Our method builds upon the VITS model and adds several novel modifications for zero-shot multi-speaker and multilingual training. We achieved…

This paper introduces a new speech dataset called ``LibriTTS-R'' designed for text-to-speech (TTS) use. It is derived by applying speech restoration to the LibriTTS corpus, which consists of 585 hours of speech data at 24 kHz sampling rate…

音频与语音处理 · 电气工程与系统科学 2023-05-31 Yuma Koizumi , Heiga Zen , Shigeki Karita , Yifan Ding , Kohei Yatabe , Nobuyuki Morioka , Michiel Bacchiani , Yu Zhang , Wei Han , Ankur Bapna

Incremental text-to-speech (TTS) synthesis generates utterances in small linguistic units for the sake of real-time and low-latency applications. We previously proposed an incremental TTS method that leverages a large pre-trained language…

声音 · 计算机科学 2021-09-23 Takaaki Saeki , Shinnosuke Takamichi , Hiroshi Saruwatari

Several high-resource Text to Speech (TTS) systems currently produce natural, well-established human-like speech. In contrast, low-resource languages, including Arabic, have very limited TTS systems due to the lack of resources. We propose…

计算与语言 · 计算机科学 2023-01-27 Massa Baali , Tomoki Hayashi , Hamdy Mubarak , Soumi Maiti , Shinji Watanabe , Wassim El-Hajj , Ahmed Ali