中文
相关论文

相关论文: A2TTS: TTS for Low Resource Indian Languages

200 篇论文

Adaptive text to speech (TTS) can synthesize new voices in zero-shot scenarios efficiently, by using a well-trained source TTS model without adapting it on the speech data of new speakers. Considering seen and unseen speakers have diverse…

音频与语音处理 · 电气工程与系统科学 2022-04-04 Yihan Wu , Xu Tan , Bohan Li , Lei He , Sheng Zhao , Ruihua Song , Tao Qin , Tie-Yan Liu

Text-to-speech (TTS) systems typically require high-quality studio data and accurate transcriptions for training. India has 1369 languages, with 22 official using 13 scripts. Training a TTS system for all these languages, most of which have…

计算与语言 · 计算机科学 2025-06-05 Utkarsh Pathak , Chandra Sai Krishna Gunda , Anusha Prakash , Keshav Agarwal , Hema A. Murthy

Recent advancements in text-to-speech (TTS) synthesis show that large-scale models trained with extensive web data produce highly natural-sounding output. However, such data is scarce for Indian languages due to the lack of high-quality,…

Text-to-Speech (TTS) models have advanced significantly, aiming to accurately replicate human speech's diversity, including unique speaker identities and linguistic nuances. Despite these advancements, achieving an optimal balance between…

音频与语音处理 · 电气工程与系统科学 2024-08-28 Jinhyeok Yang , Junhyeok Lee , Hyeong-Seok Choi , Seunghun Ji , Hyeongju Kim , Juheon Lee

Recently, there has been a growing interest in text-to-speech (TTS) methods that can be trained with minimal supervision by combining two types of discrete speech representations and using two sequence-to-sequence tasks to decouple TTS.…

声音 · 计算机科学 2023-12-19 Chunyu Qiang , Hao Li , Hao Ni , He Qu , Ruibo Fu , Tao Wang , Longbiao Wang , Jianwu Dang

Neural Text-to-speech (TTS) synthesis is a powerful technology that can generate speech using neural networks. One of the most remarkable features of TTS synthesis is its capability to produce speech in the voice of different speakers. This…

音频与语音处理 · 电气工程与系统科学 2024-02-19 Vinotha R , Hepsiba D , L. D. Vijay Anand , Deepak John Reji

This paper presents a method for end-to-end cross-lingual text-to-speech (TTS) which aims to preserve the target language's pronunciation regardless of the original speaker's language. The model used is based on a non-attentive Tacotron…

Recent advancements in Text-to-Speech (TTS) technology have led to natural-sounding speech for English, primarily due to the availability of large-scale, high-quality web data. However, many other languages lack access to such resources,…

计算与语言 · 计算机科学 2024-10-24 Srija Anand , Praveen Srinivasa Varadhan , Mehak Singal , Mitesh M. Khapra

We propose Guided-TTS 2, a diffusion-based generative model for high-quality adaptive TTS using untranscribed data. Guided-TTS 2 combines a speaker-conditional diffusion model with a speaker-dependent phoneme classifier for adaptive…

声音 · 计算机科学 2022-06-01 Sungwon Kim , Heeseung Kim , Sungroh Yoon

Scaling text-to-speech to a large and wild dataset has been proven to be highly effective in achieving timbre and speech style generalization, particularly in zero-shot TTS. However, previous works usually encode speech into latent using…

音频与语音处理 · 电气工程与系统科学 2023-06-07 Ziyue Jiang , Yi Ren , Zhenhui Ye , Jinglin Liu , Chen Zhang , Qian Yang , Shengpeng Ji , Rongjie Huang , Chunfeng Wang , Xiang Yin , Zejun Ma , Zhou Zhao

The rapid development of large-scale text-to-speech (TTS) models has led to significant advancements in modeling diverse speaker prosody and voices. However, these models often face issues such as slow inference speeds, reliance on complex…

音频与语音处理 · 电气工程与系统科学 2024-09-17 Yinghao Aaron Li , Xilin Jiang , Cong Han , Nima Mesgarani

Recently, end-to-end multi-speaker text-to-speech (TTS) systems gain success in the situation where a lot of high-quality speech plus their corresponding transcriptions are available. However, laborious paired data collection processes…

音频与语音处理 · 电气工程与系统科学 2020-08-05 Tao Tu , Yuan-Jui Chen , Alexander H. Liu , Hung-yi Lee

While neural text-to-speech (TTS) has achieved human-like natural synthetic speech, multilingual TTS systems are limited to resource-rich languages due to the need for paired text and studio-quality audio data. This paper proposes a method…

音频与语音处理 · 电气工程与系统科学 2023-05-30 Takaaki Saeki , Soumi Maiti , Xinjian Li , Shinji Watanabe , Shinnosuke Takamichi , Hiroshi Saruwatari

We introduce a text-to-speech(TTS) framework based on a neural transducer. We use discretized semantic tokens acquired from wav2vec2.0 embeddings, which makes it easy to adopt a neural transducer for the TTS framework enjoying its monotonic…

音频与语音处理 · 电气工程与系统科学 2023-11-09 Minchan Kim , Myeonghun Jeong , Byoung Jin Choi , Dongjune Lee , Nam Soo Kim

Text-to-speech (TTS) systems are an important component in voice-based e-commerce applications. These applications include end-to-end voice assistant and customer experience (CX) voice bot. Code-mixed TTS is also relevant in these…

机器学习 · 计算机科学 2023-12-05 Raviraj Joshi , Nikesh Garera

Recently, deep learning-based Text-to-Speech (TTS) systems have achieved high-quality speech synthesis results. Recurrent neural networks have become a standard modeling technique for sequential data in TTS systems and are widely used.…

声音 · 计算机科学 2024-03-19 Ziqi Liang , Haoxiang Shi , Jiawei Wang , Keda Lu

We present MunTTS, an end-to-end text-to-speech (TTS) system specifically for Mundari, a low-resource Indian language of the Austo-Asiatic family. Our work addresses the gap in linguistic technology for underrepresented languages by…

计算与语言 · 计算机科学 2024-01-30 Varun Gumma , Rishav Hada , Aditya Yadavalli , Pamir Gogoi , Ishani Mondal , Vivek Seshadri , Kalika Bali

We introduce SPEAR-TTS, a multi-speaker text-to-speech (TTS) system that can be trained with minimal supervision. By combining two types of discrete speech representations, we cast TTS as a composition of two sequence-to-sequence tasks:…

This paper introduces DiFlow-TTS, a novel zero-shot text-to-speech (TTS) system that employs discrete flow matching for generative speech modeling. We position this work as an entry point that may facilitate further advances in this…

The language diversity in India's education sector poses a significant challenge, hindering inclusivity. Despite the democratization of knowledge through online educational content, the dominance of English, as the internet's lingua franca,…

计算与语言 · 计算机科学 2024-03-08 Sai Akarsh , Vamshi Raghusimha , Anindita Mondal , Anil Vuppala