English
Related papers

Related papers: Bolbosh: Script-Aware Flow Matching for Kashmiri T…

200 papers

Several high-resource Text to Speech (TTS) systems currently produce natural, well-established human-like speech. In contrast, low-resource languages, including Arabic, have very limited TTS systems due to the lack of resources. We propose…

Computation and Language · Computer Science 2023-01-27 Massa Baali , Tomoki Hayashi , Hamdy Mubarak , Soumi Maiti , Shinji Watanabe , Wassim El-Hajj , Ahmed Ali

While deep learning-based text-to-speech (TTS) models such as VITS have shown excellent results, they typically require a sizable set of high-quality <text, audio> pairs to train, which is expensive to collect. So far, most languages in the…

Sound · Computer Science 2023-01-05 Xin Yuan , Robin Feng , Mingming Ye

Modern zero-shot text-to-speech (TTS) systems, despite using extensive pre-training, often struggle in challenging scenarios such as tongue twisters, repeated words, code-switching, and cross-lingual synthesis, leading to intelligibility…

Sound · Computer Science 2025-06-09 Xueyao Zhang , Yuancheng Wang , Chaoren Wang , Ziniu Li , Zhuo Chen , Zhizheng Wu

This technical report presents the 600K-KS-OCR Dataset, a large-scale synthetic corpus comprising approximately 602,000 word-level segmented images designed for training and evaluating optical character recognition systems targeting…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Haq Nawaz Malik

We present OmniVoice, a massively multilingual zero-shot text-to-speech (TTS) model that scales to over 600 languages. At its core is a novel diffusion language model-style discrete non-autoregressive (NAR) architecture. Unlike conventional…

Computation and Language · Computer Science 2026-04-22 Han Zhu , Lingxuan Ye , Wei Kang , Zengwei Yao , Liyong Guo , Fangjun Kuang , Zhifeng Han , Weiji Zhuang , Long Lin , Daniel Povey

Recent advancements in text-to-speech (TTS) synthesis show that large-scale models trained with extensive web data produce highly natural-sounding output. However, such data is scarce for Indian languages due to the lack of high-quality,…

Zero-shot Text-to-Speech (TTS) has recently advanced significantly, enabling models to synthesize speech from text using short, limited-context prompts. These prompts serve as voice exemplars, allowing the model to mimic speaker identity,…

Sound · Computer Science 2025-10-06 Hieu-Nghia Huynh-Nguyen , Huynh Nguyen Dang , Ngoc-Son Nguyen , Van Nguyen

Intra-sentence multilingual speech synthesis (code-switching TTS) remains a major challenge due to abrupt language shifts, varied scripts, and mismatched prosody between languages. Conventional TTS systems are typically monolingual and fail…

Sound · Computer Science 2025-10-30 Dharma Teja Donepudi

At present, Text-to-speech (TTS) systems that are trained with high-quality transcribed speech data using end-to-end neural models can generate speech that is intelligible, natural, and closely resembles human speech. These models are…

Computation and Language · Computer Science 2023-03-02 Ajinkya Kulkarni , Atharva Kulkarni , Sara Abedalmonem Mohammad Shatnawi , Hanan Aldarmaki

Machine Translation System (MTS) serves as an effective tool for communication by translating text or speech from one language to another language. The need of an efficient translation system becomes obvious in a large multilingual…

Computation and Language · Computer Science 2024-03-18 Sudhansu Bala Das , Atharv Biradar , Tapas Kumar Mishra , Bidyut Kumar Patra

Text-to-Speech (TTS) synthesis for low-resource languages is an attractive research issue in academia and industry nowadays. Mongolian is the official language of the Inner Mongolia Autonomous Region and a representative low-resource…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-03 Kailin Liang , Bin Liu , Yifan Hu , Rui Liu , Feilong Bao , Guanglai Gao

Text-to-speech (TTS) systems that scale up the amount of training data have achieved significant improvements in zero-shot speech synthesis. However, these systems have certain limitations: they require a large amount of training data,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-07 Taejun Bak , Youngsik Eom , SeungJae Choi , Young-Sun Joo

Bengali is spoken by over 230 million people yet remains severely under-served in automatic speech recognition (ASR) and speaker diarization research. In this paper, we present our system for the DL Sprint 4.0 Bengali Long-Form Speech…

Computation and Language · Computer Science 2026-03-23 Md. Nazmus Sakib , Shafiul Tanvir , Mesbah Uddin Ahamed , H. M. Aktaruzzaman Mukdho

While neural methods for text-to-speech (TTS) have shown great advances in modeling multiple speakers, even in zero-shot settings, the amount of data needed for those approaches is generally not feasible for the vast majority of the world's…

Computation and Language · Computer Science 2022-10-25 Florian Lux , Julia Koch , Ngoc Thang Vu

Persian remains substantially underrepresented in open speech-text resources, limiting progress in multi-speaker text-to-speech (TTS), speech-language modelling, and low-resource speech processing. We introduce ParsVoice, the largest…

Sound · Computer Science 2026-05-27 Mohammad Javad Ranjbar Kalahroodi , Heshaam Faili , Azadeh Shakery

Token-based text-to-speech (TTS) models have emerged as a promising avenue for generating natural and realistic speech, yet they grapple with low pronunciation accuracy, speaking style and timbre inconsistency, and a substantial need for…

Sound · Computer Science 2024-03-12 Chunhui Wang , Chang Zeng , Bowen Zhang , Ziyang Ma , Yefan Zhu , Zifeng Cai , Jian Zhao , Zhonglin Jiang , Yong Chen

We present MunTTS, an end-to-end text-to-speech (TTS) system specifically for Mundari, a low-resource Indian language of the Austo-Asiatic family. Our work addresses the gap in linguistic technology for underrepresented languages by…

Computation and Language · Computer Science 2024-01-30 Varun Gumma , Rishav Hada , Aditya Yadavalli , Pamir Gogoi , Ishani Mondal , Vivek Seshadri , Kalika Bali

Commercial TTS systems produce near-native Indic audio, but the best open-source bases (Chatterbox, Indic Parler-TTS, IndicF5) trail them on measured phonological dimensions, and the most widely adopted multilingual base (Chatterbox, 23…

Sound · Computer Science 2026-04-29 Venkata Pushpak Teja Menta

This paper reports on the development of a text-to-speech (TTS) system for Mizo, a low-resource, tonal, and Tibeto-Burman language spoken primarily in the Indian state of Mizoram. The TTS was built with only 5.18 hours of data; however, in…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-06 Abhijit Mohanta , Remruatpuii , Priyankoo Sarmah , Rohit Sinha , Wendy Lalhminghlui

In this work, we take on the challenging task of building a single text-to-speech synthesis system that is capable of generating speech in over 7000 languages, many of which lack sufficient data for traditional TTS development. By…

Computation and Language · Computer Science 2024-06-11 Florian Lux , Sarina Meyer , Lyonel Behringer , Frank Zalkow , Phat Do , Matt Coler , Emanuël A. P. Habets , Ngoc Thang Vu