English
Related papers

Related papers: More Data, Fewer Diacritics: Scaling Arabic TTS

200 papers

We summarize the results of a host of efforts using giant automatic speech recognition (ASR) models pre-trained using large, diverse unlabeled datasets containing approximately a million hours of audio. We find that the combination of…

In this work we evaluate the utility of synthetic data for training automatic speech recognition (ASR). We use the ASR training data to train a text-to-speech (TTS) system similar to FastSpeech-2. With this TTS we reproduce the original…

Computation and Language · Computer Science 2024-10-29 Benedikt Hilmes , Nick Rossenbach , and Ralf Schlüter

Automated Essay Scoring (AES) plays a crucial role in assessing language learners' writing quality, reducing grading workload, and providing real-time feedback. The lack of annotated essay datasets inhibits the development of Arabic AES…

Computation and Language · Computer Science 2025-06-11 Chatrine Qwaider , Bashar Alhafni , Kirill Chirkunov , Nizar Habash , Ted Briscoe

This paper introduces BnTTS (Bangla Text-To-Speech), the first framework for Bangla speaker adaptation-based TTS, designed to bridge the gap in Bangla speech synthesis using minimal training data. Building upon the XTTS architecture, our…

Text to speech (TTS) and automatic speech recognition (ASR) are two dual tasks in speech processing and both achieve impressive performance thanks to the recent advance in deep learning and large amount of aligned speech and text data.…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-28 Yi Ren , Xu Tan , Tao Qin , Sheng Zhao , Zhou Zhao , Tie-Yan Liu

Pretraining monolingual language models have been proven to be vital for performance in Arabic Natural Language Processing (NLP) tasks. In this paper, we conduct a comprehensive study on the role of data in Arabic Pretrained Language Models…

Computation and Language · Computer Science 2024-01-17 Abbas Ghaddar , Philippe Langlais , Mehdi Rezagholizadeh , Boxing Chen

Over the past three years, the rapid advancement of Large Language Models (LLMs) has had a profound impact on multiple areas of Artificial Intelligence (AI), particularly in Natural Language Processing (NLP) across diverse languages,…

Computation and Language · Computer Science 2025-05-14 Haneh Rhel , Dmitri Roussinov

High-quality Text-to-Speech (TTS) model training requires extensive and diverse text and speech data. It is challenging to procure such data from real sources due to issues of domain specificity, licensing, and scalability. Large language…

Computation and Language · Computer Science 2025-10-03 Karan Dua , Puneet Mittal , Ranjeet Gupta , Hitesh Laxmichand Patel

Automatic speech recognition for low-resource languages remains fundamentally constrained by the scarcity of labeled data and computational resources required by state-of-the-art models. We present a systematic investigation into…

Computation and Language · Computer Science 2025-12-09 Srihari Bandarupalli , Bhavana Akkiraju , Charan Devarakonda , Vamsiraghusimha Narsinga , Anil Kumar Vuppala

High-quality audio data is a critical prerequisite for training robust text-to-speech models, which often limits the use of opportunistic or crowdsourced datasets. This paper presents an approach to overcome this limitation by implementing…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-18 José Giraldo , Martí Llopart-Font , Alex Peiró-Lilja , Carme Armentano-Oller , Gerard Sant , Baybars Külebi

Recently, there has been a vast interest in self-supervised learning (SSL) where the model is pre-trained on large scale unlabeled data and then fine-tuned on a small labeled dataset. The common wisdom is that SSL helps resource-limited…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-13 Chengyi Wang , Yu Wu , Shujie Liu , Jinyu Li , Yao Qian , Kenichi Kumatani , Furu Wei

We present state-of-the-art results on morphosyntactic tagging across different varieties of Arabic using fine-tuned pre-trained transformer language models. Our models consistently outperform existing systems in Modern Standard Arabic and…

Computation and Language · Computer Science 2022-03-22 Go Inoue , Salam Khalifa , Nizar Habash

The rapid growth of social media has amplified the spread of offensive, violent, and vulgar speech, which poses serious societal and cybersecurity concerns. Detecting such content in Arabic text is particularly complex due to limited…

Computation and Language · Computer Science 2025-06-04 Aisha Alansari , Hamzah Luqman

This paper presents FOOCTTS, an automatic pipeline for a football commentator that generates speech with background crowd noise. The application gets the text from the user, applies text pre-processing such as vowelization, followed by the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-14 Massa Baali , Ahmed Ali

Personalized TTS is an exciting and highly desired application that allows users to train their TTS voice using only a few recordings. However, TTS training typically requires many hours of recording and a large model, making it unsuitable…

Sound · Computer Science 2023-03-22 Sung-Feng Huang , Chia-ping Chen , Zhi-Sheng Chen , Yu-Pao Tsai , Hung-yi Lee

Large Language Models (LLMs) have shown impressive results in multiple domains of natural language processing (NLP) but are mainly focused on the English language. Recently, more LLMs have incorporated a larger proportion of multilingual…

Text-to-Speech (TTS) system is a system where speech is synthesized from a given text following any particular approach. Concatenative synthesis, Hidden Markov Model (HMM) based synthesis, Deep Learning (DL) based synthesis with multiple…

Sound · Computer Science 2021-08-03 Prithwiraj Bhattacharjee , Rajan Saha Raju , Arif Ahmad , M. Shahidur Rahman

Recently, pre-trained transformer-based architectures have proven to be very efficient at language modeling and understanding, given that they are trained on a large enough corpus. Applications in language generation for Arabic are still…

Computation and Language · Computer Science 2021-03-09 Wissam Antoun , Fady Baly , Hazem Hajj

Ramsa is a developing 41-hour speech corpus of Emirati Arabic designed to support sociolinguistic research and low-resource language technologies. It contains recordings from structured interviews with native speakers and episodes from…

Computation and Language · Computer Science 2026-03-10 Rania Al-Sabbagh

Audio deepfake detection (ADD) is essential for preventing the misuse of synthetic voices that may infringe on personal rights and privacy. Recent zero-shot text-to-speech (TTS) models pose higher risks as they can clone voices with a…

Sound · Computer Science 2024-09-23 Yuang Li , Min Zhang , Mengxin Ren , Miaomiao Ma , Daimeng Wei , Hao Yang