English
Related papers

Related papers: Thaka at KSAA-2026 Task 2: Regularized Fine-Tuning…

200 papers

Arabic is known to present unique challenges for Automatic Speech Recognition (ASR). On one hand, its rich linguistic diversity and wide range of dialects complicate the development of robust, inclusive models. On the other, current…

Computation and Language · Computer Science 2024-06-10 Abdul Waheed , Karima Kadaoui , Muhammad Abdul-Mageed

We introduce ArVoice, a multi-speaker Modern Standard Arabic (MSA) speech corpus with diacritized transcriptions, intended for multi-speaker speech synthesis, and can be useful for other tasks such as speech-based diacritic restoration,…

Computation and Language · Computer Science 2025-05-28 Hawau Olamide Toyin , Rufael Marew , Humaid Alblooshi , Samar M. Magdy , Hanan Aldarmaki

In this paper, we tackle the Arabic Fine-Grained Hate Speech Detection shared task and demonstrate significant improvements over reported baselines for its three subtasks. The tasks are to predict if a tweet contains (1) Offensive language;…

Computation and Language · Computer Science 2022-05-18 Badr AlKhamissi , Mona Diab

Automatic Speech Recognition (ASR) and speaker diarization in Bangla remain challenging due to long form recordings, diverse acoustic conditions, and significant speaker variability. This work addresses these two core tasks in Bangla spoken…

Whisper, the recently developed multilingual weakly supervised model, is reported to perform well on multiple speech recognition benchmarks in both monolingual and multilingual settings. However, it is not clear how Whisper would fare under…

Computation and Language · Computer Science 2023-06-06 Bashar Talafha , Abdul Waheed , Muhammad Abdul-Mageed

In many languages like Arabic, diacritics are used to specify pronunciations as well as meanings. Such diacritics are often omitted in written text, increasing the number of possible pronunciations and meanings for a word. This results in a…

Computation and Language · Computer Science 2020-06-09 Sawsan Alqahtani , Ajay Mishra , Mona Diab

Verbatim transcription for automatic speaking assessment demands accurate capture of disfluencies, crucial for downstream tasks like error analysis and feedback. However, many ASR systems discard or generalize hesitations, losing important…

Computation and Language · Computer Science 2025-07-28 Jhen-Ke Lin , Hao-Chien Lu , Chung-Chun Wang , Hong-Yun Lin , Berlin Chen

This paper describes our speaker diarization system submitted to the Multi-channel Multi-party Meeting Transcription (M2MeT) challenge, where Mandarin meeting data were recorded in multi-channel format for diarization and automatic speech…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-07 Naijun Zheng , Na Li , Xixin Wu , Lingwei Meng , Jiawen Kang , Haibin Wu , Chao Weng , Dan Su , Helen Meng

Despite major advancements in Automatic Speech Recognition (ASR), the state-of-the-art ASR systems struggle to deal with impaired speech even with high-resource languages. In Arabic, this challenge gets amplified, with added complexities in…

Sound · Computer Science 2023-06-08 Massa Baali , Ibrahim Almakky , Shady Shehata , Fakhri Karray

Self-supervised learning (SSL) has shown significant progress in speech processing tasks. However, despite the intrinsic randomness in the Transformer structure, such as dropout variants and layer-drop, improving the model-level consistency…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-16 Ji Won Yoon , Seok Min Kim , Nam Soo Kim

In this work, we propose an error correction framework, named DiaCorrect, to refine the output of a diarization system in a simple yet effective way. This method is inspired by error correction techniques in automatic speech recognition.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-18 Jiangyu Han , Federico Landini , Johan Rohdin , Mireia Diez , Lukas Burget , Yuhang Cao , Heng Lu , Jan Cernocky

Dialectal Arabic (DA) speech data vary widely in domain coverage, dialect labeling practices, and recording conditions, complicating cross-dataset comparison and model evaluation. To characterize this landscape, we conduct a computational…

Computation and Language · Computer Science 2026-01-30 Peter Sullivan , AbdelRahim Elmadany , Alcides Alcoba Inciarte , Muhammad Abdul-Mageed

We present ArTST, a pre-trained Arabic text and speech transformer for supporting open-source speech technologies for the Arabic language. The model architecture follows the unified-modal framework, SpeechT5, that was recently released for…

Computation and Language · Computer Science 2023-10-26 Hawau Olamide Toyin , Amirbek Djanibekov , Ajinkya Kulkarni , Hanan Aldarmaki

Diacritics (short vowels) are typically omitted when writing Arabic text, and readers have to reintroduce them to correctly pronounce words. There are two types of Arabic diacritics: the first are core-word diacritics (CW), which specify…

Computation and Language · Computer Science 2020-02-05 Kareem Darwish , Ahmed Abdelali , Hamdy Mubarak , Mohamed Eldesouki

In this technical report, we describe our submission for the WildSpoof Challenge TTS Track: Text-to-Speech with In-the-Wild Data. We introduce F5-TTS-DPS, a model built upon the F5-TTS architecture. Our approach integrates Exponential…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-25 Renhe Sun , Jiayi Zhou , Haolin He , Yueying Feng , Jian Liu

We explore the performance of several state-of-the-art automatic speech recognition (ASR) models on a large-scale Arabic speech dataset, the SADA (Saudi Audio Dataset for Arabic), which contains 668 hours of high-quality audio from Saudi…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-19 Branislav Gerazov , Marcello Politi , Sébastien Bratières

In this work we present our expert system of Automatic reading or speech synthesis based on a text written in Standard Arabic, our work is carried out in two great stages: the creation of the sound data base, and the transformation of the…

Computation and Language · Computer Science 2014-05-09 Tebbi Hanane , Azzoune Hamid

This work is an attempt to introduce a comprehensive benchmark for Arabic speech recognition, specifically tailored to address the challenges of telephone conversations in Arabic language. Arabic, characterized by its rich dialectal…

Artificial Intelligence · Computer Science 2024-05-31 Qusai Abo Obaidah , Muhy Eddin Za'ter , Adnan Jaljuli , Ali Mahboub , Asma Hakouz , Bashar Al-Rfooh , Yazan Estaitia

Whisper and other large-scale automatic speech recognition models have made significant progress in performance. However, their performance on many low-resource languages, such as Kazakh, is not satisfactory. It is worth researching how to…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-08 Jinpeng Li , Yu Pu , Qi Sun , Wei-Qiang Zhang

This paper proposes a simple yet effective way of regularising the encoder-decoder-based automatic speech recognition (ASR) models that enhance the robustness of the model and improve the generalisation to out-of-domain scenarios. The…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-24 Alexander Polok , Santosh Kesiraju , Karel Beneš , Lukáš Burget , Jan Černocký