English
Related papers

Related papers: Open Automatic Speech Recognition Models for Class…

200 papers

Arabic remains one of the most underrepresented languages in natural language processing research, particularly in medical applications, due to the limited availability of open-source data and benchmarks. The lack of resources hinders…

Computation and Language · Computer Science 2026-02-03 Mouath Abu-Daoud , Leen Kharouf , Omar El Hajj , Dana El Samad , Mariam Al-Omari , Jihad Mallat , Khaled Saleh , Nizar Habash , Farah E. Shamout

Approaching Speech-to-Text and Automatic Speech Recognition problems in low-resource languages is notoriously challenging due to the scarcity of validated datasets and the diversity of dialects. Arabic, Russian, and Portuguese exemplify…

Computation and Language · Computer Science 2025-01-03 Or Haim Anidjar , Revital Marbel , Roi Yozevitch

We describe the winning system for Task 2 of the KSAA-2026 Shared Task on Arabic Speech Dictation with Automatic Diacritization. The task requires producing fully diacritized Arabic text from speech audio and undiacritized transcripts, with…

Computation and Language · Computer Science 2026-05-26 Meshal Alamr , Hassan Alqaeri , Abdullah Aldahlawi

High quality Automatic Speech Recognition (ASR) is a prerequisite for speech-based applications and research. While state-of-the-art ASR software is freely available, the language dependent acoustic models are lacking for languages other…

Computation and Language · Computer Science 2018-07-30 Benjamin Milde , Arne Köhn

In this work, we demonstrate the existence of universal adversarial audio perturbations that cause mis-transcription of audio signals by automatic speech recognition (ASR) systems. We propose an algorithm to find a single…

Machine Learning · Computer Science 2019-08-16 Paarth Neekhara , Shehzeen Hussain , Prakhar Pandey , Shlomo Dubnov , Julian McAuley , Farinaz Koushanfar

Spoken question answering (SQA) is challenging due to complex reasoning on top of the spoken documents. The recent studies have also shown the catastrophic impact of automatic speech recognition (ASR) errors on SQA. Therefore, this work…

Computation and Language · Computer Science 2019-04-18 Chia-Hsuan Lee , Yun-Nung Chen , Hung-Yi Lee

We present an end-to-end multichannel speaker-attributed automatic speech recognition (MC-SA-ASR) system that combines a Conformer-based encoder with multi-frame crosschannel attention and a speaker-attributed Transformer-based decoder. To…

Computation and Language · Computer Science 2023-10-17 Can Cui , Imran Ahamad Sheikh , Mostafa Sadeghi , Emmanuel Vincent

Diacritization of Arabic text is both an interesting and a challenging problem at the same time with various applications ranging from speech synthesis to helping students learning the Arabic language. Like many other tasks or problems in…

Computation and Language · Computer Science 2019-05-07 Ali Fadel , Ibraheem Tuffaha , Bara' Al-Jawarneh , Mahmoud Al-Ayyoub

Automatic Speech Recognition (ASR) systems in real-world settings need to handle imperfect audio, often degraded by hardware limitations or environmental noise, while accommodating diverse user groups. In human-robot interaction (HRI),…

Robotics · Computer Science 2025-08-26 Theresa Pekarek Rosin , Julia Gachot , Henri-Leon Kordt , Matthias Kerzel , Stefan Wermter

During conversations, humans are capable of inferring the intention of the speaker at any point of the speech to prepare the following action promptly. Such ability is also the key for conversational systems to achieve rhythmic and natural…

Sound · Computer Science 2022-11-03 Huaibo Zhao , Shinya Fujie , Tetsuji Ogawa , Jin Sakuma , Yusuke Kida , Tetsunori Kobayashi

Only a handful of the world's languages are abundant with the resources that enable practical applications of speech processing technologies. One of the methods to overcome this problem is to use the resources existing in other languages to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Piotr Żelasko , Laureano Moro-Velázquez , Mark Hasegawa-Johnson , Odette Scharenborg , Najim Dehak

Code-switching -- the natural alternation between two languages within a single utterance -- remains one of the most challenging and under-studied conditions for automatic speech recognition (ASR). We present a benchmark evaluating five…

Computation and Language · Computer Science 2026-05-25 Sajjad Abdoli , Ghassan Al-Sumaidaee , Clayton W. Taylor , Ahmad ElShiekh , Ahmed Rashad

Speech-based open-domain question answering (QA over a large corpus of text passages with spoken questions) has emerged as an important task due to the increasing number of users interacting with QA systems via speech interfaces. Passage…

Computation and Language · Computer Science 2024-09-23 Georgios Sidiropoulos , Evangelos Kanoulas

Large self-supervised speech (SSL) models achieve strong downstream performance, but their size limits deployment in resource-constrained settings. We present HArnESS, an Arabic-centric self-supervised speech model family trained from…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-17 Vrunda N. Sukhadia , Shammur Absar Chowdhury

This paper explores the pitfalls in evaluating multilingual automatic speech recognition (ASR) models, with a particular focus on Indic language scripts. We investigate the text normalization routine employed by leading ASR models,…

Computation and Language · Computer Science 2024-11-12 Kavya Manohar , Leena G Pillai , Elizabeth Sherly

Automatic Speech Recognition (ASR) systems have become ubiquitous in everyday applications, yet significant disparities in performance across diverse demographic groups persist. In this work, we introduce the ASR-FAIRBENCH leaderboard which…

Sound · Computer Science 2025-05-20 Anand Rai , Satyam Rahangdale , Utkarsh Anand , Animesh Mukherjee

In this work we present our expert system of Automatic reading or speech synthesis based on a text written in Standard Arabic, our work is carried out in two great stages: the creation of the sound data base, and the transformation of the…

Computation and Language · Computer Science 2014-05-09 Tebbi Hanane , Azzoune Hamid

State-of-the-art large-scale universal speech models (USMs) show a decent automatic speech recognition (ASR) performance across multiple domains and languages. However, it remains a challenge for these models to recognize overlapped speech,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-31 Chenda Li , Yao Qian , Zhuo Chen , Naoyuki Kanda , Dongmei Wang , Takuya Yoshioka , Yanmin Qian , Michael Zeng

We present ZAEBUC-Spoken, a multilingual multidialectal Arabic-English speech corpus. The corpus comprises twelve hours of Zoom meetings involving multiple speakers role-playing a work situation where Students brainstorm ideas for a certain…

Computation and Language · Computer Science 2024-03-28 Injy Hamed , Fadhl Eryani , David Palfreyman , Nizar Habash

Large Automatic Speech Recognition (ASR) models demand a vast number of parameters, copious amounts of data, and significant computational resources during the training process. However, such models can merely be deployed on high-compute…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-23 Xingchen Song , Chengdong Liang , Binbin Zhang , Pengshen Zhang , ZiYu Wang , Youcheng Ma , Menglong Xu , Lin Wang , Di Wu , Fuping Pan , Dinghao Zhou , Zhendong Peng