English
Related papers

Related papers: Where Are We At with Automatic Speech Recognition …

200 papers

Speech separation has been successfully applied as a frontend processing module of conversation transcription systems thanks to its ability to handle overlapped speech and its flexibility to combine with downstream tasks such as automatic…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-06 Jian Wu , Zhuo Chen , Sanyuan Chen , Yu Wu , Takuya Yoshioka , Naoyuki Kanda , Shujie Liu , Jinyu Li

This work explores fine-tuning OpenAI's Whisper automatic speech recognition (ASR) model for Amharic, a low-resource language, to improve transcription accuracy. While the foundational Whisper model struggles with Amharic due to limited…

Transcribing meetings containing overlapped speech with only a single distant microphone (SDM) has been one of the most challenging problems for automatic speech recognition (ASR). While various approaches have been proposed, all previous…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-14 Naoyuki Kanda , Guoli Ye , Yu Wu , Yashesh Gaur , Xiaofei Wang , Zhong Meng , Zhuo Chen , Takuya Yoshioka

Thanks to the rise of self-supervised learning, automatic speech recognition (ASR) systems now achieve near-human performance on a wide variety of datasets. However, they still lack generalization capability and are not robust to domain…

Machine Learning · Computer Science 2023-03-15 Lucas Maison , Yannick Estève

Although modern multilingual Automatic Speech Recognition (ASR) systems support several Nigerian languages, their performance consistently lags behind high-resource languages like English and French. Nigerian languages present unique…

Computation and Language · Computer Science 2026-05-19 Sewade Ogun

To better model the contextual information and increase the generalization ability of Speech Activity Detection (SAD) system, this paper leverages a multi-lingual Automatic Speech Recognition (ASR) system to perform SAD. Sequence…

Sound · Computer Science 2021-04-13 Seyyed Saeed Sarfjoo , Srikanth Madikeri , Petr Motlicek

In the FAME! project, we aim to develop an automatic speech recognition (ASR) system for Frisian-Dutch code-switching (CS) speech extracted from the archives of a local broadcaster with the ultimate goal of building a spoken document…

Computation and Language · Computer Science 2018-10-24 Emre Yılmaz , Mitchell McLaren , Henk van den Heuvel , David A. van Leeuwen

Multilingual Automatic Speech Recognition (ASR) models are typically evaluated in a setting where the ground-truth language of the speech utterance is known, however, this is often not the case for most practical settings. Automatic Spoken…

Computation and Language · Computer Science 2024-09-30 Brian Yan , Vineel Pratap , Shinji Watanabe , Michael Auli

An ideal speech recognition model has the capability to transcribe speech accurately under various characteristics of speech signals, such as speaking style (read and spontaneous), speech context (formal and informal), and background noise…

Computation and Language · Computer Science 2024-10-15 Aulia Adila , Dessi Lestari , Ayu Purwarianti , Dipta Tanaya , Kurniawati Azizah , Sakriani Sakti

Although Automatic Speech Recognition (ASR) systems have achieved human-like performance for a few languages, the majority of the world's languages do not have usable systems due to the lack of large speech datasets to train these models.…

Computation and Language · Computer Science 2022-02-28 Hemant Yadav , Sunayana Sitaram

India is the second largest English-speaking country in the world with a speaker base of roughly 130 million. Thus, it is imperative that automatic speech recognition (ASR) systems for English should be evaluated on Indian accents.…

Automatic speech recognition (ASR) systems have been shown to have large quality disparities between the language varieties they are intended or expected to recognize. One way to mitigate this is to train or fine-tune models with more…

Automatic Speech Recognition (ASR) systems have become ubiquitous in everyday applications, yet significant disparities in performance across diverse demographic groups persist. In this work, we introduce the ASR-FAIRBENCH leaderboard which…

Sound · Computer Science 2025-05-20 Anand Rai , Satyam Rahangdale , Utkarsh Anand , Animesh Mukherjee

We propose a general framework to compute the word error rate (WER) of ASR systems that process recordings containing multiple speakers at their input and that produce multiple output word sequences (MIMO). Such ASR systems are typically…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-24 Thilo von Neumann , Christoph Boeddeker , Keisuke Kinoshita , Marc Delcroix , Reinhold Haeb-Umbach

Hallucinations in automatic speech recognition (ASR) systems refer to fluent and coherent transcriptions produced by neural ASR models that are completely unrelated to the underlying acoustic input (i.e., the speech signal). While similar…

Computation and Language · Computer Science 2025-10-21 Alkis Koudounas , Moreno La Quatra , Manuel Giollo , Sabato Marco Siniscalchi , Elena Baralis

Recent advances in machine learning have demonstrated that multi-modal pre-training can improve automatic speech recognition (ASR) performance compared to randomly initialized models, even when models are fine-tuned on uni-modal tasks.…

Computation and Language · Computer Science 2024-04-01 Yash Jain , David Chan , Pranav Dheram , Aparna Khare , Olabanji Shonibare , Venkatesh Ravichandran , Shalini Ghosh

Automatic Speech Recognition (ASR) has been extensively investigated, yet prior benchmarks have largely focused on assessing the acoustic robustness of ASR models, leaving evaluations of their linguistic capabilities relatively…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-07 He Wang , Linhan Ma , Dake Guo , Xiong Wang , Lei Xie , Jin Xu , Junyang Lin

This study investigates the impact of integrating a dataset of disordered speech recordings ($\sim$1,000 hours) into the fine-tuning of a near state-of-the-art ASR baseline system. Contrary to what one might expect, despite the data being…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-22 Jimmy Tobin , Katrin Tomanek , Subhashini Venugopalan

As Automatic Speech Recognition (ASR) is increasingly deployed in clinical dialogue, standard evaluations still rely heavily on Word Error Rate (WER). This paper challenges that standard, investigating whether WER or other common metrics…

Computation and Language · Computer Science 2026-01-21 Zachary Ellis , Jared Joselowitz , Yash Deo , Yajie He , Anna Kalygina , Aisling Higham , Mana Rahimzadeh , Yan Jia , Ibrahim Habli , Ernest Lim

In this paper, we propose a self-training approach for automatic speech recognition (ASR) for low-resource settings. While self-training approaches have been extensively developed and evaluated for high-resource languages such as English,…

Computation and Language · Computer Science 2023-08-11 Satwinder Singh , Feng Hou , Ruili Wang