English
Related papers

Related papers: Evaluating ASR Confidence Scores for Automated Err…

200 papers

Automatic Speech Recognition (ASR) systems generalize poorly on accented speech. The phonetic and linguistic variability of accents present hard challenges for ASR systems today in both data collection and modeling strategies. The resulting…

Recent research on word-level confidence estimation for speech recognition systems has primarily focused on lightweight models known as Confidence Estimation Modules (CEMs), which rely on hand-engineered features derived from Automatic…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-20 Vaibhav Aggarwal , Shabari S Nair , Yash Verma , Yash Jogi

Recently, there has been growth in providers of speech transcription services enabling others to leverage technology they would not normally be able to use. As a result, speech-enabled solutions have become commonplace. Their success…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-17 Alexandros Kastanos , Anton Ragni , Mark Gales

Traditional ASR metrics like WER and CER fail to capture intelligibility, especially for dysarthric and dysphonic speech, where semantic alignment matters more than exact word matches. ASR systems struggle with these speech types, often…

Machine Learning · Computer Science 2025-12-12 Bornali Phukon , Xiuwen Zheng , Mark Hasegawa-Johnson

Knowing when a classifier's prediction can be trusted is useful in many applications and critical for safely using AI. While the bulk of the effort in machine learning research has been towards improving classifier performance,…

Machine Learning · Statistics 2018-10-30 Heinrich Jiang , Been Kim , Melody Y. Guan , Maya Gupta

While speech-enabled teachable agents have some advantages over typing-based ones, they are vulnerable to errors stemming from misrecognition by automatic speech recognition (ASR). These errors may propagate, resulting in unexpected changes…

Human-Computer Interaction · Computer Science 2023-06-14 Yuya Asano , Diane Litman , Mingzhi Yu , Nikki Lobczowski , Timothy Nokes-Malach , Adriana Kovashka , Erin Walker

Recent years have witnessed remarkable progress in automatic speech recognition (ASR), driven by advances in model architectures and large-scale training data. However, two important aspects remain underexplored. First, Word Error Rate…

Computation and Language · Computer Science 2026-04-15 Peng Wang , Yanqiao Zhu , Zixuan Jiang , Qinyuan Chen , Xingjian Zhao , Xipeng Qiu , Wupeng Wang , Zhifu Gao , Xiangang Li , Kai Yu , Xie Chen

The standard approach to mitigate errors made by an automatic speech recognition system is to use confidence scores associated with each predicted word. In the simplest case, these scores are word posterior probabilities whilst more complex…

Audio and Speech Processing · Electrical Eng. & Systems 2019-02-19 Qiujia Li , Preben Ness , Anton Ragni , Mark Gales

Recent work in automatic recognition of conversational telephone speech (CTS) has achieved accuracy levels comparable to human transcribers, although there is some debate how to precisely quantify human performance on this task, using the…

Computation and Language · Computer Science 2022-02-22 Andreas Stolcke , Jasha Droppo

Confidence estimation of predictions from an End-to-End (E2E) Automatic Speech Recognition (ASR) model benefits ASR's downstream and upstream tasks. Class-probability-based confidence scores do not accurately represent the quality of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-09 Nagarathna Ravi , Thishyan Raj T , Vipul Arora

Improving the representation of contextual information is key to unlocking the potential of end-to-end (E2E) automatic speech recognition (ASR). In this work, we present a novel and simple approach for training an ASR context mechanism with…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-30 Uri Alon , Golan Pundak , Tara N. Sainath

We propose a new method for the calculation of error rates in Automatic Speech Recognition (ASR). This new metric is for languages that contain half characters and where the same character can be written in different forms. We implement our…

Computation and Language · Computer Science 2022-06-16 Priyanshi Shah , Harveen Singh Chadha , Anirudh Gupta , Ankur Dhuriya , Neeraj Chhimwal , Rishabh Gaur , Vivek Raghavan

It is estimated that around 70 million people worldwide are affected by a speech disorder called stuttering. With recent advances in Automatic Speech Recognition (ASR), voice assistants are increasingly useful in our everyday lives. Many…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-14 Olabanji Shonibare , Xiaosu Tong , Venkatesh Ravichandran

Automatic speech recognition (ASR) system is becoming a ubiquitous technology. Although its accuracy is closing the gap with that of human level under certain settings, one area that can further improve is to incorporate user-specific…

Computation and Language · Computer Science 2020-05-05 Young Mo Kang , Yingbo Zhou

Natural language processing of conversational speech requires the availability of high-quality transcripts. In this paper, we express our skepticism towards the recent reports of very low Word Error Rates (WERs) achieved by modern Automatic…

ASR has achieved remarkable global progress, yet African low-resource languages remain rigorously underrepresented, producing barriers to digital inclusion across the continent with more than +2000 languages. This systematic literature…

Automatic Speech Recognition (ASR) systems can be trained to achieve remarkable performance given large amounts of manually transcribed speech, but large labeled data sets can be difficult or expensive to acquire for all languages of…

Computation and Language · Computer Science 2022-03-22 Hanan Aldarmaki , Asad Ullah , Nazar Zaki

The quality of automatic speech recognition (ASR) is critical to Dialogue Systems as ASR errors propagate to and directly impact downstream tasks such as language understanding (LU). In this paper, we propose multi-task neural approaches to…

Form about four decades human beings have been dreaming of an intelligent machine which can master the natural speech. In its simplest form, this machine should consist of two subsystems, namely automatic speech recognition (ASR) and speech…

Sound · Computer Science 2013-05-08 Urmila Shrawankar , V. M. Thakare

Effective communication in Air Traffic Control (ATC) is critical to maintaining aviation safety, yet the challenges posed by accented English remain largely unaddressed in Automatic Speech Recognition (ASR) systems. Existing models struggle…