English
Related papers

Related papers: Aligning ASR Evaluation with Human and LLM Judgmen…

200 papers

While Automatic Speech Recognition (ASR) is typically benchmarked by word error rate (WER), real-world applications ultimately hinge on semantic fidelity. This mismatch is particularly problematic for dysarthric speech, where articulatory…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-30 Xiuwen Zheng , Sixun Dong , Bornali Phukon , Mark Hasegawa-Johnson , Chang D. Yoo

Despite the remarkable progress in end-to-end Automatic Speech Recognition (ASR) engines, accurately transcribing dysarthric speech remains a major challenge. In this work, we proposed a two-stage framework for the Speech Accessibility…

Computation and Language · Computer Science 2025-05-27 Moreno La Quatra , Alkis Koudounas , Valerio Mario Salerno , Sabato Marco Siniscalchi

Automatic speech recognition (ASR) is a core component of human--computer interaction and an increasingly important front-end for LLM-based assistants and agents. However, most current ASR systems still follow a single-pass paradigm, which…

Artificial Intelligence · Computer Science 2026-05-29 Zixuan Jiang , Yanqiao Zhu , Peng Wang , Qinyuan Chen , Xinjian Zhao , Xipeng Qiu , Wupeng Wang , Zhifu Gao , Xiangang Li , Kai Yu , Xie Chen

Recent years have witnessed remarkable progress in automatic speech recognition (ASR), driven by advances in model architectures and large-scale training data. However, two important aspects remain underexplored. First, Word Error Rate…

Computation and Language · Computer Science 2026-04-15 Peng Wang , Yanqiao Zhu , Zixuan Jiang , Qinyuan Chen , Xingjian Zhao , Xipeng Qiu , Wupeng Wang , Zhifu Gao , Xiangang Li , Kai Yu , Xie Chen

Speech Recognition (ASR) due to phoneme distortions and high variability. While self-supervised ASR models like Wav2Vec, HuBERT, and Whisper have shown promise, their effectiveness in dysarthric speech remains unclear. This study…

Sound · Computer Science 2025-08-12 Ahmed Aboeitta , Ahmed Sharshar , Youssef Nafea , Shady Shehata

Modern speech synthesis systems have improved significantly, with synthetic speech being indistinguishable from real speech. However, efficient and holistic evaluation of synthetic speech still remains a significant challenge. Human…

Computation and Language · Computer Science 2023-10-03 Dareen Alharthi , Roshan Sharma , Hira Dhamyal , Soumi Maiti , Bhiksha Raj , Rita Singh

Automatic Speech Recognition (ASR) plays a crucial role in human-machine interaction and serves as an interface for a wide range of applications. Traditionally, ASR performance has been evaluated using Word Error Rate (WER), a metric that…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-23 Sujith Pulikodan , Sahapthan K , Prasanta Kumar Ghosh , Visruth Sanka , Nihar Desai

Automatic Speech Recognition (ASR) is traditionally evaluated using Word Error Rate (WER), a metric that is insensitive to meaning. Embedding-based semantic metrics are better correlated with human perception, but decoder-based Large…

Recent advances in supervised, semi-supervised and self-supervised deep learning algorithms have shown significant improvement in the performance of automatic speech recognition(ASR) systems. The state-of-the-art systems have achieved a…

Computation and Language · Computer Science 2021-10-19 Somnath Roy

Automatic speech recognition (ASR) systems remain brittle on dysarthric and other atypical speech. Recent audio-language models raise the possibility of improving performance by conditioning on additional clinical context at inference time,…

Artificial Intelligence · Computer Science 2026-05-05 Pehuén Moure , Niclas Pokel , Bilal Bounajma , Yingqiang Gao , Roman Boehringer , Longbiao Cheng , Shih-Chii Liu

As Automatic Speech Recognition (ASR) is increasingly deployed in clinical dialogue, standard evaluations still rely heavily on Word Error Rate (WER). This paper challenges that standard, investigating whether WER or other common metrics…

Computation and Language · Computer Science 2026-01-21 Zachary Ellis , Jared Joselowitz , Yash Deo , Yajie He , Anna Kalygina , Aisling Higham , Mana Rahimzadeh , Yan Jia , Ibrahim Habli , Ernest Lim

Automatic speech recognition (ASR) systems have traditionally been evaluated using English datasets, with the word error rate (WER) serving as the predominant metric. WER's simplicity and ease of interpretation have contributed to its…

Computation and Language · Computer Science 2024-10-21 Thennal D K , Jesin James , Deepa P Gopinath , Muhammed Ashraf K

Automatic speech recognition (ASR) systems have dramatically improved over the last few years. ASR systems are most often trained from 'typical' speech, which means that underrepresented groups don't experience the same level of…

The common standard for quality evaluation of automatic speech recognition (ASR) systems is reference-based metrics such as the Word Error Rate (WER), computed using manual ground-truth transcriptions that are time-consuming and expensive…

Computation and Language · Computer Science 2023-06-26 Kamer Ali Yuksel , Thiago Ferreira , Ahmet Gunduz , Mohamed Al-Badrashiny , Golara Javadi

Word error rate (WER) is a standard metric for the evaluation of Automated Speech Recognition (ASR) systems. However, WER fails to provide a fair evaluation of human perceived quality in presence of spelling variations, abbreviations, or…

Computation and Language · Computer Science 2023-03-10 Satarupa Guha , Rahul Ambavat , Ankur Gupta , Manish Gupta , Rupeshkumar Mehta

Objective assessment of speech that reflects meaningful changes in communication is crucial for clinical decision making and reproducible research. While existing objective assessments, particularly reference-based approaches, can capture…

Sound · Computer Science 2026-02-17 Bence Mark Halpern , Thomas Tienkamp , Defne Abur , Tomoki Toda

State-of-the-art automatic speech recognition (ASR) models like Whisper, perform poorly on atypical speech, such as that produced by individuals with dysarthria. Past works for atypical speech have mostly investigated fully personalized (or…

Sound · Computer Science 2025-09-23 Vishnu Raja , Adithya V Ganesan , Anand Syamkumar , Ritwik Banerjee , H Andrew Schwartz

Automatic speech recognition (ASR) systems struggle with dysarthric speech due to high inter-speaker variability and slow speaking rates. To address this, we explore dysarthric-to-healthy speech conversion for improved ASR performance. Our…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Karl El Hajal , Enno Hermann , Sevada Hovsepyan , Mathew Magimai. -Doss

Measuring automatic speech recognition (ASR) system quality is critical for creating user-satisfying voice-driven applications. Word Error Rate (WER) has been traditionally used to evaluate ASR system quality; however, it sometimes…

Computation and Language · Computer Science 2022-07-07 Suyoun Kim , Duc Le , Weiyi Zheng , Tarun Singh , Abhinav Arora , Xiaoyu Zhai , Christian Fuegen , Ozlem Kalinli , Michael L. Seltzer

In this work, we present our submission to the Speech Accessibility Project challenge for dysarthric speech recognition. We integrate parameter-efficient fine-tuning with latent audio representations to improve an encoder-decoder ASR…

‹ Prev 1 2 3 10 Next ›