English
Related papers

Related papers: Not All Errors Are Equal: Investigation of Speech …

200 papers

Automatic Speech Recognition (ASR) is traditionally evaluated using Word Error Rate (WER), a metric that is insensitive to meaning. Embedding-based semantic metrics are better correlated with human perception, but decoder-based Large…

Alzheimer's Dementia (AD) is an incurable, debilitating, and progressive neurodegenerative condition that affects cognitive function. Early diagnosis is important as therapeutics can delay progression and give those diagnosed vital time.…

Machine Learning · Computer Science 2023-02-28 Thomas Searle , Zina Ibrahim , Richard Dobson

Automatic Speech Recognition (ASR) transcription errors are commonly assessed using metrics that compare them with a reference transcription, such as Word Error Rate (WER), which measures spelling deviations from the reference, or semantic…

Computation and Language · Computer Science 2025-01-22 Antoine Tholly , Jane Wottawa , Mickael Rouvier , Richard Dufour

Accurately finding the wrong words in the automatic speech recognition (ASR) hypothesis and recovering them well-founded is the goal of speech error correction. In this paper, we propose a non-autoregressive speech error correction method.…

Computation and Language · Computer Science 2024-07-19 Yuchun Shu , Bo Hu , Yifeng He , Hao Shi , Longbiao Wang , Jianwu Dang

As Automatic Speech Recognition (ASR) is increasingly deployed in clinical dialogue, standard evaluations still rely heavily on Word Error Rate (WER). This paper challenges that standard, investigating whether WER or other common metrics…

Computation and Language · Computer Science 2026-01-21 Zachary Ellis , Jared Joselowitz , Yash Deo , Yajie He , Anna Kalygina , Aisling Higham , Mana Rahimzadeh , Yan Jia , Ibrahim Habli , Ernest Lim

Automatic speech recognition (ASR) systems often encounter difficulties in accurately recognizing rare words, leading to errors that can have a negative impact on downstream tasks such as keyword spotting, intent detection, and text…

Artificial Intelligence · Computer Science 2023-10-10 Jiajun He , Zekun Yang , Tomoki Toda

Speech enhancement (SE) systems are typically evaluated using a variety of instrumental metrics. The use of automatic speech recognition (ASR) systems to evaluate SE performance is common in literature, usually in terms of word error rate…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-13 Danilo de Oliveira , Tal Peer , Timo Gerkmann

Alzheimer's Disease (AD) is nowadays the most common form of dementia, and its automatic detection can help to identify symptoms at early stages, so that preventive actions can be carried out. Moreover, non-intrusive techniques based on…

Computation and Language · Computer Science 2020-11-21 Mireia Farrús , Joan Codina-Filbà

Neural sequence-to-sequence automatic speech recognition (ASR) systems are in principle open vocabulary systems, when using appropriate modeling units. In practice, however, they often fail to recognize words not seen during training, e.g.,…

Computation and Language · Computer Science 2022-03-30 Christian Huber , Rishu Kumar , Ondřej Bojar , Alexander Waibel

Automatic speech recognition (ASR) systems, increasingly prevalent in education, healthcare, employment, and mobile technology, face significant challenges in inclusivity, particularly for the 80 million-strong global community of people…

Computation and Language · Computer Science 2024-05-13 Dena Mujtaba , Nihar R. Mahapatra , Megan Arney , J. Scott Yaruss , Hope Gerlach-Houck , Caryn Herring , Jia Bin

Automatic speech recognition (ASR) allows transcribing the communications between air traffic controllers (ATCOs) and aircraft pilots. The transcriptions are used later to extract ATC named entities, e.g., aircraft callsigns. One common…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-18 Juan Zuluaga-Gomez , Seyyed Saeed Sarfjoo , Amrutha Prasad , Iuliia Nigmatulina , Petr Motlicek , Karel Ondrej , Oliver Ohneiser , Hartmut Helmke

Millions of people live with cognitive impairment from Alzheimer's disease and related dementias (ADRD). Voice-enabled smart home systems offer promise for supporting daily living but rely on automatic speech recognition (ASR) to transcribe…

Human-Computer Interaction · Computer Science 2026-03-02 Michelle Cohn , Alyssa Lanzi , Yui Ishihara , Chen-Nee Chuah , Georgia Zellou , Alyssa Weakley

The average life expectancy is increasing globally due to advancements in medical technology, preventive health care, and a growing emphasis on gerontological health. Therefore, developing technologies that detect and track aging-associated…

Computational Engineering, Finance, and Science · Computer Science 2022-09-14 Saurav K. Aryal , Howard Prioleau , Legand Burge

Early diagnosis of Alzheimer's disease (AD) is crucial in facilitating preventive care and to delay further progression. Speech based automatic AD screening systems provide a non-intrusive and more scalable alternative to other clinical…

Computation and Language · Computer Science 2023-04-03 Yi Wang , Jiajun Deng , Tianzi Wang , Bo Zheng , Shoukang Hu , Xunying Liu , Helen Meng

The amount of freely available systems for automatic speech recognition (ASR) based on neural networks is growing steadily, with equally increasingly reliable predictions. However, the evaluation of trained models is typically exclusively…

Computation and Language · Computer Science 2022-04-13 Johannes Wirth , Rene Peinl

Conventionally, Automatic Speech Recognition (ASR) systems are evaluated on their ability to correctly recognize each word contained in a speech signal. In this context, the word error rate (WER) metric is the reference for evaluating…

Computation and Language · Computer Science 2026-05-06 Thibault Bañeras Roux , Jane Wottawa , Mickael Rouvier , Teva Merlin , Richard Dufour

This paper describes methods for evaluating automatic speech recognition (ASR) systems in comparison with human perception results, using measures derived from linguistic distinctive features. Error patterns in terms of manner, place and…

Computation and Language · Computer Science 2016-12-14 Xiang Kong , Jeung-Yoon Choi , Stefanie Shattuck-Hufnagel

With the global population aging rapidly, Alzheimer's disease (AD) is particularly prominent in older adults, which has an insidious onset and leads to a gradual, irreversible deterioration in cognitive domains (memory, communication,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-15 Jinchao Li , Kaitao Song , Junan Li , Bo Zheng , Dongsheng Li , Xixin Wu , Xunying Liu , Helen Meng

Automatic Speech Recognition (ASR) systems are widely used in everyday communication, education, healthcare, and industry, yet their performance remains uneven across speakers, particularly when dialectal variation diverges from the…

Computation and Language · Computer Science 2026-03-26 Dana Serditova , Kevin Tang

The ADReSS Challenge at INTERSPEECH 2020 defines a shared task through which different approaches to the automated recognition of Alzheimer's dementia based on spontaneous speech can be compared. ADReSS provides researchers with a benchmark…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Saturnino Luz , Fasih Haider , Sofia de la Fuente , Davida Fromm , Brian MacWhinney