中文
相关论文

相关论文: Script collapse in multilingual ASR: A reference-f…

200 篇论文

Reverberation negatively impacts the performance of automatic speech recognition (ASR). Prior work on quantifying the effect of reverberation has shown that clarity (C50), a parameter that can be estimated from the acoustic impulse…

音频与语音处理 · 电气工程与系统科学 2020-02-17 Hannes Gamper , Dimitra Emmanouilidou , Sebastian Braun , Ivan J. Tashev

Automatic Speech Recognition (ASR) is traditionally evaluated using Word Error Rate (WER), a metric that is insensitive to meaning. Embedding-based semantic metrics are better correlated with human perception, but decoder-based Large…

As Automatic Speech Recognition (ASR) is increasingly deployed in clinical dialogue, standard evaluations still rely heavily on Word Error Rate (WER). This paper challenges that standard, investigating whether WER or other common metrics…

We introduce a new cross-modal fusion technique designed for generative error correction in automatic speech recognition (ASR). Our methodology leverages both acoustic information and external linguistic representations to generate accurate…

The success of the multilingual automatic speech recognition systems empowered many voice-driven applications. However, measuring the performance of such systems remains a major challenge, due to its dependency on manually transcribed…

计算与语言 · 计算机科学 2023-04-04 Shammur Absar Chowdhury , Ahmed Ali

Text data is commonly utilized as a primary input to enhance Speech Emotion Recognition (SER) performance and reliability. However, the reliance on human-transcribed text in most studies impedes the development of practical SER systems,…

音频与语音处理 · 电气工程与系统科学 2025-03-25 Yuanchao Li , Peter Bell , Catherine Lai

Hallucinations in automatic speech recognition (ASR) systems refer to fluent and coherent transcriptions produced by neural ASR models that are completely unrelated to the underlying acoustic input (i.e., the speech signal). While similar…

计算与语言 · 计算机科学 2025-10-21 Alkis Koudounas , Moreno La Quatra , Manuel Giollo , Sabato Marco Siniscalchi , Elena Baralis

Word Error Rate (WER) has been the predominant metric used to evaluate the performance of automatic speech recognition (ASR) systems. However, WER is sometimes not a good indicator for downstream Natural Language Understanding (NLU) tasks,…

计算与语言 · 计算机科学 2021-04-07 Suyoun Kim , Abhinav Arora , Duc Le , Ching-Feng Yeh , Christian Fuegen , Ozlem Kalinli , Michael L. Seltzer

Measuring automatic speech recognition (ASR) system quality is critical for creating user-satisfying voice-driven applications. Word Error Rate (WER) has been traditionally used to evaluate ASR system quality; however, it sometimes…

In this work, we address the challenge of building fair English ASR systems for second-language speakers. Our analysis of widely used ASR models, Whisper and Seamless-M4T, reveals large fluctuations in word error rate (WER) across 26 accent…

计算与语言 · 计算机科学 2026-01-27 Monorama Swain , Bubai Maji , Jagabandhu Mishra , Markus Schedl , Anders Søgaard , Jesper Rindom Jensen

ASR has achieved remarkable global progress, yet African low-resource languages remain rigorously underrepresented, producing barriers to digital inclusion across the continent with more than +2000 languages. This systematic literature…

This paper explores the pitfalls in evaluating multilingual automatic speech recognition (ASR) models, with a particular focus on Indic language scripts. We investigate the text normalization routine employed by leading ASR models,…

计算与语言 · 计算机科学 2024-11-12 Kavya Manohar , Leena G Pillai , Elizabeth Sherly

We study the effect of applying a language model (LM) on the output of Automatic Speech Recognition (ASR) systems for Indic languages. We fine-tune wav2vec $2.0$ models for $18$ Indic languages and adjust the results with language models…

Source separation is a crucial pre-processing step for various speech processing tasks, such as automatic speech recognition (ASR). Traditionally, the evaluation metrics for speech separation rely on the matched reference audios and…

音频与语音处理 · 电气工程与系统科学 2025-10-28 Ari Frummer , Helin Wang , Tianyu Cao , Adi Arbel , Yuval Sieradzki , Oren Gal , Jesús Villalba , Thomas Thebaud , Najim Dehak

While Automatic Speech Recognition (ASR) is typically benchmarked by word error rate (WER), real-world applications ultimately hinge on semantic fidelity. This mismatch is particularly problematic for dysarthric speech, where articulatory…

音频与语音处理 · 电气工程与系统科学 2026-01-30 Xiuwen Zheng , Sixun Dong , Bornali Phukon , Mark Hasegawa-Johnson , Chang D. Yoo

Text encodings from automatic speech recognition (ASR) transcripts and audio representations have shown promise in speech emotion recognition (SER) ever since. Yet, it is challenging to explain the effect of each information stream on the…

Word error rate (WER) estimation aims to evaluate the quality of an automatic speech recognition (ASR) system's output without requiring ground-truth labels. This task has gained increasing attention as advanced ASR systems are trained on…

音频与语音处理 · 电气工程与系统科学 2025-01-30 Chanho Park , Chengsong Lu , Mingjie Chen , Thomas Hain

Multilingual Automated Speech Recognition (ASR) systems allow for the joint training of data-rich and data-scarce languages in a single model. This enables data and parameter sharing across languages, which is especially beneficial for the…

音频与语音处理 · 电气工程与系统科学 2020-04-22 Arindrima Datta , Bhuvana Ramabhadran , Jesse Emond , Anjuli Kannan , Brian Roark

We propose a general framework to compute the word error rate (WER) of ASR systems that process recordings containing multiple speakers at their input and that produce multiple output word sequences (MIMO). Such ASR systems are typically…

音频与语音处理 · 电气工程与系统科学 2023-07-24 Thilo von Neumann , Christoph Boeddeker , Keisuke Kinoshita , Marc Delcroix , Reinhold Haeb-Umbach

The Word Error Rate (WER) is the common measure of accuracy for Automatic Speech Recognition (ASR). Transcripts are usually pre-processed by substituting specific characters to account for non-semantic differences. As a result of this…

计算与语言 · 计算机科学 2024-09-20 Korbinian Kuhn , Verena Kersken , Gottfried Zimmermann