English
Related papers

Related papers: Advocating Character Error Rate for Multilingual A…

200 papers

We collect novel data in the public service domain to evaluate the capability of the state-of-the-art automatic speech recognition (ASR) models in capturing regional differences in accents in the United Kingdom (UK), specifically focusing…

Computation and Language · Computer Science 2025-01-16 Melissa Torgbi , Andrew Clayman , Jordan J. Speight , Harish Tayyar Madabushi

Error correction techniques have been used to refine the output sentences from automatic speech recognition (ASR) models and achieve a lower word error rate (WER). Previous works usually adopt end-to-end models and has strong dependency on…

Computation and Language · Computer Science 2024-01-12 Jiaxin Guo , Minghan Wang , Xiaosong Qiao , Daimeng Wei , Hengchao Shang , Zongyao Li , Zhengzhe Yu , Yinglu Li , Chang Su , Min Zhang , Shimin Tao , Hao Yang

Evaluating ASR systems for Indian languages is challenging due to spelling variations, suffix splitting flexibility, and non-standard spellings in code-mixed words. Traditional Word Error Rate (WER) often presents a bleaker picture of…

End-to-end automatic speech recognition (ASR) commonly transcribes audio signals into sequences of characters while its performance is evaluated by measuring the word-error rate (WER). This suggests that predicting sequences of words…

Computation and Language · Computer Science 2018-12-07 Jan Kremer , Lasse Borgholt , Lars Maaløe

The prevalent approach in speech emotion recognition (SER) involves integrating both audio and textual information to comprehensively identify the speaker's emotion, with the text generally obtained through automatic speech recognition…

Computation and Language · Computer Science 2024-05-29 Jiajun He , Xiaohan Shi , Xingfeng Li , Tomoki Toda

Code-switching (CS), defined as the mixing of languages in conversations, has become a worldwide phenomenon. The prevalence of CS has been recently met with a growing demand and interest to build CS ASR systems. In this paper, we present…

Computation and Language · Computer Science 2021-08-31 Injy Hamed , Pavel Denisov , Chia-Yu Li , Mohamed Elmahdy , Slim Abdennadher , Ngoc Thang Vu

Pre-trained transformer-based models have significantly advanced automatic speech recognition (ASR), yet they remain sensitive to accent and dialectal variations, resulting in elevated word error rates (WER) in linguistically diverse…

Computation and Language · Computer Science 2025-10-13 Mohammad Hossein Sameti , Sepehr Harfi Moridani , Ali Zarean , Hossein Sameti

Word Error Rate (WER) has been the predominant metric used to evaluate the performance of automatic speech recognition (ASR) systems. However, WER is sometimes not a good indicator for downstream Natural Language Understanding (NLU) tasks,…

Computation and Language · Computer Science 2021-04-07 Suyoun Kim , Abhinav Arora , Duc Le , Ching-Feng Yeh , Christian Fuegen , Ozlem Kalinli , Michael L. Seltzer

Nowadays, research in speech technologies has gotten a lot out thanks to recently created public domain corpora that contain thousands of recording hours. These large amounts of data are very helpful for training the new complex models…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-12 Guillermo Cámbara , Alex Peiró-Lilja , Mireia Farrús , Jordi Luque

Speech enhancement methods are commonly believed to improve the performance of automatic speech recognition (ASR) in noisy environments. However, the effectiveness of these techniques cannot be taken for granted in the case of modern…

Automatic Speech Recognition (ASR) systems have been evolving quickly and reaching human parity in certain cases. The systems usually perform pretty well on reading style and clean speech, however, most of the available systems suffer from…

Computation and Language · Computer Science 2019-10-15 Quang Minh Nguyen , Thai Binh Nguyen , Ngoc Phuong Pham , The Loc Nguyen

A deep neural network (DNN)-based speech enhancement (SE) aiming to maximize the performance of an automatic speech recognition (ASR) system is proposed in this paper. In order to optimize the DNN-based SE model in terms of the character…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-23 Ryosuke Sawata , Yosuke Kashiwagi , Shusuke Takahashi

Automatic Speech Recognition (ASR) systems are widely used in everyday communication, education, healthcare, and industry, yet their performance remains uneven across speakers, particularly when dialectal variation diverges from the…

Computation and Language · Computer Science 2026-03-26 Dana Serditova , Kevin Tang

Building an accurate automatic speech recognition (ASR) system requires a large dataset that contains many hours of labeled speech samples produced by a diverse set of speakers. The lack of such open free datasets is one of the main issues…

Computation and Language · Computer Science 2018-11-05 Jason Li , Ravi Gadde , Boris Ginsburg , Vitaly Lavrukhin

This study investigates the performance of personalized automatic speech recognition (ASR) for recognizing disordered speech using small amounts of per-speaker adaptation data. We trained personalized models for 195 individuals with…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-12 Jimmy Tobin , Katrin Tomanek

Pashto is spoken by approximately 60--80 million people but has no published benchmarks for multilingual automatic speech recognition (ASR) on any shared public test set. This paper reports the first reproducible multi-model evaluation on…

Computation and Language · Computer Science 2026-04-07 Hanif Rahman

Objective assessment of speech that reflects meaningful changes in communication is crucial for clinical decision making and reproducible research. While existing objective assessments, particularly reference-based approaches, can capture…

Sound · Computer Science 2026-02-17 Bence Mark Halpern , Thomas Tienkamp , Defne Abur , Tomoki Toda

This paper addresses the challenge of integrating low-resource languages into multilingual automatic speech recognition (ASR) systems. We introduce a novel application of weighted cross-entropy, typically used for unbalanced datasets, to…

Speech separation has been successfully applied as a frontend processing module of conversation transcription systems thanks to its ability to handle overlapped speech and its flexibility to combine with downstream tasks such as automatic…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-06 Jian Wu , Zhuo Chen , Sanyuan Chen , Yu Wu , Takuya Yoshioka , Naoyuki Kanda , Shujie Liu , Jinyu Li

Automatic Speech Recognition (ASR) systems struggle with regional dialects due to biased training which favours mainstream varieties. While previous research has identified racial, age, and gender biases in ASR, regional bias remains…

Computation and Language · Computer Science 2025-08-26 Dana Serditova , Kevin Tang , Jochen Steffens