English
Related papers

Related papers: Optimizing expected word error rate via sampling f…

200 papers

Recent strides in automatic speech recognition (ASR) have accelerated their application in the medical domain where their performance on accented medical named entities (NE) such as drug names, diagnoses, and lab results, is largely…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-19 Tejumade Afonja , Tobi Olatunji , Sewade Ogun , Naome A. Etori , Abraham Owodunni , Moshood Yekini

In the broadcast domain there is an abundance of related text data and partial transcriptions, such as closed captions and subtitles. This text data can be used for lightly supervised training, in which text matching the audio is selected…

Computation and Language · Computer Science 2019-07-16 Joachim Fainberg , Ondřej Klejch , Steve Renals , Peter Bell

Automatic Speech Recognition (ASR) traditionally assumes known domains, but adding data from a new domain raises concerns about computational inefficiencies linked to retraining models on both existing and new domains. Fine-tuning solely on…

Computation and Language · Computer Science 2024-09-25 Devang Kulshreshtha , Saket Dingliwal , Brady Houston , Nikolaos Pappas , Srikanth Ronanki

A common question being raised in automatic speech recognition (ASR) evaluations is how reliable is an observed word error rate (WER) improvement comparing two ASR systems, where statistical hypothesis testing and confidence interval (CI)…

Machine Learning · Statistics 2020-05-22 Zhe Liu , Fuchun Peng

Error correction techniques have been used to refine the output sentences from automatic speech recognition (ASR) models and achieve a lower word error rate (WER). Previous works usually adopt end-to-end models and has strong dependency on…

Computation and Language · Computer Science 2024-01-12 Jiaxin Guo , Minghan Wang , Xiaosong Qiao , Daimeng Wei , Hengchao Shang , Zongyao Li , Zhengzhe Yu , Yinglu Li , Chang Su , Min Zhang , Shimin Tao , Hao Yang

Evaluating ASR systems for Indian languages is challenging due to spelling variations, suffix splitting flexibility, and non-standard spellings in code-mixed words. Traditional Word Error Rate (WER) often presents a bleaker picture of…

We revisit self-training in the context of end-to-end speech recognition. We demonstrate that training with pseudo-labels can substantially improve the accuracy of a baseline model. Key to our approach are a strong baseline acoustic and…

Computation and Language · Computer Science 2020-05-08 Jacob Kahn , Ann Lee , Awni Hannun

The "Switchboard benchmark" is a very well-known test set in automatic speech recognition (ASR) research, establishing record-setting performance for systems that claim human-level transcription accuracy. This work highlights lesser-known…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Arlo Faria , Adam Janin , Korbinian Riedhammer , Sidhi Adkoli

Automatic speech recognition (ASR) systems are predominantly evaluated using the Word Error Rate (WER). However, raw token-level metrics fail to capture semantic fidelity and routinely obscures the `diversity tax', the disproportionate…

Machine Learning · Computer Science 2026-03-06 Ting-Hui Cheng , Line H. Clemmensen , Sneha Das

The use of spatial information with multiple microphones can improve far-field automatic speech recognition (ASR) accuracy. However, conventional microphone array techniques degrade speech enhancement performance when there is an array…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-23 Kenichi Kumatani , Minhua Wu , Shiva Sundaram , Nikko Strom , Bjorn Hoffmeister

Classroom speech and lectures often contain named entities (NEs) such as names of people and special terminology. While automatic speech recognition (ASR) systems have achieved remarkable performance on general speech, the word error rate…

Computation and Language · Computer Science 2026-04-21 Viet Anh Trinh , Xinlu He , Jacob Whitehill

Recent work has shown that sample-based Minimum Bayes Risk (MBR) decoding outperforms beam search in text-to-text generation tasks, such as machine translation, text summarization, and image captioning. On the other hand, beam search is the…

Computation and Language · Computer Science 2026-05-14 Yuu Jinnai

Neural network models for audio tasks, such as automatic speech recognition (ASR) and acoustic scene classification (ASC), are susceptible to noise contamination for real-life applications. To improve audio quality, an enhancement module,…

In speech enhancement (SE), phase estimation is important for perceptual quality, so many methods take clean speech's complex short-time Fourier transform (STFT) spectrum or the complex ideal ratio mask (cIRM) as the learning target. To…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-12 Yuewei Zhang , Huanbin Zou , Jie Zhu

Second-pass rescoring is an important component in automatic speech recognition (ASR) systems that is used to improve the outputs from a first-pass decoder by implementing a lattice rescoring or $n$-best re-ranking. While pretraining with a…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-13 Liyan Xu , Yile Gu , Jari Kolehmainen , Haidar Khan , Ankur Gandhe , Ariya Rastrow , Andreas Stolcke , Ivan Bulyko

Automatic Speech Recognition (ASR) still face challenges when recognizing time-variant rare-phrases. Contextual biasing (CB) modules bias ASR model towards such contextually-relevant phrases. During training, a list of biasing phrases are…

This paper investigates the performance of various speech SSL models on dialectal Arabic (DA) and Arabic-English code-switched (CS) speech. To address data scarcity, a modified audio-splicing approach is introduced to generate artificial CS…

Computation and Language · Computer Science 2025-06-30 Muhammad Umar Farooq , Oscar Saz

Multilingual end-to-end(E2E) models have shown a great potential in the expansion of the language coverage in the realm of automatic speech recognition(ASR). In this paper, we aim to enhance the multilingual ASR performance in two ways,…

Computation and Language · Computer Science 2021-10-18 Rimita Lahiri , Kenichi Kumatani , Eric Sun , Yao Qian

For sequence-to-sequence tasks it is challenging to combine individual system outputs. Further, there is also often a mismatch between the decoding criterion and the one used for assessment. Minimum Bayes' Risk (MBR) decoding can be used to…

Computation and Language · Computer Science 2023-10-30 Vyas Raina , Mark Gales

Empirical risk minimization (ERM) is the workhorse of machine learning, whether for classification and regression or for off-policy policy learning, but its model-agnostic guarantees can fail when we use adaptively collected data, such as…

Machine Learning · Statistics 2021-06-04 Aurélien Bibaut , Antoine Chambaz , Maria Dimakopoulou , Nathan Kallus , Mark van der Laan