English
Related papers

Related papers: Word Error Rate Estimation Without ASR Output: e-W…

200 papers

We propose an unsupervised speaker adaptation method inspired by the neural Turing machine for end-to-end (E2E) automatic speech recognition (ASR). The proposed model contains a memory block that holds speaker i-vectors extracted from the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-17 Leda Sarı , Niko Moritz , Takaaki Hori , Jonathan Le Roux

Attention-based encoder-decoder architectures such as Listen, Attend, and Spell (LAS), subsume the acoustic, pronunciation and language model components of a traditional automatic speech recognition (ASR) system into a single neural…

Aphasia is a language disorder affecting one third of stroke patients. Current aphasia assessment does not consider natural speech due to the time consuming nature of manual transcriptions and a lack of knowledge on how to analyze such…

Neurons and Cognition · Quantitative Biology 2024-08-27 Mara Barberis , Pieter De Clercq , Bastiaan Tamm , Hugo Van hamme , Maaike Vandermosten

Modern Automatic Speech Recognition (ASR) systems can achieve high performance in terms of recognition accuracy. However, a perfectly accurate transcript still can be challenging to read due to disfluency, filter words, and other errata…

Computation and Language · Computer Science 2021-02-23 Junwei Liao , Yu Shi , Ming Gong , Linjun Shou , Sefik Eskimez , Liyang Lu , Hong Qu , Michael Zeng

Conventional far-field automatic speech recognition (ASR) systems typically employ microphone array techniques for speech enhancement in order to improve robustness against noise or reverberation. However, such speech enhancement techniques…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-23 Minhua Wu , Kenichi Kumatani , Shiva Sundaram , Nikko Strom , Bjorn Hoffmeister

End-to-end models with auto-regressive decoders have shown impressive results for automatic speech recognition (ASR). These models formulate the sequence-level probability as a product of the conditional probabilities of all individual…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-24 Qiujia Li , Yu Zhang , Bo Li , Liangliang Cao , Philip C. Woodland

End-to-End speech-to-speech translation (S2ST) is generally evaluated with text-based metrics. This means that generated speech has to be automatically transcribed, making the evaluation dependent on the availability and quality of…

Computation and Language · Computer Science 2022-12-19 Mingda Chen , Paul-Ambroise Duquenne , Pierre Andrews , Justine Kao , Alexandre Mourachko , Holger Schwenk , Marta R. Costa-jussà

Preschool evaluation is crucial because it gives teachers and parents influential knowledge about children's growth and development. The COVID-19 pandemic has highlighted the necessity of online assessment for preschool children. One of the…

Computation and Language · Computer Science 2023-08-25 Amirhossein Abaskohi , Fatemeh Mortazavi , Hadi Moradi

Personalizing dysarthric ASR is hindered by demanding enrollment collection and per-user training. We propose a hybrid meta-training method for a single model, enabling zero-shot and few-shot on-the-fly personalization via in-context…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-24 Dhruuv Agarwal , Harry Zhang , Yang Yu , Quan Wang

End-to-end automatic speech recognition systems represent the state of the art, but they rely on thousands of hours of manually annotated speech for training, as well as heavyweight computation for inference. Of course, this impedes…

Computation and Language · Computer Science 2022-11-22 Raphael Tang , Karun Kumar , Gefei Yang , Akshat Pandey , Yajie Mao , Vladislav Belyaev , Madhuri Emmadi , Craig Murray , Ferhan Ture , Jimmy Lin

Recent strides in automatic speech recognition (ASR) have accelerated their application in the medical domain where their performance on accented medical named entities (NE) such as drug names, diagnoses, and lab results, is largely…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-19 Tejumade Afonja , Tobi Olatunji , Sewade Ogun , Naome A. Etori , Abraham Owodunni , Moshood Yekini

Automatic speech recognition (ASR) outcomes serve as input for downstream tasks, substantially impacting the satisfaction level of end-users. Hence, the diagnosis and enhancement of the vulnerabilities present in the ASR model bear…

Computation and Language · Computer Science 2024-01-29 Seonmin Koo , Chanjun Park , Jinsung Kim , Jaehyung Seo , Sugyeong Eo , Hyeonseok Moon , Heuiseok Lim

We describe a system that generates speaker-annotated transcripts of meetings by using a virtual microphone array, a set of spatially distributed asynchronous recording devices such as laptops and mobile phones. The system is composed of…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-09 Takuya Yoshioka , Zhuo Chen , Dimitrios Dimitriadis , William Hinthorn , Xuedong Huang , Andreas Stolcke , Michael Zeng

Language models play a central role in automatic speech recognition (ASR), yet most methods rely on text-only models unaware of ASR error patterns. Recently, large language models (LLMs) have been applied to ASR correction, but introduce…

Machine Learning · Computer Science 2026-03-18 Zijin Gu , Tatiana Likhomanenko , He Bai , Erik McDermott , Ronan Collobert , Navdeep Jaitly

Aiming at reducing the reliance on expensive human annotations, data synthesis for Automatic Speech Recognition (ASR) has remained an active area of research. While prior work mainly focuses on synthetic speech generation for ASR data…

A deep neural network (DNN)-based speech enhancement (SE) aiming to maximize the performance of an automatic speech recognition (ASR) system is proposed in this paper. In order to optimize the DNN-based SE model in terms of the character…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-23 Ryosuke Sawata , Yosuke Kashiwagi , Shusuke Takahashi

This paper investigates the impact of word-based RNN language models (RNN-LMs) on the performance of end-to-end automatic speech recognition (ASR). In our prior work, we have proposed a multi-level LM, in which character-based and…

Computation and Language · Computer Science 2018-08-09 Takaaki Hori , Jaejin Cho , Shinji Watanabe

Previous work on emotion recognition demonstrated a synergistic effect of combining several modalities such as auditory, visual, and transcribed text to estimate the affective state of a speaker. Among these, the linguistic modality is…

Computation and Language · Computer Science 2019-03-01 Egor Lakomkin , Mohammad Ali Zamani , Cornelius Weber , Sven Magg , Stefan Wermter

We employ a combination of recent developments in semi-supervised learning for automatic speech recognition to obtain state-of-the-art results on LibriSpeech utilizing the unlabeled audio of the Libri-Light dataset. More precisely, we carry…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-22 Yu Zhang , James Qin , Daniel S. Park , Wei Han , Chung-Cheng Chiu , Ruoming Pang , Quoc V. Le , Yonghui Wu

In this paper, we introduce a new and simple method for comparing speech utterances without relying on text transcripts. Our speech-to-speech comparison metric utilizes state-of-the-art speech2unit encoders like HuBERT to convert speech…

Computation and Language · Computer Science 2023-07-21 Laurent Besacier , Swen Ribeiro , Olivier Galibert , Ioan Calapodescu