English
Related papers

Related papers: Adapting an Unadaptable ASR System

200 papers

Automatic Speech Recognition (ASR) systems are known to exhibit difficulties when transcribing children's speech. This can mainly be attributed to the absence of large children's speech corpora to train robust ASR models and the resulting…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Jenthe Thienpondt , Kris Demuynck

Speaker adaptation techniques provide a powerful solution to customise automatic speech recognition (ASR) systems for individual users. Practical application of unsupervised model-based speaker adaptation techniques to data intensive…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-16 Jiajun Deng , Xurong Xie , Tianzi Wang , Mingyu Cui , Boyang Xue , Zengrui Jin , Guinan Li , Shujie Hu , Xunying Liu

Most existing automatic speech recognition (ASR) research evaluate models using in-domain datasets. However, they seldom evaluate how they generalize across diverse speech contexts. This study addresses this gap by benchmarking seven Akan…

Spoken question answering (SQA) is challenging due to complex reasoning on top of the spoken documents. The recent studies have also shown the catastrophic impact of automatic speech recognition (ASR) errors on SQA. Therefore, this work…

Computation and Language · Computer Science 2019-04-18 Chia-Hsuan Lee , Yun-Nung Chen , Hung-Yi Lee

Automatic speech recognition (ASR) systems have achieved strong performance on general transcription tasks. However, they continue to struggle with recognizing rare named entities and adapting to domain mismatches. In contrast, large…

Computation and Language · Computer Science 2025-08-21 Shaoshi Ling , Guoli Ye

Benefiting from massive and diverse data sources, speech foundation models exhibit strong generalization and knowledge transfer capabilities to a wide range of downstream tasks. However, a limitation arises from their exclusive handling of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-10 Pengcheng Guo , Xuankai Chang , Hang Lv , Shinji Watanabe , Lei Xie

Training speech recognizers with unpaired speech and text -- known as unsupervised speech recognition (UASR) -- is a crucial step toward extending ASR to low-resource languages in the long-tail distribution and enabling multimodal learning…

Computation and Language · Computer Science 2025-10-07 Liming Wang , Junrui Ni , Kai-Wei Chang , Saurabhchand Bhati , David Harwath , Mark Hasegawa-Johnson , James R. Glass

This paper proposes AS-ASR, a lightweight aphasia-specific speech recognition framework based on Whisper-tiny, tailored for low-resource deployment on edge devices. Our approach introduces a hybrid training strategy that systematically…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-03 Chen Bao , Chuanbing Huo , Qinyu Chen , Chang Gao

We analyze automatic speech recognition (ASR) modeling choices under domain mismatch, comparing classic modular and novel sequence-to-sequence (seq2seq) architectures. Across the different ASR architectures, we examine a spectrum of…

Sound · Computer Science 2025-08-14 Tina Raissi , Nick Rossenbach , Ralf Schlüter

We propose a novel approach to enable the use of large, single-speaker ASR models, such as Whisper, for target speaker ASR. The key claim of this method is that it is much easier to model relative differences among speakers by learning to…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-17 Alexander Polok , Dominik Klement , Matthew Wiesner , Sanjeev Khudanpur , Jan Černocký , Lukáš Burget

Automatic Speech Recognition (ASR) is an area of growing academic and commercial interest due to the high demand for applications that use it to provide a natural communication method. It is common for general purpose ASR systems to fail in…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-24 Rafael Viana-Cámara , Diego Campos-Sobrino , Mario Campos-Soberanis

Automatic Speech Recognition (ASR) is an integral component of modern technology, powering applications such as voice-activated assistants, transcription services, and accessibility tools. Yet ASR systems continue to struggle with the…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-20 Mohammad Reza Peyghan , Saman Soleimani Roudi , Saeedreza Zouashkiani , Sajjad Amini , Fatemeh Rajabi , Shahrokh Ghaemmaghami

Speech is the fundamental means of communication between humans. The advent of AI and sophisticated speech technologies have led to the rapid proliferation of human-to-computer-based interactions, fueled primarily by Automatic Speech…

Computation and Language · Computer Science 2022-12-01 Mikel K. Ngueajio , Gloria Washington

End-to-end models for robust automatic speech recognition (ASR) have not been sufficiently well-explored in prior work. With end-to-end models, one could choose to preprocess the input speech using speech enhancement techniques and train…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-15 Archiki Prasad , Preethi Jyothi , Rajbabu Velmurugan

Low resource automatic speech recognition (ASR) is a useful but thorny task, since deep learning ASR models usually need huge amounts of training data. The existing models mostly established a bottleneck (BN) layer by pre-training on a…

Computation and Language · Computer Science 2022-05-31 Jian Luo , Jianzong Wang , Ning Cheng , Zhenpeng Zheng , Jing Xiao

In this paper, we investigate domain adaptation for low-resource Automatic Speech Recognition (ASR) of target-domain data, when a well-trained ASR model trained with a large dataset is available. We argue that in the encoder-decoder…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-30 Vrunda N. Sukhadia , S. Umesh

Automatic recognition of disordered and elderly speech remains highly challenging tasks to date due to data scarcity. Parameter fine-tuning is often used to exploit the large quantities of non-aged and healthy speech pre-trained models,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-28 Tianzi Wang , Shoukang Hu , Jiajun Deng , Zengrui Jin , Mengzhe Geng , Yi Wang , Helen Meng , Xunying Liu

Automatic Speech Recognition (ASR) systems have found their use in numerous industrial applications in very diverse domains. Since domain-specific systems perform better than their generic counterparts on in-domain evaluation, the need for…

Computation and Language · Computer Science 2021-10-26 Saket Dingliwal , Ashish Shenoy , Sravan Bodapati , Ankur Gandhe , Ravi Teja Gadde , Katrin Kirchhoff

OpenAI Whisper is a family of robust Automatic Speech Recognition (ASR) models trained on 680,000 hours of audio. However, its encoder-decoder architecture, trained with a sequence-to-sequence objective, lacks native support for streaming…

Domain-specific speech remains a persistent challenge for automatic speech recognition (ASR), even for state-of-the-art systems like OpenAI's Whisper. We introduce Whisper: Courtside Edition, a novel multi-agent large language model (LLM)…

Computation and Language · Computer Science 2026-02-24 Yonathan Ron , Shiri Gilboa , Tammuz Dubnov