English
Related papers

Related papers: Whisper in Medusa's Ear: Multi-head Efficient Deco…

200 papers

Recent advancements in deep learning have significantly enhanced multilingual automatic speech recognition (ASR) due to the development of advanced model architectures and available large-scale multilingual datasets. Despite that,…

Computation and Language · Computer Science 2025-06-30 Jiahong Li , Yiwen Shao , Jianheng Zhuo , Chenda Li , Liliang Tang , Dong Yu , Yanmin Qian

Recognizing whispered speech and converting it to normal speech creates many possibilities for speech interaction. Because the sound pressure of whispered speech is significantly lower than that of normal speech, it can be used as a…

Sound · Computer Science 2023-03-06 Jun Rekimoto

Recently, Transformer-based encoder-decoder models have demonstrated strong performance in multilingual speech recognition. However, the decoder's autoregressive nature and large size introduce significant bottlenecks during inference.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-28 Yunkyu Lim , Jihwan Park , Hyung Yong Kim , Hanbin Lee , Byeong-Yeol Kim

Modern Automatic Speech Recognition (ASR) systems can achieve high performance in terms of recognition accuracy. However, a perfectly accurate transcript still can be challenging to read due to disfluency, filter words, and other errata…

Computation and Language · Computer Science 2021-02-23 Junwei Liao , Yu Shi , Ming Gong , Linjun Shou , Sefik Eskimez , Liyang Lu , Hong Qu , Michael Zeng

Transformer has been successfully applied to speech separation recently with its strong long-dependency modeling capacity using a self-attention mechanism. However, Transformer tends to have heavy run-time costs due to the deep encoder…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-28 Sanyuan Chen , Yu Wu , Zhuo Chen , Jian Wu , Takuya Yoshioka , Shujie Liu , Jinyu Li , Xiangzhan Yu

This work explores fine-tuning OpenAI's Whisper automatic speech recognition (ASR) model for Amharic, a low-resource language, to improve transcription accuracy. While the foundational Whisper model struggles with Amharic due to limited…

Recent advancements in Automatic Speech Recognition (ASR) systems, exemplified by Whisper, have demonstrated the potential of these systems to approach human-level performance given sufficient data. However, this progress doesn't readily…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-16 Ahmed Adel Attia , Jing Liu , Wei Ai , Dorottya Demszky , Carol Espy-Wilson

The Whisper model, an open-source automatic speech recognition system, is widely adopted for its strong performance across multilingual and zero-shot settings. However, it frequently suffers from hallucination errors, especially under noisy…

Artificial Intelligence · Computer Science 2025-11-19 Kumud Tripathi , Aditya Srinivas Menon , Aman Gaurav , Raj Prakash Gohil , Pankaj Wasnik

Recent research on word-level confidence estimation for speech recognition systems has primarily focused on lightweight models known as Confidence Estimation Modules (CEMs), which rely on hand-engineered features derived from Automatic…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-20 Vaibhav Aggarwal , Shabari S Nair , Yash Verma , Yash Jogi

Machine recognition of an atypical speech like whispered speech, is a challenging task. We introduce whisper-to-natural-speech conversion using sequence-to-sequence approach by proposing enhanced transformer architecture, which uses both…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-06 Abhishek Niranjan , Mukesh Sharma , Sai Bharath Chandra Gutha , M Ali Basha Shaik

Speaker-attributed automatic speech recognition (SA-ASR) aims to transcribe speech while assigning transcripts to the corresponding speakers accurately. Existing methods often rely on complex modular systems or require extensive fine-tuning…

Computation and Language · Computer Science 2025-01-16 Thai-Binh Nguyen , Alexander Waibel

We introduce a new cross-modal fusion technique designed for generative error correction in automatic speech recognition (ASR). Our methodology leverages both acoustic information and external linguistic representations to generate accurate…

We collect novel data in the public service domain to evaluate the capability of the state-of-the-art automatic speech recognition (ASR) models in capturing regional differences in accents in the United Kingdom (UK), specifically focusing…

Computation and Language · Computer Science 2025-01-16 Melissa Torgbi , Andrew Clayman , Jordan J. Speight , Harish Tayyar Madabushi

ASR systems often struggle with maintaining syntactic and semantic accuracy in long audio transcripts, impacting tasks like Named Entity Recognition (NER), capitalization, and punctuation. We propose a novel approach that enhances ASR by…

Computation and Language · Computer Science 2025-08-20 Duygu Altinok

Large reasoning models (LRMs) have demonstrated remarkable proficiency in tackling complex tasks through step-by-step thinking. However, this lengthy reasoning process incurs substantial computational and latency overheads, hindering the…

Computation and Language · Computer Science 2026-05-19 Heming Xia , Cunxiao Du , Rui Li , Chak Tou Leong , Yongqi Li , Wenjie Li

We introduce Whisper-RIR-Mega, a benchmark dataset of paired clean and reverberant speech for evaluating automatic speech recognition (ASR) robustness to room acoustics. Each sample pairs a clean LibriSpeech utterance with the same…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-17 Mandip Goswami

In automatic speech recognition, any factor that alters the acoustic properties of speech can pose a challenge to the system's performance. This paper presents a novel approach for automatic whispered speech recognition in the Irish dialect…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-05 Aref Farhadipour , Homa Asadi , Volker Dellwo

In this paper, we focus on Whisper, a recent automatic speech recognition model trained with a massive 680k hour labeled speech corpus recorded in diverse conditions. We first show an interesting finding that while Whisper is very robust…

Sound · Computer Science 2023-10-10 Yuan Gong , Sameer Khurana , Leonid Karlinsky , James Glass

In this paper, we explore the untapped potential of Whisper, a well-established automatic speech recognition (ASR) foundation model, in the context of L2 spoken language assessment (SLA). Unlike prior studies that extrinsically analyze…

Computation and Language · Computer Science 2026-01-27 Fu-An Chao , Bi-Cheng Yan , Berlin Chen

This paper proposes AS-ASR, a lightweight aphasia-specific speech recognition framework based on Whisper-tiny, tailored for low-resource deployment on edge devices. Our approach introduces a hybrid training strategy that systematically…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-03 Chen Bao , Chuanbing Huo , Qinyu Chen , Chang Gao