English
Related papers

Related papers: Prompting the Hidden Talent of Web-Scale Speech Mo…

200 papers

Zero-shot spoken language understanding (SLU) enables systems to comprehend user utterances in new domains without prior exposure to training data. Recent studies often rely on large language models (LLMs), leading to excessive footprints…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-24 Mohan Li , Simon Keizer , Rama Doddipatla

In this work, we propose a method to create domain-sensitive speech recognition models that utilize textual domain information by conditioning its generation on a given text prompt. This is accomplished by fine-tuning a pre-trained,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-09 Feng-Ting Liao , Yung-Chieh Chan , Yi-Chang Chen , Chan-Jan Hsu , Da-shan Shiu

Recent advancements in multilingual automatic speech recognition (ASR) have been driven by large-scale end-to-end models like Whisper. However, challenges such as language interference and expanding to unseen languages (language expansion)…

Computation and Language · Computer Science 2025-09-29 Hongli Yang , Sheng Li , Hao Huang , Ayiduosi Tuohan , Yizhou Peng

Macroscopic intelligibility models predict the expected human word-error-rate for a given speech-in-noise stimulus. In contrast, microscopic intelligibility models aim to make fine-grained predictions about listeners' perception, e.g.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-12 Paul Best , Santiago Cuervo , Ricard Marxer

The development of resource-constrained approaches to automatic speech recognition (ASR) is of great interest due to its broad applicability to many low-resource languages for which there is scant usable data. Existing approaches to many…

Computation and Language · Computer Science 2026-03-17 Emma Rafkin , Dan DeGenaro , Xiulin Yang

Multilingual Automatic Speech Recognition (ASR) aims to recognize and transcribe speech from multiple languages within a single system. Whisper, one of the most advanced ASR models, excels in this domain by handling 99 languages…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-24 Shao-Syuan Huang , Kuan-Po Huang , Andy T. Liu , Hung-yi Lee

Whisper is a recent Automatic Speech Recognition (ASR) model displaying impressive robustness to both out-of-distribution inputs and random noise. In this work, we show that this robustness does not carry over to adversarial noise. We show…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-14 Raphael Olivier , Bhiksha Raj

Whisper, despite being trained on 680K hours of web-scaled audio data, faces difficulty in recognising rare words like domain-specific terms, with a solution being contextual biasing through prompting. To improve upon this method, in this…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-19 Yash Jogi , Vaibhav Aggarwal , Shabari S Nair , Yash Verma , Aayush Kubba

Recent developments in large speech foundation models like Whisper have led to their widespread use in many automatic speech recognition (ASR) applications. These systems incorporate `special tokens' in their vocabulary, such as…

Computation and Language · Computer Science 2024-07-18 Vyas Raina , Rao Ma , Charles McGhee , Kate Knill , Mark Gales

Speech data has rich acoustic and paralinguistic information with important cues for understanding a speaker's tone, emotion, and intent, yet traditional large language models such as BERT do not incorporate this information. There has been…

Computation and Language · Computer Science 2023-11-14 Fatema Hasan , Yulong Li , James Foulds , Shimei Pan , Bishwaranjan Bhattacharjee

Domain-specific speech remains a persistent challenge for automatic speech recognition (ASR), even for state-of-the-art systems like OpenAI's Whisper. We introduce Whisper: Courtside Edition, a novel multi-agent large language model (LLM)…

Computation and Language · Computer Science 2026-02-24 Yonathan Ron , Shiri Gilboa , Tammuz Dubnov

Recent advancements in Automatic Speech Recognition (ASR) systems, exemplified by Whisper, have demonstrated the potential of these systems to approach human-level performance given sufficient data. However, this progress doesn't readily…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-16 Ahmed Adel Attia , Jing Liu , Wei Ai , Dorottya Demszky , Carol Espy-Wilson

Recent research on word-level confidence estimation for speech recognition systems has primarily focused on lightweight models known as Confidence Estimation Modules (CEMs), which rely on hand-engineered features derived from Automatic…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-20 Vaibhav Aggarwal , Shabari S Nair , Yash Verma , Yash Jogi

Automatic Speech Recognition (ASR) has seen remarkable progress, with models like OpenAI Whisper and NVIDIA Canary achieving state-of-the-art (SOTA) performance in offline transcription. However, these models are not designed for streaming…

Computation and Language · Computer Science 2026-04-07 Tomer Krichli , Bhiksha Raj , Joseph Keshet

Edge-based automatic speech recognition (ASR) technologies are increasingly prevalent in the development of intelligent and personalized assistants. However, resource-constrained ASR models face significant challenges in adaptivity,…

Computation and Language · Computer Science 2024-12-24 Amir Nassereldine , Dancheng Liu , Chenhui Xu , Ruiyang Qin , Yiyu Shi , Jinjun Xiong

Automated speech recognition (ASR) models have gained prominence for applications such as captioning, speech translation, and live transcription. This paper studies Whisper and two model variants: one optimized for live speech streaming and…

Sound · Computer Science 2025-03-14 Allison Andreyev

This research introduces an enhanced version of the multi-objective speech assessment model--MOSA-Net+, by leveraging the acoustic features from Whisper, a large-scaled weakly supervised model. We first investigate the effectiveness of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-30 Ryandhimas E. Zezario , Yu-Wen Chen , Szu-Wei Fu , Yu Tsao , Hsin-Min Wang , Chiou-Shann Fuh

Recent progress in Automatic Speech Recognition (ASR) has been coupled with a substantial increase in the model sizes, which may now contain billions of parameters, leading to slow inferences even with adapted hardware. In this context,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-25 Hugo Malard , Salah Zaiem , Robin Algayres

Prevailing methods for mapping large generative language models to supervised tasks may fail to sufficiently probe models' novel capabilities. Using GPT-3 as a case study, we show that 0-shot prompts can significantly outperform few-shot…

Computation and Language · Computer Science 2021-02-16 Laria Reynolds , Kyle McDonell

The prevalence of the powerful multilingual models, such as Whisper, has significantly advanced the researches on speech recognition. However, these models often struggle with handling the code-switching setting, which is essential in…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-15 Bobbi Aditya , Mahdin Rohmatillah , Liang-Hsuan Tai , Jen-Tzung Chien