English
Related papers

Related papers: Earnings-21: A Practical Benchmark for ASR in the …

200 papers

Recent advances in audio-language models have demonstrated remarkable success on short, segment-level speech tasks. However, real-world applications such as meeting transcription, spoken document understanding, and conversational analysis…

End-to-end automatic speech recognition (ASR) models, including both attention-based models and the recurrent neural network transducer (RNN-T), have shown superior performance compared to conventional systems. However, previous studies…

Limited diversity in standardized benchmarks for evaluating audio representation learning (ARL) methods may hinder systematic comparison of current methods' capabilities. We present ARCH, a comprehensive benchmark for evaluating ARL methods…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-17 Moreno La Quatra , Alkis Koudounas , Lorenzo Vaiani , Elena Baralis , Luca Cagliero , Paolo Garza , Sabato Marco Siniscalchi

Automatic speech recognition (ASR) systems have achieved near-human accuracy on curated benchmarks, yet still fail in real-world voice agents under conditions that current evaluations do not systematically cover. Without diagnostic tools…

Artificial Intelligence · Computer Science 2026-03-27 Geeyang Tay , Wentao Ma , Jaewon Lee , Yuzhi Tang , Daniel Lee , Weisu Yin , Dongming Shen , Silin Meng , Yi Zhu , Mu Li , Alex Smola

Common measures of accuracy used to assess the performance of automatic speech recognition (ASR) systems, as well as human transcribers, conflate multiple sources of error. Stylistic differences, such as verbatim vs non-verbatim, can play a…

Computation and Language · Computer Science 2024-09-06 Annika Heuser , Tyler Kendall , Miguel del Rio , Quinten McNamara , Nishchal Bhandari , Corey Miller , Migüel Jetté

End-to-end automatic speech recognition systems represent the state of the art, but they rely on thousands of hours of manually annotated speech for training, as well as heavyweight computation for inference. Of course, this impedes…

Computation and Language · Computer Science 2022-11-22 Raphael Tang , Karun Kumar , Gefei Yang , Akshat Pandey , Yajie Mao , Vladislav Belyaev , Madhuri Emmadi , Craig Murray , Ferhan Ture , Jimmy Lin

Automated speech recognition (ASR) models have gained prominence for applications such as captioning, speech translation, and live transcription. This paper studies Whisper and two model variants: one optimized for live speech streaming and…

Sound · Computer Science 2025-03-14 Allison Andreyev

Transcribing meetings containing overlapped speech with only a single distant microphone (SDM) has been one of the most challenging problems for automatic speech recognition (ASR). While various approaches have been proposed, all previous…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-14 Naoyuki Kanda , Guoli Ye , Yu Wu , Yashesh Gaur , Xiaofei Wang , Zhong Meng , Zhuo Chen , Takuya Yoshioka

Multi-speaker speech recognition of unsegmented recordings has diverse applications such as meeting transcription and automatic subtitle generation. With technical advances in systems dealing with speech separation, speaker diarization, and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-05 Desh Raj , Pavel Denisov , Zhuo Chen , Hakan Erdogan , Zili Huang , Maokui He , Shinji Watanabe , Jun Du , Takuya Yoshioka , Yi Luo , Naoyuki Kanda , Jinyu Li , Scott Wisdom , John R. Hershey

As human-machine voice interfaces provide easy access to increasingly intelligent machines, many state-of-the-art automatic speech recognition (ASR) systems are proposed. However, commercial ASR systems usually have poor performance on…

Computation and Language · Computer Science 2023-09-28 Yanan Jia

Automatic Speech Recognition (ASR) is increasingly used to document clinical encounters, yet its reliability in multilingual and demographically diverse Indian healthcare contexts remains largely unknown. In this study, we conduct the first…

The vast majority of ASR research uses corpora in which both the training and test data have been pre-segmented into utterances. In most real-word ASR use-cases, however, test audio is not segmented, leading to a mismatch between…

Computation and Language · Computer Science 2023-09-27 Jennifer Drexler Fox , Desh Raj , Natalie Delworth , Quinn McNamara , Corey Miller , Migüel Jetté

Predicting corporate earnings surprises is a profitable yet challenging task, as accurate forecasts can inform significant investment decisions. However, progress in this domain has been constrained by a reliance on expensive, proprietary,…

Multimedia · Computer Science 2025-10-07 Dong Shu , Yanguang Liu , Huopu Zhang , Mengnan Du

Dialog systems, such as voice assistants, are expected to engage with users in complex, evolving conversations. Unfortunately, traditional automatic speech recognition (ASR) systems deployed in such applications are usually trained to…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-17 Hitesh Tulsiani , David M. Chan , Shalini Ghosh , Garima Lalwani , Prabhat Pandey , Ankish Bansal , Sri Garimella , Ariya Rastrow , Björn Hoffmeister

Automatic speech recognition (ASR) of single channel far-field recordings with an unknown number of speakers is traditionally tackled by cascaded modules. Recent research shows that end-to-end (E2E) multi-speaker ASR models can achieve…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-11 Ilya Sklyar , Anna Piunova , Xianrui Zheng , Yulan Liu

It has been shown that the intelligibility of noisy speech can be improved by speech enhancement (SE) algorithms. However, monaural SE has not been established as an effective frontend for automatic speech recognition (ASR) in noisy…

Sound · Computer Science 2024-03-12 Yufeng Yang , Ashutosh Pandey , DeLiang Wang

The speech representations learned from large-scale unlabeled data have shown better generalizability than those from supervised learning and thus attract a lot of interest to be applied for various downstream tasks. In this paper, we…

Sound · Computer Science 2022-01-25 Zhengyang Chen , Sanyuan Chen , Yu Wu , Yao Qian , Chengyi Wang , Shujie Liu , Yanmin Qian , Michael Zeng

This paper describes a system that generates speaker-annotated transcripts of meetings by using a microphone array and a 360-degree camera. The hallmark of the system is its ability to handle overlapped speech, which has been an unsolved…

Popular ASR benchmarks such as Librispeech and Switchboard are limited in the diversity of settings and speakers they represent. We introduce a set of benchmarks matching real-life conditions, aimed at spotting possible biases and…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-19 Morgane Riviere , Jade Copet , Gabriel Synnaeve

The developments in transformer encoder-decoder architectures have led to significant breakthroughs in machine translation, Automatic Speech Recognition (ASR), and instruction-based chat machines, among other applications. The pre-trained…

Computation and Language · Computer Science 2025-06-30 Kartheek Kumar Reddy Nareddy , Sarah Ternus , Julia Niebling