English
Related papers

Related papers: Libri-Light: A Benchmark for ASR with Limited or N…

200 papers

We propose multi-layer perceptron (MLP)-based architectures suitable for variable length input. MLP-based architectures, recently proposed for image classification, can only be used for inputs of a fixed, pre-defined size. However, many…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-18 Jin Sakuma , Tatsuya Komatsu , Robin Scheibler

It is well known that many machine learning systems demonstrate bias towards specific groups of individuals. This problem has been studied extensively in the Facial Recognition area, but much less so in Automatic Speech Recognition (ASR).…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-22 Chunxi Liu , Michael Picheny , Leda Sarı , Pooja Chitkara , Alex Xiao , Xiaohui Zhang , Mark Chou , Andres Alvarado , Caner Hazirbas , Yatharth Saraf

Recent progress in speech processing has highlighted that high-quality performance across languages requires substantial training data for each individual language. While existing multilingual datasets cover many languages, they often…

Computation and Language · Computer Science 2025-10-28 Samuel Pfisterer , Florian Grötschla , Luca A. Lanzendörfer , Florian Yan , Roger Wattenhofer

Self-supervised learning has been successfully used for various speech related tasks, including automatic speech recognition. BERT-based Speech pre-Training with Random-projection Quantizer (BEST-RQ) has achieved state-of-the-art results in…

Sound · Computer Science 2025-01-28 Ilja Baumann , Dominik Wagner , Korbinian Riedhammer , Tobias Bocklet

Large language models (LLMs) have driven substantial advances in speech language models (SpeechLMs), yielding strong performance in automatic speech recognition (ASR) under high-resource conditions. However, existing benchmarks…

Computation and Language · Computer Science 2026-03-23 Jianan Chen , Xiaoxue Gao , Tatsuya Kawahara , Nancy F. Chen

Automatic speech recognition (ASR) systems have achieved strong performance on general transcription tasks. However, they continue to struggle with recognizing rare named entities and adapting to domain mismatches. In contrast, large…

Computation and Language · Computer Science 2025-08-21 Shaoshi Ling , Guoli Ye

We present state-of-the-art automatic speech recognition (ASR) systems employing a standard hybrid DNN/HMM architecture compared to an attention-based encoder-decoder design for the LibriSpeech task. Detailed descriptions of the system…

Computation and Language · Computer Science 2019-10-02 Christoph Lüscher , Eugen Beck , Kazuki Irie , Markus Kitza , Wilfried Michel , Albert Zeyer , Ralf Schlüter , Hermann Ney

While deep learning based end-to-end automatic speech recognition (ASR) systems have greatly simplified modeling pipelines, they suffer from the data sparsity issue. In this work, we propose a self-training method with an end-to-end system…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-31 Yang Chen , Weiran Wang , Chao Wang

Improving ASR systems is necessary to make new LLM-based use-cases accessible to people across the globe. In this paper, we focus on Indian languages, and make the case that diverse benchmarks are required to evaluate and improve ASR…

Computation and Language · Computer Science 2023-08-03 Kaushal Santosh Bhogale , Sai Sundaresan , Abhigyan Raman , Tahir Javed , Mitesh M. Khapra , Pratyush Kumar

There are several domains that own corresponding widely used feature extractors, such as ResNet, BERT, and GPT-x. These models are usually pre-trained on large amounts of unlabeled data by self-supervision and can be effectively applied to…

Computation and Language · Computer Science 2021-01-19 Cheng Yi , Jianzhong Wang , Ning Cheng , Shiyu Zhou , Bo Xu

A random sample of nearly 10 hours of speech from PennSound, the world's largest online collection of poetry readings and discussions, was used as a benchmark to evaluate several commercial and open-source speech-to-text systems.…

Computation and Language · Computer Science 2025-04-09 Jonathan Wright , Mark Liberman , Neville Ryant , James Fiumara

Most recent speech recognition models rely on large supervised datasets, which are unavailable for many low-resource languages. In this work, we present a speech recognition pipeline that does not require any audio for the target language.…

Computation and Language · Computer Science 2022-09-08 Xinjian Li , Florian Metze , David R Mortensen , Alan W Black , Shinji Watanabe

Training a robust Automatic Speech Recognition (ASR) system for children's speech recognition is a challenging task due to inherent differences in acoustic attributes of adult and child speech and scarcity of publicly available children's…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-15 Vishwanath Pratap Singh , Hardik Sailor , Supratik Bhattacharya , Abhishek Pandey

Automatic speech recognition research focuses on training and evaluating on static datasets. Yet, as speech models are increasingly deployed on personal devices, such models encounter user-specific distributional shifts. To simulate this…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-26 Anuj Diwan , Ching-Feng Yeh , Wei-Ning Hsu , Paden Tomasello , Eunsol Choi , David Harwath , Abdelrahman Mohamed

The parallel advances in language modeling and speech representation learning have raised the prospect of learning language directly from speech without textual intermediates. This requires extracting semantic representations directly from…

Automatic Speech Recognition has been a longstanding research area, with substantial efforts dedicated to integrating semi-supervised learning due to the scarcity of labeled datasets. However, most prior work has focused on improving…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-10 Nune Tadevosyan , Nikolay Karpov , Andrei Andrusenko , Vitaly Lavrukhin , Ante Jukic

Advancements in deep neural networks have allowed automatic speech recognition (ASR) systems to attain human parity on several publicly available clean speech datasets. However, even state-of-the-art ASR systems experience performance…

Computation and Language · Computer Science 2023-10-17 Chen Chen , Yuchen Hu , Chao-Han Huck Yang , Sabato Macro Siniscalchi , Pin-Yu Chen , Eng Siong Chng

This work presents an extensive and detailed study on Audio-Visual Speech Recognition (AVSR) for five widely spoken languages: Chinese, Spanish, English, Arabic, and French. We have collected large-scale datasets for each language except…

Computation and Language · Computer Science 2024-06-04 Sanath Narayan , Yasser Abdelaziz Dahou Djilali , Ankit Singh , Eustache Le Bihan , Hakim Hacid

Recent advancement in deep learning encouraged developing large automatic speech recognition (ASR) models that achieve promising results while ignoring computational and memory constraints. However, deploying such models on low resource…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Abdul Hannan , Alessio Brutti , Shah Nawaz , Mubashir Noman

Automatic Speech Recognition (ASR) offers significant potential to reduce the workload of medical personnel, for example, through the automation of documentation tasks. While numerous benchmarks exist for the English language, specific…

Computation and Language · Computer Science 2026-01-29 Thomas Schuster , Julius Trögele , Nico Döring , Robin Krüger , Matthieu Hoffmann , Holger Friedrich