English
Related papers

Related papers: RWTH ASR Systems for LibriSpeech: Hybrid vs Attent…

200 papers

Automatic Speech Recognition (ASR) has advanced with Speech Foundation Models (SFMs), yet performance degrades on dysarthric speech due to variability and limited data. This study as part of the submission to the Speech Accessibility…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-28 Alexandre Ducorroy , Rachid Riad

Text to speech (TTS) and automatic speech recognition (ASR) are two dual tasks in speech processing and both achieve impressive performance thanks to the recent advance in deep learning and large amount of aligned speech and text data.…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-28 Yi Ren , Xu Tan , Tao Qin , Sheng Zhao , Zhou Zhao , Tie-Yan Liu

This study presents a hybrid deep learning architecture that integrates LSTM, CNN, and an Attention mechanism to enhance the classification of web content based on text. Pretrained GloVe embeddings are used to represent words as dense…

Computation and Language · Computer Science 2025-12-29 Mykola Kuz , Ihor Lazarovych , Mykola Kozlenko , Mykola Pikuliak , Andrii Kvasniuk

Multilingual ASR technology simplifies model training and deployment, but its accuracy is known to depend on the availability of language information at runtime. Since language identity is seldom known beforehand in real-world scenarios, it…

Bootstrapping speech recognition on limited data resources has been an area of active research for long. The recent transition to all-neural models and end-to-end (E2E) training brought along particular challenges as these models are known…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-21 Manuel Giollo , Deniz Gunceler , Yulan Liu , Daniel Willett

This paper proposes a new approach to perform unsupervised fine-tuning and self-training using unlabeled speech data for recurrent neural network (RNN)-Transducer (RNN-T) end-to-end (E2E) automatic speech recognition (ASR) systems.…

Computation and Language · Computer Science 2022-08-01 Cong-Thanh Do , Mohan Li , Rama Doddipatla

Automatic Speech Recognition (ASR) has reached impressive accuracy for high-resource languages, yet its utility in linguistic fieldwork remains limited. Recordings collected in fieldwork contexts present unique challenges, including…

Computation and Language · Computer Science 2025-06-25 Siyu Liang , Gina-Anne Levow

Audio-based automatic speech recognition (ASR) degrades significantly in noisy environments and is particularly vulnerable to interfering speech, as the model cannot determine which speaker to transcribe. Audio-visual speech recognition…

Sound · Computer Science 2022-07-18 Bowen Shi , Wei-Ning Hsu , Abdelrahman Mohamed

This paper presents an exploration of end-to-end automatic speech recognition systems (ASR) for the largest open-source Russian language data set -- OpenSTT. We evaluate different existing end-to-end approaches such as joint CTC/Attention,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-08 Andrei Andrusenko , Aleksandr Laptev , Ivan Medennikov

Large Language Models (LLMs) have showcased exceptional performance across diverse NLP tasks, and their integration with speech encoder is rapidly emerging as a dominant trend in the Automatic Speech Recognition (ASR) field. Previous works…

Artificial Intelligence · Computer Science 2024-12-05 Zheshu Song , Ziyang Ma , Yifan Yang , Jianheng Zhuo , Xie Chen

Speech summarization, which generates a text summary from speech, can be achieved by combining automatic speech recognition (ASR) and text summarization (TS). With this cascade approach, we can exploit state-of-the-art models and large…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-17 Takatomo Kano , Atsunori Ogawa , Marc Delcroix , Shinji Watanabe

Despite significant efforts over the last few years to build a robust automatic speech recognition (ASR) system for different acoustic settings, the performance of the current state-of-the-art technologies significantly degrades in noisy…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-17 Salar Jafarlou , Soheil Khorram , Vinay Kothapally , John H. L. Hansen

Speaker adaptation is important to build robust automatic speech recognition (ASR) systems. In this work, we investigate various methods for speaker adaptive training (SAT) based on feature-space approaches for a conformer-based acoustic…

Computation and Language · Computer Science 2022-06-28 Mohammad Zeineldeen , Jingjing Xu , Christoph Lüscher , Ralf Schlüter , Hermann Ney

Text-to-speech (TTS) models have been widely adopted to enhance automatic speech recognition (ASR) systems using text-only corpora, thereby reducing the cost of labeling real speech data. Existing research primarily utilizes additional text…

Computation and Language · Computer Science 2024-11-21 Jiawei Yu , Yuang Li , Xiaosong Qiao , Huan Zhao , Xiaofeng Zhao , Wei Tang , Min Zhang , Hao Yang , Jinsong Su

Conformers have recently been proposed as a promising modelling approach for automatic speech recognition (ASR), outperforming recurrent neural network-based approaches and transformers. Nevertheless, in general, the performance of these…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-25 Carlos Carvalho , Alberto Abad

End-to-end (E2E) automatic speech recognition (ASR) with sequence-to-sequence models has gained attention because of its simple model training compared with conventional hidden Markov model based ASR. Recently, several studies report the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-21 Yuya Fujita , Aswin Shanmugam Subramanian , Motoi Omachi , Shinji Watanabe

Employing pre-trained language models (LM) to extract contextualized word representations has achieved state-of-the-art performance on various NLP tasks. However, applying this technique to noisy transcripts generated by automatic speech…

Computation and Language · Computer Science 2020-11-03 Chao-Wei Huang , Yun-Nung Chen

State-of-the-art hybrid automatic speech recognition (ASR) system exploits deep neural network (DNN) based acoustic models (AM) trained with Lattice Free-Maximum Mutual Information (LF-MMI) criterion and n-gram language models. The AMs…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-23 Amrutha Prasad , Petr Motlicek , Srikanth Madikeri

Automatic Speech Recognition (ASR) aims to convert human speech content into corresponding text. In conversational scenarios, effectively utilizing context can enhance its accuracy. Large Language Models' (LLMs) exceptional long-context…

Sound · Computer Science 2026-01-19 Bingshen Mu , Hexin Liu , Hongfei Xue , Kun Wei , Lei Xie

The Whisper model, an open-source automatic speech recognition system, is widely adopted for its strong performance across multilingual and zero-shot settings. However, it frequently suffers from hallucination errors, especially under noisy…

Artificial Intelligence · Computer Science 2025-11-19 Kumud Tripathi , Aditya Srinivas Menon , Aman Gaurav , Raj Prakash Gohil , Pankaj Wasnik