English
Related papers

Related papers: A Comparative Study on Neural Architectures and Tr…

200 papers

End-to-end transformer-based models epitomize the cutting-edge in Automatic Speech Recognition (ASR) systems. Despite their substantial benefits, these models demand extensive training data to perform optimally, presenting a significant…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-10 Abdulhady Abas Abdullah , Hadi Veisi , Tarik Rashid

Automatic Speech Recognition (ASR) has undergone a profound transformation over the past decade, driven by advances in deep learning. This survey provides a comprehensive overview of the modern era of ASR, charting its evolution from…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-16 Md. Nayeem , Md Shamse Tabrej , Kabbojit Jit Deb , Shaonti Goswami , Md. Azizul Hakim

Attention-based contextual biasing approaches have shown significant improvements in the recognition of generic and/or personal rare-words in End-to-End Automatic Speech Recognition (E2E ASR) systems like neural transducers. These…

Computation and Language · Computer Science 2023-05-10 Xuandi Fu , Kanthashree Mysore Sathyendra , Ankur Gandhe , Jing Liu , Grant P. Strimel , Ross McGowan , Athanasios Mouchtaris

This article concerns comparative studies on the Automatic Speech Recognition (ASR) model incorporated with the Large Language Model (LLM) used for medical interviews. The proposed solution is tested on polish language benchmarks and…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-04 Marcin Pietroń , Szymon Piórkowski , Kamil Faber , Dominik Żurek , Michał Karwatowski , Jerzy Duda , Hubert Zieliński , Piotr Lipnicki , Mikołaj Leszczuk

Speech recognition applications cover a range of different audio and text distributions, with different speaking styles, background noise, transcription punctuation and character casing. However, many speech recognition systems require…

Computation and Language · Computer Science 2022-10-25 Sanchit Gandhi , Patrick von Platen , Alexander M. Rush

We propose a bottom-up framework for automatic speech recognition (ASR) in syllable-based languages by unifying language-universal articulatory attribute modeling with syllable-level prediction. The system first recognizes sequences or…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-11 Hao Yen , Pin-Jui Ku , Sabato Marco Siniscalchi , Chin-Hui Lee

Self-supervised learning representations (SSLR) have resulted in robust features for downstream tasks in many fields. Recently, several SSLRs have shown promising results on automatic speech recognition (ASR) benchmark corpora. However,…

Sound · Computer Science 2022-07-01 Szu-Jui Chen , Jiamin Xie , John H. L. Hansen

End-to-end (E2E) spoken language understanding (SLU) systems predict utterance semantics directly from speech using a single model. Previous work in this area has focused on targeted tasks in fixed domains, where the output semantic…

Computation and Language · Computer Science 2021-10-08 Michael Saxon , Samridhi Choudhary , Joseph P. McKenna , Athanasios Mouchtaris

This paper presents an efficient decoding approach for end-to-end automatic speech recognition (E2E-ASR) with large language models (LLMs). Although shallow fusion is the most common approach to incorporate language models into E2E-ASR…

Computation and Language · Computer Science 2025-01-17 Takaaki Hori , Martin Kocour , Adnan Haider , Erik McDermott , Xiaodan Zhuang

End-to-end architectures have been recently proposed for spoken language understanding (SLU) and semantic parsing. Based on a large amount of data, those models learn jointly acoustic and linguistic-sequential features. Such architectures…

Computation and Language · Computer Science 2020-02-17 Marco Dinarelli , Nikita Kapoor , Bassam Jabaian , Laurent Besacier

Hybrid and end-to-end (E2E) systems have their individual advantages, with different error patterns in the speech recognition results. By jointly modeling audio and text, the E2E model performs better in matched scenarios and scales well…

Computation and Language · Computer Science 2022-02-23 Guoli Ye , Vadim Mazalov , Jinyu Li , Yifan Gong

Although end-to-end automatic speech recognition (e2e ASR) models are widely deployed in many applications, there have been very few studies to understand models' robustness against adversarial perturbations. In this paper, we explore…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-08 Zhiyun Lu , Wei Han , Yu Zhang , Liangliang Cao

Accent variability has posed a huge challenge to automatic speech recognition~(ASR) modeling. Although one-hot accent vector based adaptation systems are commonly used, they require prior knowledge about the target accent and cannot handle…

Sound · Computer Science 2022-04-22 Xun Gong , Yizhou Lu , Zhikai Zhou , Yanmin Qian

In this paper, we propose an incremental learning method for end-to-end Automatic Speech Recognition (ASR) which enables an ASR system to perform well on new tasks while maintaining the performance on its originally learned ones. To…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-17 Li Fu , Xiaoxiao Li , Libo Zi , Zhengchen Zhang , Youzheng Wu , Xiaodong He , Bowen Zhou

The efficacy of external language model (LM) integration with existing end-to-end (E2E) automatic speech recognition (ASR) systems can be improved significantly using the internal language model estimation (ILME) method. In this method, the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-26 Zhong Meng , Naoyuki Kanda , Yashesh Gaur , Sarangarajan Parthasarathy , Eric Sun , Liang Lu , Xie Chen , Jinyu Li , Yifan Gong

End-to-end automatic speech recognition directly maps input speech to characters. However, the mapping can be problematic when several different pronunciations should be mapped into one character or when one pronunciation is shared among…

Computation and Language · Computer Science 2023-03-14 Yusuke Fujita , Tatsuya Komatsu , Yusuke Kida

Attention-based encoder-decoder architectures such as Listen, Attend, and Spell (LAS), subsume the acoustic, pronunciation and language model components of a traditional automatic speech recognition (ASR) system into a single neural…

Prompts are crucial to large language models as they provide context information such as topic or logical relationships. Inspired by this, we propose PromptASR, a framework that integrates prompts in end-to-end automatic speech recognition…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-25 Xiaoyu Yang , Wei Kang , Zengwei Yao , Yifan Yang , Liyong Guo , Fangjun Kuang , Long Lin , Daniel Povey

Self-supervised learning (SSL) has been dramatically successful not only in monolingual but also in cross-lingual settings. However, since the two settings have been studied individually in general, there has been little research focusing…

Computation and Language · Computer Science 2023-05-10 Takanori Ashihara , Takafumi Moriya , Kohei Matsuura , Tomohiro Tanaka

End-to-end (E2E) systems synthesise high-quality speech, but this typically requires a large amount of data. As E2E synthesis progressed from Tacotron to FastSpeech2, it became evident that features representing prosody, particularly…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-19 Anusha Prakash , S Umesh , Hema A Murthy