English
Related papers

Related papers: Contextualized End-to-End Speech Recognition with …

200 papers

Contextualized end-to-end automatic speech recognition has been an active research area, with recent efforts focusing on the implicit learning of contextual phrases based on the final loss objective. However, these approaches ignore the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-12 Muhammad Shakeel , Yui Sudo , Yifan Peng , Shinji Watanabe

Deep biasing improves automatic speech recognition (ASR) performance by incorporating contextual phrases. However, most existing methods enhance subwords in a contextual phrase as independent units, potentially compromising contextual…

Sound · Computer Science 2025-05-30 Zhennan Lin , Kaixun Huang , Wei Ren , Linju Yang , Lei Xie

Contextual biasing is an important and challenging task for end-to-end automatic speech recognition (ASR) systems, which aims to achieve better recognition performance by biasing the ASR system to particular context phrases such as person…

Computation and Language · Computer Science 2022-09-08 Xiaoqiang Wang , Yanqing Liu , Jinyu Li , Veljko Miljanic , Sheng Zhao , Hosam Khalil

Attention-based contextual biasing approaches have shown significant improvements in the recognition of generic and/or personal rare-words in End-to-End Automatic Speech Recognition (E2E ASR) systems like neural transducers. These…

Computation and Language · Computer Science 2023-05-10 Xuandi Fu , Kanthashree Mysore Sathyendra , Ankur Gandhe , Jing Liu , Grant P. Strimel , Ross McGowan , Athanasios Mouchtaris

By incorporating additional contextual information, deep biasing methods have emerged as a promising solution for speech recognition of personalized words. However, for real-world voice assistants, always biasing on such personalized words…

Sound · Computer Science 2023-08-16 Tianyi Xu , Zhanheng Yang , Kaixun Huang , Pengcheng Guo , Ao Zhang , Biao Li , Changru Chen , Chao Li , Lei Xie

The attention-based deep contextual biasing method has been demonstrated to effectively improve the recognition performance of end-to-end automatic speech recognition (ASR) systems on given contextual phrases. However, unlike shallow fusion…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-10 Kaixun Huang , Ao Zhang , Binbin Zhang , Tianyi Xu , Xingchen Song , Lei Xie

Improving the representation of contextual information is key to unlocking the potential of end-to-end (E2E) automatic speech recognition (ASR). In this work, we present a novel and simple approach for training an ASR context mechanism with…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-30 Uri Alon , Golan Pundak , Tara N. Sainath

In recent years, Large Language Models (LLMs) have garnered significant attention from the research community due to their exceptional performance and generalization capabilities. In this paper, we introduce a novel method for…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-21 Egor Lakomkin , Chunyang Wu , Yassir Fathullah , Ozlem Kalinli , Michael L. Seltzer , Christian Fuegen

How to leverage dynamic contextual information in end-to-end speech recognition has remained an active research area. Previous solutions to this problem were either designed for specialized use cases that did not generalize well to…

End-to-end (E2E) automatic speech recognition (ASR) methods exhibit remarkable performance. However, since the performance of such methods is intrinsically linked to the context present in the training data, E2E-ASR methods do not perform…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-22 Yui Sudo , Muhammad Shakeel , Yosuke Fukumoto , Yifan Peng , Shinji Watanabe

Nowadays, most methods in end-to-end contextual speech recognition bias the recognition process towards contextual knowledge. Since all-neural contextual biasing methods rely on phrase-level contextual modeling and attention-based relevance…

Computation and Language · Computer Science 2022-03-03 Minglun Han , Linhao Dong , Zhenlin Liang , Meng Cai , Shiyu Zhou , Zejun Ma , Bo Xu

Convolutional neural networks (CNN) have shown promising results for end-to-end speech recognition, albeit still behind other state-of-the-art methods in performance. In this paper, we study how to bridge this gap and go beyond with a novel…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Wei Han , Zhengdong Zhang , Yu Zhang , Jiahui Yu , Chung-Cheng Chiu , James Qin , Anmol Gulati , Ruoming Pang , Yonghui Wu

Sequence-to-sequence attention-based models on subword units allow simple open-vocabulary end-to-end speech recognition. In this work, we show that such models can achieve competitive results on the Switchboard 300h and LibriSpeech 1000h…

Computation and Language · Computer Science 2019-08-06 Albert Zeyer , Kazuki Irie , Ralf Schlüter , Hermann Ney

Existing research suggests that automatic speech recognition (ASR) models can benefit from additional contexts (e.g., contact lists, user specified vocabulary). Rare words and named entities can be better recognized with contexts. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-16 Ruizhe Huang , Mahsa Yarmohammadi , Sanjeev Khudanpur , Daniel Povey

Speech foundation models (SFMs), such as Open Whisper-Style Speech Models (OWSM), are trained on massive datasets to achieve accurate automatic speech recognition. However, even SFMs struggle to accurately recognize rare and unseen words.…

Sound · Computer Science 2025-06-12 Yui Sudo , Yusuke Fujita , Atsushi Kojima , Tomoya Mizumoto , Lianbo Liu

While end-to-end (E2E) automatic speech recognition (ASR) models excel at general transcription, they struggle to recognize rare or unseen named entities (e.g., contact names, locations), which are critical for downstream applications like…

Computation and Language · Computer Science 2025-12-22 Ramaneswaran Selvakumar , Cindy Tseng , Eesung Kim , Vijendra Raj Apsingekar , Yun Tang

For a speech-enhancement algorithm, it is highly desirable to simultaneously improve perceptual quality and recognition rate. Thanks to computational costs and model complexities, it is challenging to train a model that effectively…

Machine Learning · Computer Science 2018-02-19 Rasool Fakoor , Xiaodong He , Ivan Tashev , Shuayb Zarar

Contextual ASR, which takes a list of bias terms as input along with audio, has drawn recent interest as ASR use becomes more widespread. We are releasing contextual biasing lists to accompany the Earnings21 dataset, creating a public…

Computation and Language · Computer Science 2022-09-07 Jennifer Drexler Fox , Natalie Delworth

Connectionist temporal classification (CTC) is widely used for maximum likelihood learning in end-to-end speech recognition models. However, there is usually a disparity between the negative maximum likelihood and the performance metric…

Computation and Language · Computer Science 2017-12-20 Yingbo Zhou , Caiming Xiong , Richard Socher

Contextual biasing improves automatic speech recognition (ASR) by integrating external knowledge, such as user-specific phrases or entities, during decoding. In this work, we use an attention-based biasing decoder to produce scores for…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-29 Wanting Huang , Weiran Wang
‹ Prev 1 2 3 10 Next ›