English
Related papers

Related papers: A Light-weight contextual spelling correction mode…

200 papers

Accurate recognition of rare and new words remains a pressing problem for contextualized Automatic Speech Recognition (ASR) systems. Most context-biasing methods involve modification of the ASR model or the beam-search decoding algorithm,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-12 Andrei Andrusenko , Aleksandr Laptev , Vladimir Bataev , Vitaly Lavrukhin , Boris Ginsburg

Automatic Speech Recognition (ASR) has witnessed a profound research interest. Recent breakthroughs have given ASR systems different prospects such as faithfully transcribing spoken language, which is a pivotal advancement in building…

Computation and Language · Computer Science 2024-03-05 Ankitha Sudarshan , Vinay Samuel , Parth Patwa , Ibtihel Amara , Aman Chadha

Automatic speech recognition (ASR) systems often encounter difficulties in accurately recognizing rare words, leading to errors that can have a negative impact on downstream tasks such as keyword spotting, intent detection, and text…

Artificial Intelligence · Computer Science 2023-10-10 Jiajun He , Zekun Yang , Tomoki Toda

In recent years, Large Language Models (LLMs) have garnered significant attention from the research community due to their exceptional performance and generalization capabilities. In this paper, we introduce a novel method for…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-21 Egor Lakomkin , Chunyang Wu , Yassir Fathullah , Ozlem Kalinli , Michael L. Seltzer , Christian Fuegen

Automatic speech recognition (ASR) system is becoming a ubiquitous technology. Although its accuracy is closing the gap with that of human level under certain settings, one area that can further improve is to incorporate user-specific…

Computation and Language · Computer Science 2020-05-05 Young Mo Kang , Yingbo Zhou

Fast contextual adaptation has shown to be effective in improving Automatic Speech Recognition (ASR) of rare words and when combined with an on-device personalized training, it can yield an even better recognition result. However, the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-08 Tsendsuren Munkhdalai , Khe Chai Sim , Angad Chandorkar , Fan Gao , Mason Chua , Trevor Strohman , Françoise Beaufays

Current ASR systems are mainly trained and evaluated at the utterance level. Long range cross utterance context can be incorporated. A key task is to derive a suitable compact representation of the most relevant history contexts. In…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-27 Mingyu Cui , Jiawen Kang , Jiajun Deng , Xi Yin , Yutao Xie , Xie Chen , Xunying Liu

We develop a large language model (LLM) based automatic speech recognition (ASR) system that can be contextualized by providing keywords as prior information in text prompts. We adopt decoder-only architecture and use our in-house LLM,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-14 Kento Nozawa , Takashi Masuko , Toru Taniguchi

Automatic speech recognition (ASR) is widely used in consumer electronics. ASR greatly improves the utility and accessibility of technology, but usually the output is only word sequences without punctuation. This can result in ambiguity in…

Computation and Language · Computer Science 2021-02-23 Andrew Silva , Barry-John Theobald , Nicholas Apostoloff

Transformer-based models have demonstrated their effectiveness in automatic speech recognition (ASR) tasks and even shown superior performance over the conventional hybrid framework. The main idea of Transformers is to capture the…

Sound · Computer Science 2022-07-05 Kun Wei , Pengcheng Guo , Ning Jiang

End-to-End Automatic Speech Recognition (ASR) has advanced significantly yet still struggles with rare and domain-specific entities. This paper introduces a simple yet efficient prompt-based biasing technique for contextualized ASR,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-21 Bo Ren , Yu Shi , Jinyu Li

Statistical language models (LM) play a key role in Automatic Speech Recognition (ASR) systems used by conversational agents. These ASR systems should provide a high accuracy under a variety of speaking styles, domains, vocabulary and…

Computation and Language · Computer Science 2018-12-12 Anirudh Raju , Behnam Hedayatnia , Linda Liu , Ankur Gandhe , Chandra Khatri , Angeliki Metallinou , Anu Venkatesh , Ariya Rastrow

Large language model (LLM)-based automatic speech recognition (ASR) has recently achieved strong performance across diverse tasks, yet contextual biasing for named entities and hotwords under large vocabularies remains challenging. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-29 YuXiang Kong , JunFeng Hou , Jian Tang , Bingqing Zhu , Jicheng Zhang , Shaofei Xue

This paper presents an audio visual automatic speech recognition (AV-ASR) system using a Transformer-based architecture. We particularly focus on the scene context provided by the visual information, to ground the ASR. We extract…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-01 Georgios Paraskevopoulos , Srinivas Parthasarathy , Aparna Khare , Shiva Sundaram

Context cues carry information which can improve multi-turn interactions in automatic speech recognition (ASR) systems. In this paper, we introduce a novel mechanism inspired by hyper-prompting to fuse textual context with acoustic…

Computation and Language · Computer Science 2024-01-17 Sergio Duarte-Torres , Arunasish Sen , Aman Rana , Lukas Drude , Alejandro Gomez-Alanis , Andreas Schwarz , Leif Rädel , Volker Leutnant

Although modern automatic speech recognition (ASR) systems can achieve high performance, they may produce errors that weaken readers' experience and do harm to downstream tasks. To improve the accuracy and reliability of ASR hypotheses, we…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-11 Jing Du , Shiliang Pu , Qinbo Dong , Chao Jin , Xin Qi , Dian Gu , Ru Wu , Hongwei Zhou

By incorporating additional contextual information, deep biasing methods have emerged as a promising solution for speech recognition of personalized words. However, for real-world voice assistants, always biasing on such personalized words…

Sound · Computer Science 2023-08-16 Tianyi Xu , Zhanheng Yang , Kaixun Huang , Pengcheng Guo , Ao Zhang , Biao Li , Changru Chen , Chao Li , Lei Xie

Contextual biasing refers to the problem of biasing the automatic speech recognition (ASR) systems towards rare entities that are relevant to the specific user or application scenarios. We propose algorithms for contextual biasing based on…

Contextual ASR, which takes a list of bias terms as input along with audio, has drawn recent interest as ASR use becomes more widespread. We are releasing contextual biasing lists to accompany the Earnings21 dataset, creating a public…

Computation and Language · Computer Science 2022-09-07 Jennifer Drexler Fox , Natalie Delworth

Contextual ASR or hotword customization holds substantial practical value. Despite the impressive performance of current end-to-end (E2E) automatic speech recognition (ASR) systems, they often face challenges in accurately recognizing rare…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-12 Guanrou Yang , Ziyang Ma , Zhifu Gao , Shiliang Zhang , Xie Chen