English
Related papers

Related papers: CopyNE: Better Contextual ASR by Copying Named Ent…

200 papers

Integrating named entity recognition (NER) with automatic speech recognition (ASR) can significantly enhance transcription accuracy and informativeness. In this paper, we introduce WhisperNER, a novel model that allows joint speech…

Computation and Language · Computer Science 2025-08-08 Gil Ayache , Menachem Pirchi , Aviv Navon , Aviv Shamsian , Gill Hetz , Joseph Keshet

Improving the representation of contextual information is key to unlocking the potential of end-to-end (E2E) automatic speech recognition (ASR). In this work, we present a novel and simple approach for training an ASR context mechanism with…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-30 Uri Alon , Golan Pundak , Tara N. Sainath

End-to-end automatic speech recognition systems often fail to transcribe domain-specific named entities, causing catastrophic failures in downstream tasks. Numerous fast and lightweight named entity correction (NEC) models have been…

Computation and Language · Computer Science 2025-10-27 Yuanchang Luo , Daimeng Wei , Shaojun Li , Hengchao Shang , Jiaxin Guo , Zongyao Li , Zhanglin Wu , Xiaoyu Chen , Zhiqiang Rao , Jinlong Yang , Hao Yang

While end-to-end (E2E) automatic speech recognition (ASR) models excel at general transcription, they struggle to recognize rare or unseen named entities (e.g., contact names, locations), which are critical for downstream applications like…

Computation and Language · Computer Science 2025-12-22 Ramaneswaran Selvakumar , Cindy Tseng , Eesung Kim , Vijendra Raj Apsingekar , Yun Tang

Automatic Speech Recognition (ASR) systems, such as Whisper, achieve high transcription accuracy but struggle with named entities and numerical data, especially when proper formatting is required. These issues increase word error rate (WER)…

Computation and Language · Computer Science 2025-07-01 Duygu Altinok

Named entity recognition (NER) is among SLU tasks that usually extract semantic information from textual documents. Until now, NER from speech is made through a pipeline process that consists in processing first an automatic speech…

Computation and Language · Computer Science 2018-05-31 Sahar Ghannay , Antoine Caubrière , Yannick Estève , Antoine Laurent , Emmanuel Morin

Named entity recognition (NER) from text has been a widely studied problem and usually extracts semantic information from text. Until now, NER from speech is mostly studied in a two-step pipeline process that includes first applying an…

Computation and Language · Computer Science 2020-05-25 Hemant Yadav , Sreyan Ghosh , Yi Yu , Rajiv Ratn Shah

End-to-end modeling (E2E) of automatic speech recognition (ASR) blends all the components of a traditional speech recognition system into a unified model. Although it simplifies training and decoding pipelines, the unified model is hard to…

Computation and Language · Computer Science 2018-12-06 Zhehuai Chen , Mahaveer Jain , Yongqiang Wang , Michael L. Seltzer , Christian Fuegen

End-to-end automatic speech recognition (E2E-ASR) has the potential to improve performance, but a specific issue that needs to be addressed is the difficulty it has in handling enharmonic words: named entities (NEs) with the same…

Sound · Computer Science 2023-05-30 Yui Sudo , Kazuya Hata , Kazuhiro Nakadai

Despite the success of end-to-end automatic speech recognition (ASR) models, challenges persist in recognizing rare, out-of-vocabulary words - including named entities (NE) - and in adapting to new domains using only text data. This work…

Personalization of automatic speech recognition (ASR) models is a widely studied topic because of its many practical applications. Most recently, attention-based contextual biasing techniques are used to improve the recognition of rare…

Computation and Language · Computer Science 2023-11-15 Sai Muralidhar Jayanthi , Devang Kulshreshtha , Saket Dingliwal , Srikanth Ronanki , Sravan Bodapati

Employing pre-trained language models (LM) to extract contextualized word representations has achieved state-of-the-art performance on various NLP tasks. However, applying this technique to noisy transcripts generated by automatic speech…

Computation and Language · Computer Science 2020-11-03 Chao-Wei Huang , Yun-Nung Chen

Contextual biasing is an important and challenging task for end-to-end automatic speech recognition (ASR) systems, which aims to achieve better recognition performance by biasing the ASR system to particular context phrases such as person…

Computation and Language · Computer Science 2022-09-08 Xiaoqiang Wang , Yanqing Liu , Jinyu Li , Veljko Miljanic , Sheng Zhao , Hosam Khalil

The performance of automatic speech recognition (ASR) has improved tremendously due to the application of deep neural networks (DNNs). Despite this progress, building a new ASR system remains a challenging task, requiring various resources,…

Computation and Language · Computer Science 2015-10-20 Yajie Miao , Mohammad Gowayyed , Florian Metze

This paper proposes a novel automatic speech recognition (ASR) system that can transcribe individual speaker's speech while identifying whether they are target or non-target speakers from multi-talker overlapped speech. Target-speaker ASR…

Voice digital assistants must keep up with trending search queries. We rely on a speech recognition model using contextual biasing with a rapidly updated set of entities, instead of frequent model retraining, to keep up with trends. There…

Computation and Language · Computer Science 2023-06-13 Tianyu Huang , Chung Hoon Hong , Carl Wivagg , Kanna Shimizu

End-2-end (E2E) models have become increasingly popular in some ASR tasks because of their performance and advantages. These E2E models directly approximate the posterior distribution of tokens given the acoustic inputs. Consequently, the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-30 Jesús Andrés-Ferrer , Dario Albesano , Puming Zhan , Paul Vozila

End-to-end automatic speech recognition (E2E ASR) systems have significantly improved speech recognition through training on extensive datasets. Despite these advancements, they still struggle to accurately recognize domain specific words,…

Computation and Language · Computer Science 2024-07-26 Jiwon Suh , Injae Na , Woohwan Jung

Automatic speech recognition (ASR) systems struggle with domain-specific named entities, especially homophones. Contextual ASR improves recognition but often fails to capture fine-grained phoneme variations due to limited entity diversity.…

Computation and Language · Computer Science 2025-09-05 Jiajun He , Naoki Sawada , Koichi Miyazaki , Tomoki Toda

Despite impressive results of language models for named entity recognition (NER), their generalization to varied textual genres, a growing entity type set, and new entities remains a challenge. Collecting thousands of annotations in each…

Computation and Language · Computer Science 2022-04-28 Elena V. Epure , Romain Hennequin
‹ Prev 1 2 3 10 Next ›