English
Related papers

Related papers: WhisperNER: Unified Open Named Entity and Speech R…

200 papers

Although modern named entity recognition (NER) systems show impressive performance on standard datasets, they perform poorly when presented with noisy data. In particular, capitalization is a strong signal for entities in many languages,…

Computation and Language · Computer Science 2019-12-17 Stephen Mayhew , Nitish Gupta , Dan Roth

This paper proposes AS-ASR, a lightweight aphasia-specific speech recognition framework based on Whisper-tiny, tailored for low-resource deployment on edge devices. Our approach introduces a hybrid training strategy that systematically…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-03 Chen Bao , Chuanbing Huo , Qinyu Chen , Chang Gao

NER model has achieved promising performance on standard NER benchmarks. However, recent studies show that previous approaches may over-rely on entity mention information, resulting in poor performance on out-of-vocabulary (OOV) entity…

Computation and Language · Computer Science 2022-05-04 Xiao Wang , Shihan Dou , Limao Xiong , Yicheng Zou , Qi Zhang , Tao Gui , Liang Qiao , Zhanzhan Cheng , Xuanjing Huang

With the fast development of Deep Learning techniques, Named Entity Recognition (NER) is becoming more and more important in the information extraction task. The greatest difficulty that the NER task faces is to keep the detectability even…

Computation and Language · Computer Science 2024-01-23 Xin Chen , Qi Zhao , Xinyang Liu

In automatic speech recognition, any factor that alters the acoustic properties of speech can pose a challenge to the system's performance. This paper presents a novel approach for automatic whispered speech recognition in the Irish dialect…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-05 Aref Farhadipour , Homa Asadi , Volker Dellwo

The state-of-the-art named entity recognition (NER) systems are supervised machine learning models that require large amounts of manually annotated data to achieve high accuracy. However, annotating NER data by human is expensive and…

Computation and Language · Computer Science 2019-11-04 Jian Ni , Georgiana Dinu , Radu Florian

We propose a simple method for automatic speech recognition (ASR) by fine-tuning BERT, which is a language model (LM) trained on large-scale unlabeled text data and can generate rich contextual representations. Our assumption is that given…

Sound · Computer Science 2021-02-02 Wen-Chin Huang , Chia-Hua Wu , Shang-Bao Luo , Kuan-Yu Chen , Hsin-Min Wang , Tomoki Toda

Named entity recognition (NER) is a widely studied task in natural language processing. Recently, a growing number of studies have focused on the nested NER. The span-based methods, considering the entity recognition as a span…

Computation and Language · Computer Science 2021-06-22 Zeqi Tan , Yongliang Shen , Shuai Zhang , Weiming Lu , Yueting Zhuang

Recent strides in automatic speech recognition (ASR) have accelerated their application in the medical domain where their performance on accented medical named entities (NE) such as drug names, diagnoses, and lab results, is largely…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-19 Tejumade Afonja , Tobi Olatunji , Sewade Ogun , Naome A. Etori , Abraham Owodunni , Moshood Yekini

Automatic Speech Recognition (ASR) systems are used in the financial domain to enhance the caller experience by enabling natural language understanding and facilitating efficient and intuitive interactions. Increasing use of ASR systems…

Machine Learning · Computer Science 2024-02-08 Chirag Chhablani , Nikhita Sharma , Jordan Hosier , Vijay K. Gurbani

Automated speech recognition (ASR) models have gained prominence for applications such as captioning, speech translation, and live transcription. This paper studies Whisper and two model variants: one optimized for live speech streaming and…

Sound · Computer Science 2025-03-14 Allison Andreyev

We introduce Universal NER (UNER), an open, community-driven project to develop gold-standard NER benchmarks in many languages. The overarching goal of UNER is to provide high-quality, cross-lingually consistent annotations to facilitate…

Named Entity Recognition (NER) is an important subtask of information extraction that seeks to locate and recognise named entities. Despite recent achievements, we still face limitations in correctly detecting and classifying entities,…

Information Retrieval · Computer Science 2018-09-07 Diego Esteves

The advancements of Large Language Models (LLMs) have spurred a growing interest in their application to Named Entity Recognition (NER) methods. However, existing datasets are primarily designed for traditional machine learning methods and…

Computation and Language · Computer Science 2026-05-18 Hanjun Luo , Yingbin Jin , Xinfeng Li , Xuecheng Liu , Ruizhe Chen , Tong Shang , Kun Wang , Qingsong Wen , Zuozhu Liu

Whisper's robust performance in automatic speech recognition (ASR) is often attributed to its massive 680k-hour training set, an impractical scale for most researchers. In this work, we examine how linguistic and acoustic diversity in…

Computation and Language · Computer Science 2025-05-28 Dancheng Liu , Amir Nassereldine , Chenhui Xu , Jinjun Xiong

In this paper, we propose a new strategy for the task of named entity recognition (NER). We cast the task as a query-based machine reading comprehension task: e.g., the task of extracting entities with PER is formalized as answering the…

Computation and Language · Computer Science 2019-11-05 Yuxian Meng , Xiaoya Li , Zijun Sun , Jiwei Li

This paper investigates the in-context learning abilities of the Whisper automatic speech recognition (ASR) models released by OpenAI. A novel speech-based in-context learning (SICL) approach is proposed for test-time adaptation, which can…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-21 Siyin Wang , Chao-Han Huck Yang , Ji Wu , Chao Zhang

Automatic Speech Recognition systems have made significant progress with large-scale pre-trained models. However, most current systems focus solely on transcribing the speech without identifying speaker roles, a function that is critical…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-13 Anfeng Xu , Tiantian Feng , Shrikanth Narayanan

We present a bi-encoder framework for named entity recognition (NER), which applies contrastive learning to map candidate text spans and entity types into the same vector representation space. Prior work predominantly approaches NER as…

Computation and Language · Computer Science 2023-02-24 Sheng Zhang , Hao Cheng , Jianfeng Gao , Hoifung Poon

Named Entity Recognition (NER) is a foundational task in Natural Language Processing (NLP) and Information Retrieval (IR), which facilitates semantic search and structured data extraction. We introduce \textbf{AWED-FiNER}, an open-source…

Computation and Language · Computer Science 2026-02-23 Prachuryya Kaushik , Ashish Anand