English
Related papers

Related papers: NuNER: Entity Recognition Encoder Pre-training via…

200 papers

This paper presents a case study on deploying Large Language Models (LLMs) as an advanced "annotation" mechanism to achieve nuanced content understanding (e.g., discerning content "vibe") at scale within a large-scale industrial short-form…

Despite their strong linguistic capabilities, Large Language Models (LLMs) are computationally demanding and require substantial resources for fine-tuning, which is unadapted to privacy and budget constraints of many healthcare settings. To…

Computation and Language · Computer Science 2026-04-30 Pierre Epron , Adrien Coulet , Mehwish Alam

Many sensitive domains -- such as the clinical domain -- lack widely available datasets due to privacy risks. The increasing generative capabilities of large language models (LLMs) have made synthetic datasets a viable path forward. In this…

Computation and Language · Computer Science 2025-06-03 Thomas Vakili , Aron Henriksson , Hercules Dalianis

In this study, we aim to reduce generation latency for Named Entity Recognition (NER) with Large Language Models (LLMs). The main cause of high latency in LLMs is the sequential decoding process, which autoregressively generates all labels…

Computation and Language · Computer Science 2024-11-22 Jinghui Lu , Ziwei Yang , Yanjie Wang , Xuejing Liu , Brian Mac Namee , Can Huang

Large Language Models (LLMs) have demonstrated impressive capabilities in language generation and general task performance. However, their application to spoken language understanding (SLU) remains challenging, particularly for token-level…

Computation and Language · Computer Science 2025-10-09 Shangjian Yin , Peijie Huang , Jiatian Chen , Haojing Huang , Yuhong Xu

Character-level patterns have been widely used as features in English Named Entity Recognition (NER) systems. However, to date there has been no direct investigation of the inherent differences between name and non-name tokens in text, nor…

Computation and Language · Computer Science 2018-09-21 Xiaodong Yu , Stephen Mayhew , Mark Sammons , Dan Roth

Data annotation refers to the labeling or tagging of textual data with relevant information. A large body of works have reported positive results on leveraging LLMs as an alternative to human annotators. However, existing studies focus on…

Computation and Language · Computer Science 2024-10-07 Yu-Min Tseng , Wei-Lin Chen , Chung-Chi Chen , Hsin-Hsi Chen

Deep neural network models have helped named entity (NE) recognition achieve amazing performance without handcrafting features. However, existing systems require large amounts of human annotated training data. Efforts have been made to…

Information Retrieval · Computer Science 2020-10-06 Ying Luo , Hai Zhao , Junlang Zhan

Large language models (LLMs) have demonstrated remarkable capabilities in handling complex dialogue tasks without requiring use case-specific fine-tuning. However, analyzing live dialogues in real-time necessitates low-latency processing…

Computation and Language · Computer Science 2025-03-10 Xuanqing Liu , Luyang Kong , Wei Niu , Afshin Khashei , Belinda Zeng , Steve Johnson , Jon Jay , Davor Golac , Matt Pope

More recently, Named Entity Recognition hasachieved great advances aided by pre-trainingapproaches such as BERT. However, currentpre-training techniques focus on building lan-guage modeling objectives to learn a gen-eral representation,…

Computation and Language · Computer Science 2020-10-29 Mengge Xue , Bowen Yu , Zhenyu Zhang , Tingwen Liu , Yue Zhang , Bin Wang

Named Entity Recognition (NER) is a critical task that requires substantial annotated data, making it challenging in low-resource scenarios where label acquisition is expensive. While zero-shot and instruction-tuned approaches have made…

Computation and Language · Computer Science 2025-10-21 Nanda Kumar Rengarajan , Jun Yan , Chun Wang

This paper presents a comprehensive study to efficiently build named entity recognition (NER) systems when a small number of in-domain labeled data is available. Based upon recent Transformer-based self-supervised pre-trained language…

Computation and Language · Computer Science 2021-01-01 Jiaxin Huang , Chunyuan Li , Krishan Subudhi , Damien Jose , Shobana Balakrishnan , Weizhu Chen , Baolin Peng , Jianfeng Gao , Jiawei Han

Named entity recognition (NER) is used to extract information from various documents and texts such as names and dates. It is important to extract education and work experience information from resumes in order to filter them. Considering…

Computation and Language · Computer Science 2023-06-23 Ege Kesim , Aysu Deliahmetoglu

The use of BERT, one of the most popular language models, has led to improvements in many Natural Language Processing (NLP) tasks. One such task is Named Entity Recognition (NER) i.e. automatic identification of named entities such as…

Computation and Language · Computer Science 2023-03-10 Harshil Darji , Jelena Mitrović , Michael Granitzer

Over the last two decades, the development of the CoNLL-2003 named entity recognition (NER) dataset has helped enhance the capabilities of deep learning and natural language processing (NLP). The finance domain, characterized by its unique…

Computation and Language · Computer Science 2024-09-10 Agam Shah , Abhinav Gullapalli , Ruchit Vithani , Michael Galarnyk , Sudheer Chava

Work done to uncover the knowledge encoded within pre-trained language models rely on annotated corpora or human-in-the-loop methods. However, these approaches are limited in terms of scalability and the scope of interpretation. We propose…

Computation and Language · Computer Science 2023-10-23 Basel Mousi , Nadir Durrani , Fahim Dalvi

Named-entities are inherently multilingual, and annotations in any given language may be limited. This motivates us to consider polyglot named-entity recognition (NER), where one model is trained using annotated data drawn from more than…

Computation and Language · Computer Science 2020-05-05 David Mueller , Nicholas Andrews , Mark Dredze

Entity Linking (EL) has traditionally relied on large annotated datasets and extensive model fine-tuning. While recent few-shot methods leverage large language models (LLMs) through prompting to reduce training requirements, they often…

Computation and Language · Computer Science 2025-11-20 Yajie Li , Albert Galimov , Mitra Datta Ganapaneni , Pujitha Thejaswi , De Meng , Priyanshu Kumar , Saloni Potdar

Large Language Models (LLMs) and pre-trained Language Models (LMs) have achieved impressive success on many software engineering tasks (e.g., code completion and code generation). By leveraging huge existing code corpora (e.g., GitHub),…

Software Engineering · Computer Science 2025-01-16 Xin Yin , Chao Ni , Xiaodan Xu , Xinrui Li , Xiaohu Yang

Clinical Named Entity Recognition (CNER) aims to identify and classify clinical terms such as diseases, symptoms, treatments, exams, and body parts in electronic health records, which is a fundamental and crucial task for clinical and…

Computation and Language · Computer Science 2018-04-16 Qi Wang , Yuhang Xia , Yangming Zhou , Tong Ruan , Daqi Gao , Ping He