English
Related papers

Related papers: Small Language Model Makes an Effective Long Text …

200 papers

Large language models (LLMs) allow us to generate high-quality human-like text. One interesting task in natural language processing (NLP) is named entity recognition (NER), which seeks to detect mentions of relevant information in…

Computation and Language · Computer Science 2024-06-10 Fabián Villena , Luis Miranda , Claudio Aracena

Traditional named entity recognition (NER) aims to identify text mentions into pre-defined entity types. Continual Named Entity Recognition (CNER) is introduced since entity categories are continuously increasing in various real-world…

Computation and Language · Computer Science 2025-10-14 Yawen Yang , Fukun Ma , Shiao Meng , Aiwei Liu , Lijie Wen

Large Language Models (LLMs) have revolutionized various sectors, including healthcare where they are employed in diverse applications. Their utility is particularly significant in the context of rare diseases, where data scarcity,…

Computation and Language · Computer Science 2024-08-20 Qiuhao Lu , Rui Li , Andrew Wen , Jinlian Wang , Liwei Wang , Hongfang Liu

Language Models (LMs) such as BERT, have been shown to perform well on the task of identifying Named Entities (NE) in text. A BERT LM is typically used as a classifier to classify individual tokens in the input text, or to classify spans of…

Computation and Language · Computer Science 2024-03-04 Edward Whittaker , Ikuo Kitagishi

Named entity recognition (NER) is a vital task in spoken language understanding, which aims to identify mentions of named entities in text e.g., from transcribed speech. Existing neural models for NER rely mostly on dedicated word-level…

Computation and Language · Computer Science 2019-09-24 Abdalghani Abujabal , Judith Gaspers

Although Large Language Models (LLMs) exhibit remarkable adaptability across domains, these models often fall short in structured knowledge extraction tasks such as named entity recognition (NER). This paper explores an innovative,…

Computation and Language · Computer Science 2024-06-11 Yuzhao Heng , Chunyuan Deng , Yitong Li , Yue Yu , Yinghao Li , Rongzhi Zhang , Chao Zhang

In this work, we address the NER problem by splitting it into two logical sub-tasks: (1) Span Detection which simply extracts entity mention spans irrespective of entity type; (2) Span Classification which classifies the spans into their…

Computation and Language · Computer Science 2023-11-01 Jatin Arora , Youngja Park

This paper presents ReverseNER, a method aimed at overcoming the limitation of large language models (LLMs) in zero-shot named entity recognition (NER) tasks, arising from their reliance on pre-provided demonstrations. ReverseNER tackles…

Computation and Language · Computer Science 2024-12-30 Anbang Wang , Difei Mei , Zhichao Zhang , Xiuxiu Bai , Ran Yao , Zewen Fang , Min Hu , Zhirui Cao , Haitao Sun , Yifeng Guo , Hongyao Zhou , Yu Guo

Named entity recognition (NER) aims to identify mentions of named entities in an unstructured text and classify them into predefined named entity classes. While deep learning-based pre-trained language models help to achieve good predictive…

Computation and Language · Computer Science 2023-06-16 Ali Osman Berk Sapci , Oznur Tastan , Reyyan Yeniterzi

Sequence labeling (SL) is a fundamental research problem encompassing a variety of tasks, e.g., part-of-speech (POS) tagging, named entity recognition (NER), text chunking, etc. Though prevalent and effective in many downstream applications…

Computation and Language · Computer Science 2020-11-16 Zhiyong He , Zanbo Wang , Wei Wei , Shanshan Feng , Xianling Mao , Sheng Jiang

Named entity recognition (NER) is an extensively studied task that extracts and classifies named entities in a text. NER is crucial not only in downstream language processing applications such as relation extraction and question answering…

Computation and Language · Computer Science 2020-05-19 Gizem Aras , Didem Makaroglu , Seniz Demir , Altan Cakir

Identifying relevant text spans is important for several downstream tasks in NLP, as it contributes to model explainability. While most span identification approaches rely on relatively smaller pre-trained language models like BERT, a few…

Computation and Language · Computer Science 2026-01-05 Alphaeus Dmonte , Roland Oruche , Tharindu Ranasinghe , Marcos Zampieri , Prasad Calyam

In the domain of Natural Language Processing (NLP), Named Entity Recognition (NER) stands out as a pivotal mechanism for extracting structured insights from unstructured text. This manuscript offers an exhaustive exploration into the…

Computation and Language · Computer Science 2023-09-26 Kalyani Pakhale

Named entity recognition (NER) models often struggle with noisy inputs, such as those with spelling mistakes or errors generated by Optical Character Recognition processes, and learning a robust NER model is challenging. Existing robust NER…

Computation and Language · Computer Science 2024-07-29 Chaoyi Ai , Yong Jiang , Shen Huang , Pengjun Xie , Kewei Tu

Named entity recognition (NER) is a fundamental task in numerous downstream applications. Recently, researchers have employed pre-trained language models (PLMs) and large language models (LLMs) to address this task. However, fully…

Computation and Language · Computer Science 2025-10-30 Yufei Zhao , Xiaoshi Zhong , Erik Cambria , Jagath C. Rajapakse

Despite the fact that large-scale Language Models (LLM) have achieved SOTA performances on a variety of NLP tasks, its performance on NER is still significantly below supervised baselines. This is due to the gap between the two tasks the…

Computation and Language · Computer Science 2023-10-10 Shuhe Wang , Xiaofei Sun , Xiaoya Li , Rongbin Ouyang , Fei Wu , Tianwei Zhang , Jiwei Li , Guoyin Wang

Named Entity Recognition (NER) in historical texts presents unique challenges due to non-standardized language, archaic orthography, and nested or overlapping entities. This study benchmarks a diverse set of NER approaches, ranging from…

Computation and Language · Computer Science 2025-06-04 Ludovic Moncla , Hédi Zeghidi

Large Language Models (LLMs) have shown impressive abilities in data annotation, opening the way for new approaches to solve classic NLP problems. In this paper, we show how to use LLMs to create NuNER, a compact language representation…

Computation and Language · Computer Science 2024-02-26 Sergei Bogdanov , Alexandre Constantin , Timothée Bernard , Benoit Crabbé , Etienne Bernard

Recent studies in Retrieval-Augmented Generation (RAG) have investigated extracting evidence from retrieved passages to reduce computational costs and enhance the final RAG performance, yet it remains challenging. Existing methods heavily…

Computation and Language · Computer Science 2024-10-16 Xinping Zhao , Dongfang Li , Yan Zhong , Boren Hu , Yibin Chen , Baotian Hu , Min Zhang

Large language models (LLMs) have demonstrated dominating performance in many NLP tasks, especially on generative tasks. However, they often fall short in some information extraction tasks, particularly those requiring domain-specific…

Computation and Language · Computer Science 2023-09-22 Junyi Bian , Jiaxuan Zheng , Yuyi Zhang , Shanfeng Zhu