English
Related papers

Related papers: A Byte-sized Approach to Named Entity Recognition

200 papers

Tokenization is a critical component of Natural Language Processing (NLP), especially for low resource languages, where subword segmentation influences vocabulary structure and downstream task accuracy. Although Byte Pair Encoding (BPE) is…

Computation and Language · Computer Science 2025-04-25 Priyaranjan Pattnayak , Hitesh Laxmichand Patel , Amit Agarwal

For several purposes in Natural Language Processing (NLP), such as Information Extraction, Sentiment Analysis or Chatbot, Named Entity Recognition (NER) holds an important role as it helps to determine and categorize entities in text into…

Computation and Language · Computer Science 2020-03-24 Thong Nguyen , Duy Nguyen , Pramod Rao

The number of biomedical literature on new biomedical concepts is rapidly increasing, which necessitates a reliable biomedical named entity recognition (BioNER) model for identifying new and unseen entity mentions. However, it is…

Computation and Language · Computer Science 2022-03-15 Hyunjae Kim , Jaewoo Kang

Nested named entity recognition (NER) has been receiving increasing attention. Recently, (Fu et al, 2021) adapt a span-based constituency parser to tackle nested NER. They treat nested entities as partially-observed constituency trees and…

Computation and Language · Computer Science 2022-03-10 Chao Lou , Songlin Yang , Kewei Tu

Training a neural network-based biomedical named entity recognition (BioNER) model usually requires extensive and costly human annotations. While several studies have employed multi-task learning with multiple BioNER datasets to reduce…

Computation and Language · Computer Science 2024-12-31 Yu Yin , Hyunjae Kim , Xiao Xiao , Chih Hsuan Wei , Jaewoo Kang , Zhiyong Lu , Hua Xu , Meng Fang , Qingyu Chen

Biomedical entity linking (EL) consists of named entity recognition (NER) and named entity disambiguation (NED). EL models are trained on corpora labeled by a predefined KB. However, it is a common scenario that only entities within a…

Computation and Language · Computer Science 2023-06-06 Hongyi Yuan , Keming Lu , Zheng Yuan

The most common Named Entity Recognizers are usually sequence taggers trained on fully annotated corpora, i.e. the class of all words for all entities is known. Partially annotated corpora, i.e. some but not all entities of some types are…

Computation and Language · Computer Science 2022-04-21 Michael Strobl , Amine Trabelsi , Osmar Zaiane

Identifying the named entities mentioned in text would enrich many semantic applications at the downstream level. However, due to the predominant usage of colloquial language in microblogs, the named entity recognition (NER) in Chinese…

Computation and Language · Computer Science 2019-08-29 Canwen Xu , Feiyang Wang , Jialong Han , Chenliang Li

Named Entity Recognition (NER) is a useful component in Natural Language Processing (NLP) applications. It is used in various tasks such as Machine Translation, Summarization, Information Retrieval, and Question-Answering systems. The…

Clinical Named Entity Recognition (CNER) aims to identify and classify clinical terms such as diseases, symptoms, treatments, exams, and body parts in electronic health records, which is a fundamental and crucial task for clinical and…

Computation and Language · Computer Science 2018-04-16 Qi Wang , Yuhang Xia , Yangming Zhou , Tong Ruan , Daqi Gao , Ping He

Recent approaches based on artificial neural networks (ANNs) have shown promising results for named-entity recognition (NER). In order to achieve high performances, ANNs need to be trained on a large labeled dataset. However, labels might…

Computation and Language · Computer Science 2017-05-18 Ji Young Lee , Franck Dernoncourt , Peter Szolovits

Supervised machine learning assumes the availability of fully-labeled data, but in many cases, such as low-resource languages, the only data available is partially annotated. We study the problem of Named Entity Recognition (NER) with…

Computation and Language · Computer Science 2019-09-23 Stephen Mayhew , Snigdha Chaturvedi , Chen-Tse Tsai , Dan Roth

As a fundamental natural language processing task and one of core knowledge extraction techniques, named entity recognition (NER) is widely used to extract information from texts for downstream tasks. Nested NER is a branch of NER in which…

Computation and Language · Computer Science 2022-04-19 Yifei Yang , Zuchao Li , Hai Zhao

Named Entity Recognition (NER) in domains like e-commerce is an understudied problem due to the lack of annotated datasets. Recognizing novel entity types in this domain, such as products, components, and attributes, is challenging because…

Computation and Language · Computer Science 2020-05-25 Hanchu Zhang , Leonhard Hennig , Christoph Alt , Changjian Hu , Yao Meng , Chao Wang

Named entity recognition (NER) task aims at identifying entities from a piece of text that belong to predefined semantic types such as person, location, organization, etc. The state-of-the-art solutions for flat entities NER commonly suffer…

Computation and Language · Computer Science 2022-08-08 Jianlin Su , Ahmed Murtadha , Shengfeng Pan , Jing Hou , Jun Sun , Wanwei Huang , Bo Wen , Yunfeng Liu

When comparing entities extracted by a medical entity recognition system with gold standard annotations over a test set, two types of mismatches might occur, label mismatch or span mismatch. Here we focus on span mismatch and show that its…

Computation and Language · Computer Science 2020-06-11 Isar Nejadgholi , Kathleen C. Fraser , Berry De Bruijn

Byte-pair encoding (BPE) is a ubiquitous algorithm in the subword tokenization process of language models as it provides multiple benefits. However, this process is solely based on pre-training data statistics, making it hard for the…

Computation and Language · Computer Science 2021-09-27 Gustavo Aguilar , Bryan McCann , Tong Niu , Nazneen Rajani , Nitish Keskar , Thamar Solorio

Ever-larger language models with ever-increasing capabilities are by now well-established text processing tools. Alas, information extraction tasks such as named entity recognition are still largely unaffected by this progress as they are…

Computation and Language · Computer Science 2023-08-16 Tobias Deußer , Lars Hillebrand , Christian Bauckhage , Rafet Sifa

Named Entity Recognition (NER) aims at locating and classifying named entities in text. In some use cases of NER, including cases where detected named entities are used in creating content recommendations, it is crucial to have a reliable…

Neural and Evolutionary Computing · Computer Science 2017-12-07 Mahdi Namazifar

To tackle Named Entity Recognition (NER) tasks, supervised methods need to obtain sufficient cleanly annotated data, which is labor and time consuming. On the contrary, distantly supervised methods acquire automatically annotated data using…

Computation and Language · Computer Science 2019-12-05 Shifeng Liu , Yifang Sun , Bing Li , Wei Wang , Xiang Zhao