English
Related papers

Related papers: Preserving Empirical Probabilities in BERT for Sma…

200 papers

Named entity recognition (NER) is a fundamental part of extracting information from documents in biomedical applications. A notable advantage of NER is its consistency in extracting biomedical entities in a document context. Although…

Computation and Language · Computer Science 2022-10-25 Minbyul Jeong , Jaewoo Kang

As the categories of named entities rapidly increase, the deployed NER models are required to keep updating toward recognizing more entity types, creating a demand for class-incremental learning for NER. Considering the privacy concerns and…

Computation and Language · Computer Science 2023-07-25 Ruotian Ma , Xuanting Chen , Lin Zhang , Xin Zhou , Junzhe Wang , Tao Gui , Qi Zhang , Xiang Gao , Yunwen Chen

Imperfect labels limit the quality of predictions learned by deep neural networks. This is particularly relevant in medical image segmentation, where reference annotations are difficult to collect and vary significantly even across expert…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Eugene Vorontsov , Samuel Kadoury

Named entity recognition (NER), a task that identifies and categorizes named entities such as persons or organizations from text, is traditionally framed as a multi-class classification problem. However, this approach often overlooks the…

Computation and Language · Computer Science 2023-11-10 Ngoc Dang Nguyen , Wei Tan , Lan Du , Wray Buntine , Richard Beare , Changyou Chen

Type- and token-based embedding architectures are still competing in lexical semantic change detection. The recent success of type-based models in SemEval-2020 Task 1 has raised the question why the success of token-based models on a…

Computation and Language · Computer Science 2021-03-15 Severin Laicher , Sinan Kurtyigit , Dominik Schlechtweg , Jonas Kuhn , Sabine Schulte im Walde

Although modern named entity recognition (NER) systems show impressive performance on standard datasets, they perform poorly when presented with noisy data. In particular, capitalization is a strong signal for entities in many languages,…

Computation and Language · Computer Science 2019-12-17 Stephen Mayhew , Nitish Gupta , Dan Roth

Named entity recognition (NER) is one of the best studied tasks in natural language processing. However, most approaches are not capable of handling nested structures which are common in many applications. In this paper we introduce a novel…

Computation and Language · Computer Science 2019-08-12 Joseph Fisher , Andreas Vlachos

In recent years Deep Neural Network-based systems are not only increasing in popularity but also receive growing user trust. However, due to the closed-world assumption of such systems, they cannot recognize samples from unknown classes and…

Machine Learning · Computer Science 2025-01-15 Joanna Komorniczak , Pawel Ksieniewicz

Active learning, a widely adopted technique for enhancing machine learning models in text and image classification tasks with limited annotation resources, has received relatively little attention in the domain of Named Entity Recognition…

Computation and Language · Computer Science 2023-11-03 Haocheng Luo , Wei Tan , Ngoc Dang Nguyen , Lan Du

We study the problem of learning a named entity recognition (NER) tagger using noisy labels from multiple weak supervision sources. Though cheap to obtain, the labels from weak supervision sources are often incomplete, inaccurate, and…

Computation and Language · Computer Science 2021-06-01 Yinghao Li , Pranav Shetty , Lucas Liu , Chao Zhang , Le Song

Neural networks trained on real-world datasets with long-tailed label distributions are biased towards frequent classes and perform poorly on infrequent classes. The imbalance in the ratio of positive and negative samples for each class…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Kevin Duarte , Yogesh S. Rawat , Mubarak Shah

When comparing entities extracted by a medical entity recognition system with gold standard annotations over a test set, two types of mismatches might occur, label mismatch or span mismatch. Here we focus on span mismatch and show that its…

Computation and Language · Computer Science 2020-06-11 Isar Nejadgholi , Kathleen C. Fraser , Berry De Bruijn

In recent years, research has mainly focused on the general NER task. There still have some challenges with nested NER task in the specific domains. Specifically, the scenarios of low resource and class imbalance impede the wide application…

Computation and Language · Computer Science 2025-04-22 Jian Zhang , Tianqing Zhang , Qi Li , Hongwei Wang

We cast nested named entity recognition (NNER) as a sequence labeling task by leveraging prior work that linearizes constituency structures, effectively reducing the complexity of this structured prediction problem to straightforward token…

Computation and Language · Computer Science 2025-09-30 Alberto Muñoz-Ortiz , David Vilares , Caio Corro , Carlos Gómez-Rodríguez

Recognition of biomedical entities from literature is a challenging research focus, which is the foundation for extracting a large amount of biomedical knowledge existing in unstructured texts into structured formats. Using the sequence…

Computation and Language · Computer Science 2021-05-18 Cong Sun , Zhihao Yang , Lei Wang , Yin Zhang , Hongfei Lin , Jian Wang

Using token representation from bidirectional language models (LMs) such as BERT is still a widely used approach for token-classification tasks. Even though there exist much larger unidirectional LMs such as Llama-2, they are rarely used to…

Computation and Language · Computer Science 2024-12-11 Takumi Goto , Hiroyoshi Nagao , Yuta Koreeda

In multi-label classification, an instance may be associated with a set of labels simultaneously. Recently, the research on multi-label classification has largely shifted its focus to the other end of the spectrum where the number of labels…

Machine Learning · Computer Science 2016-04-06 Li Li , Houfeng Wang

Medical events of interest, such as mortality, often happen at a low rate in electronic medical records, as most admitted patients survive. Training models with this imbalance rate (class density discrepancy) may lead to suboptimal…

Machine Learning · Computer Science 2022-08-02 Zepeng Huo , Xiaoning Qian , Shuai Huang , Zhangyang Wang , Bobak J. Mortazavi

Sequential labeling is a task predicting labels for each token in a sequence, such as Named Entity Recognition (NER). NER tasks aim to extract entities and predict their labels given a text, which is important in information extraction.…

Computation and Language · Computer Science 2024-06-06 Jianfeng He , Linlin Yu , Shuo Lei , Chang-Tien Lu , Feng Chen

Biomedical entity linking is the task of linking entity mentions in a biomedical document to referent entities in a knowledge base. Recently, many BERT-based models have been introduced for the task. While these models have achieved…

Computation and Language · Computer Science 2021-09-07 Tuan Lai , Heng Ji , ChengXiang Zhai