中文
相关论文

相关论文: Continual Named Entity Recognition without Catastr…

200 篇论文

In this paper, we propose a novel training procedure for the continual representation learning problem in which a neural network model is sequentially learned to alleviate catastrophic forgetting in visual search tasks. Our method, called…

计算机视觉与模式识别 · 计算机科学 2022-06-13 Tommaso Barletti , Niccolo' Biondi , Federico Pernici , Matteo Bruni , Alberto Del Bimbo

State of the art Named Entity Recognition (NER) models have achieved an impressive ability to extract common phrases from text that belong to labels such as location, organization, time, and person. However, typical NER systems that rely on…

计算与语言 · 计算机科学 2024-01-24 Alexandra Loessberg-Zahl

In Continual learning (CL) balancing effective adaptation while combating catastrophic forgetting is a central challenge. Many of the recent best-performing methods utilize various forms of prior task data, e.g. a replay buffer, to tackle…

机器学习 · 计算机科学 2023-06-07 Nader Asadi , MohammadReza Davari , Sudhir Mudur , Rahaf Aljundi , Eugene Belilovsky

A plain well-trained deep learning model often does not have the ability to learn new knowledge without forgetting the previously learned knowledge, which is known as catastrophic forgetting. Here we propose a novel method, SupportNet, to…

神经与进化计算 · 计算机科学 2018-12-31 Yu Li , Zhongxiao Li , Lizhong Ding , Yijie Pan , Chao Huang , Yuhui Hu , Wei Chen , Xin Gao

In this work, we propose a two-stage method for named entity recognition (NER), especially for nested NER. We borrowed the idea from the two-stage Object Detection in computer vision and the way how they construct the loss function. First,…

计算与语言 · 计算机科学 2021-01-28 Bing Li

Forgetting presents a significant challenge during incremental training, making it particularly demanding for contemporary AI systems to assimilate new knowledge in streaming data environments. To address this issue, most approaches in…

机器学习 · 计算机科学 2024-08-27 Monica Millunzi , Lorenzo Bonicelli , Angelo Porrello , Jacopo Credi , Petter N. Kolm , Simone Calderara

When combined with In-Context Learning, a technique that enables models to adapt to new tasks by incorporating task-specific examples or demonstrations directly within the input prompt, autoregressive language models have achieved good…

计算与语言 · 计算机科学 2024-10-18 Enzo Shiraishi , Raphael Y. de Camargo , Henrique L. P. Silva , Ronaldo C. Prati

Humans possess an innate ability to identify and differentiate instances that they are not familiar with, by leveraging and adapting the knowledge that they have acquired so far. Importantly, they achieve this without deteriorating the…

计算机视觉与模式识别 · 计算机科学 2022-07-22 K J Joseph , Sujoy Paul , Gaurav Aggarwal , Soma Biswas , Piyush Rai , Kai Han , Vineeth N Balasubramanian

Supervised machine learning assumes the availability of fully-labeled data, but in many cases, such as low-resource languages, the only data available is partially annotated. We study the problem of Named Entity Recognition (NER) with…

计算与语言 · 计算机科学 2019-09-23 Stephen Mayhew , Snigdha Chaturvedi , Chen-Tse Tsai , Dan Roth

Named entity recognition (NER) is a fundamental part of extracting information from documents in biomedical applications. A notable advantage of NER is its consistency in extracting biomedical entities in a document context. Although…

计算与语言 · 计算机科学 2022-10-25 Minbyul Jeong , Jaewoo Kang

Large Language Models (LLMs) have demonstrated impressive capabilities for generalizing in unseen tasks. In the Named Entity Recognition (NER) task, recent advancements have seen the remarkable improvement of LLMs in a broad range of entity…

计算与语言 · 计算机科学 2024-06-21 Yuyang Ding , Juntao Li , Pinzheng Wang , Zecheng Tang , Bowen Yan , Min Zhang

Current systems of fine-grained entity typing use distant supervision in conjunction with existing knowledge bases to assign categories (type labels) to entity mentions. However, the type labels so obtained from knowledge bases are often…

计算与语言 · 计算机科学 2016-02-18 Xiang Ren , Wenqi He , Meng Qu , Clare R. Voss , Heng Ji , Jiawei Han

Although named entity recognition (NER) helps us to extract domain-specific entities from text (e.g., artists in the music domain), it is costly to create a large amount of training data or a structured knowledge base to perform accurate…

计算与语言 · 计算机科学 2023-06-07 Kosuke Nishida , Naoki Yoshinaga , Kyosuke Nishida

In this paper, we study the named entity recognition (NER) problem under distant supervision. Due to the incompleteness of the external dictionaries and/or knowledge bases, such distantly annotated training data usually suffer from a high…

计算与语言 · 计算机科学 2022-04-21 Kang Zhou , Yuepei Li , Qi Li

This paper presents an iterative approach to performing Scientific Named Entity Recognition (SciNER) using BERT-based models. We leverage transfer learning to fine-tune pretrained models with a small but high-quality set of manually…

计算与语言 · 计算机科学 2025-02-25 Kartik Gupta

Human beings are able to master a variety of knowledge and skills with ongoing learning. By contrast, dramatic performance degradation is observed when new tasks are added to an existing neural network model. This phenomenon, termed as…

机器学习 · 计算机科学 2019-10-25 Xin Yao , Tianchi Huang , Chenglei Wu , Rui-Xiao Zhang , Lifeng Sun

Negative sampling is highly effective in handling missing annotations for named entity recognition (NER). One of our contributions is an analysis on how it makes sense through introducing two insightful concepts: missampling and…

计算与语言 · 计算机科学 2022-02-28 Yangming Li , Lemao Liu , Shuming Shi

We present a bi-encoder framework for named entity recognition (NER), which applies contrastive learning to map candidate text spans and entity types into the same vector representation space. Prior work predominantly approaches NER as…

计算与语言 · 计算机科学 2023-02-24 Sheng Zhang , Hao Cheng , Jianfeng Gao , Hoifung Poon

In Continual Learning, a Neural Network is trained on a stream of data whose distribution shifts over time. Under these assumptions, it is especially challenging to improve on classes appearing later in the stream while remaining accurate…

机器学习 · 计算机科学 2020-10-13 Pietro Buzzega , Matteo Boschini , Angelo Porrello , Simone Calderara

Over the past years, semantic segmentation, as many other tasks in computer vision, benefited from the progress in deep neural networks, resulting in significantly improved performance. However, deep architectures trained with…

计算机视觉与模式识别 · 计算机科学 2022-02-02 Guanglei Yang , Enrico Fini , Dan Xu , Paolo Rota , Mingli Ding , Hao Tang , Xavier Alameda-Pineda , Elisa Ricci