中文
相关论文

相关论文: Continual Named Entity Recognition without Catastr…

200 篇论文

Class-incremental learning of deep networks sequentially increases the number of classes to be classified. During training, the network has only access to data of one task at a time, where each task contains several classes. In this…

计算机视觉与模式识别 · 计算机科学 2020-04-02 Lu Yu , Bartłomiej Twardowski , Xialei Liu , Luis Herranz , Kai Wang , Yongmei Cheng , Shangling Jui , Joost van de Weijer

Deep neural models for named entity recognition (NER) have shown impressive results in overcoming label scarcity and generalizing to unseen entities by leveraging distant supervision and auxiliary information such as explanations. However,…

Neural networks tend to gradually forget the previously learned knowledge when learning multiple tasks sequentially from dynamic data distributions. This problem is called \textit{catastrophic forgetting}, which is a fundamental challenge…

计算与语言 · 计算机科学 2022-03-21 Chenze Shao , Yang Feng

Recent advances in named entity recognition (NER) have pushed the boundary of the task to incorporate visual signals, leading to many variants, including multi-modal NER (MNER) or grounded MNER (GMNER). A key challenge to these tasks is…

计算与语言 · 计算机科学 2024-04-03 Hyunjong Ok , Taeho Kil , Sukmin Seo , Jaeho Lee

Motivation: Named Entity Recognition (NER) is a key task to support biomedical research. In Biomedical Named Entity Recognition (BioNER), obtaining high-quality expert annotated data is laborious and expensive, leading to the development of…

计算与语言 · 计算机科学 2023-05-23 Liangping Ding , Giovanni Colavizza , Zhixiong Zhang

Catastrophic forgetting, the tendency of neural networks to forget previously learned knowledge when learning new tasks, has been a major challenge in continual learning (CL). To tackle this challenge, CL methods have been proposed and…

机器学习 · 计算机科学 2026-03-04 Zhanwang Liu , Yuting Li , Haoyuan Gao , Yexin Li , Linghe Kong , Lichao Sun , Weiran Huang

Humans excel at lifelong learning, as the brain has evolved to be robust to distribution shifts and noise in our ever-changing environment. Deep neural networks (DNNs), however, exhibit catastrophic forgetting and the learned…

机器学习 · 计算机科学 2023-02-23 Fahad Sarfraz , Elahe Arani , Bahram Zonooz

Few-shot Named Entity Recognition (NER) aims to extract named entities using only a limited number of labeled examples. Existing contrastive learning methods often suffer from insufficient distinguishability in context vector representation…

计算与语言 · 计算机科学 2024-05-09 Haojie Zhang , Yimeng Zhuang

Continual learning for Semantic Segmentation (CSS) is a rapidly emerging field, in which the capabilities of the segmentation model are incrementally improved by learning new classes or new domains. A central challenge in Continual Learning…

计算机视觉与模式识别 · 计算机科学 2022-09-21 Tobias Kalb , Björn Mauthe , Jürgen Beyerer

In real-world applications, dynamic scenarios require the models to possess the capability to learn new tasks continuously without forgetting the old knowledge. Experience-Replay methods store a subset of the old images for joint training.…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Xinyuan Gao , Songlin Dong , Yuhang He , Xing Wei , Yihong Gong

For many natural language processing (NLP) tasks the amount of annotated data is limited. This urges a need to apply semi-supervised learning techniques, such as transfer learning or meta-learning. In this work we tackle Named Entity…

计算与语言 · 计算机科学 2018-12-18 Alexander Fritzler , Varvara Logacheva , Maksim Kretov

In class-incremental learning, the objective is to learn a number of classes sequentially without having access to the whole training data. However, due to a problem known as catastrophic forgetting, neural networks suffer substantial…

机器学习 · 计算机科学 2021-06-01 Sobirdzhon Bobiev , Adil Khan , Syed Muhammad Ahsan Raza Kazmi

Named Entity Recognition (NER) is a crucial upstream task in Natural Language Processing (NLP). Traditional tag scheme approaches offer a single recognition that does not meet the needs of many downstream tasks such as coreference…

计算与语言 · 计算机科学 2020-04-30 Wendong He , Yizhen Shao , Pingjian Zhang

Recently, neural networks have shown promising results for named entity recognition (NER), which needs a number of labeled data to for model training. When meeting a new domain (target domain) for NER, there is no or a few labeled data,…

计算与语言 · 计算机科学 2018-10-17 Lin Li , Yueqing Sun

Distantly-Supervised Named Entity Recognition (DS-NER) is widely used in real-world scenarios. It can effectively alleviate the burden of annotation by matching entities in existing knowledge bases with snippets in the text but suffer from…

计算与语言 · 计算机科学 2025-07-04 Shuzheng Si , Helan Hu , Haozhe Zhao , Shuang Zeng , Kaikai An , Zefan Cai , Baobao Chang

Continual learning is the ability to sequentially learn over time by accommodating knowledge while retaining previously learned experiences. Neural networks can learn multiple tasks when trained on them jointly, but cannot maintain…

机器学习 · 计算机科学 2018-10-26 Frantzeska Lavda , Jason Ramapuram , Magda Gregorova , Alexandros Kalousis

Catastrophic forgetting is a significant challenge in the field of machine learning, particularly in neural networks. When a neural network learns to perform well on a new task, it often forgets its previously acquired knowledge or…

机器学习 · 计算机科学 2023-12-04 Nuri Korhan , Ceren Öner

Artificial neural networks, celebrated for their human-like cognitive learning abilities, often encounter the well-known catastrophic forgetting (CF) problem, where the neural networks lose the proficiency in previously acquired knowledge.…

机器学习 · 计算机科学 2024-05-14 Weiwei Weng , Mahardhika Pratama , Jie Zhang , Chen Chen , Edward Yapp Kien Yee , Ramasamy Savitha

The incremental sequence labeling task involves continuously learning new classes over time while retaining knowledge of the previous ones. Our investigation identifies two significant semantic shifts: E2O (where the model mislabels an old…

计算与语言 · 计算机科学 2024-05-28 Shengjie Qiu , Junhao Zheng , Zhen Liu , Yicheng Luo , Qianli Ma

Although deep learning approaches have stood out in recent years due to their state-of-the-art results, they continue to suffer from catastrophic forgetting, a dramatic decrease in overall performance when training with new classes added…

计算机视觉与模式识别 · 计算机科学 2018-09-05 Francisco M. Castro , Manuel J. Marín-Jiménez , Nicolás Guil , Cordelia Schmid , Karteek Alahari