English
Related papers

Related papers: Distilling Causal Effect from Miscellaneous Other-…

200 papers

With the memory-resource-limited constraints, class-incremental learning (CIL) usually suffers from the "catastrophic forgetting" problem when updating the joint classification model on the arrival of newly added classes. To cope with the…

Machine Learning · Computer Science 2021-05-19 Hanbin Zhao , Hui Wang , Yongjian Fu , Fei Wu , Xi Li

In class-incremental learning, the objective is to learn a number of classes sequentially without having access to the whole training data. However, due to a problem known as catastrophic forgetting, neural networks suffer substantial…

Machine Learning · Computer Science 2021-06-01 Sobirdzhon Bobiev , Adil Khan , Syed Muhammad Ahsan Raza Kazmi

The goal of continual learning (CL) is to learn a sequence of tasks without suffering from the phenomenon of catastrophic forgetting. Previous work has shown that leveraging memory in the form of a replay buffer can reduce performance…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Sayna Ebrahimi , Suzanne Petryk , Akash Gokul , William Gan , Joseph E. Gonzalez , Marcus Rohrbach , Trevor Darrell

Discovering cause-effect from observational data is an important but challenging problem in science and engineering. In this work, a recently proposed brain inspired learning algorithm namely-\emph{Neurochaos Learning} (NL) is used for the…

Machine Learning · Computer Science 2022-01-31 Harikrishnan N B , Aditi Kathpalia , Nithin Nagaraj

Although deep learning approaches have stood out in recent years due to their state-of-the-art results, they continue to suffer from catastrophic forgetting, a dramatic decrease in overall performance when training with new classes added…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Francisco M. Castro , Manuel J. Marín-Jiménez , Nicolás Guil , Cordelia Schmid , Karteek Alahari

Continual Learning (CL) primarily aims to retain knowledge to prevent catastrophic forgetting and transfer knowledge to facilitate learning new tasks. Unlike traditional methods, we propose a novel perspective: CL not only needs to prevent…

Machine Learning · Computer Science 2025-06-12 Xuemei Cao , Hanlin Gu , Xin Yang , Bingjun Wei , Haoyang Liang , Xiangkun Wang , Tianrui Li

Current systems of fine-grained entity typing use distant supervision in conjunction with existing knowledge bases to assign categories (type labels) to entity mentions. However, the type labels so obtained from knowledge bases are often…

Computation and Language · Computer Science 2016-02-18 Xiang Ren , Wenqi He , Meng Qu , Clare R. Voss , Heng Ji , Jiawei Han

We study the new task of class-incremental Novel Class Discovery (class-iNCD), which refers to the problem of discovering novel categories in an unlabelled data set by leveraging a pre-trained model that has been trained on a labelled data…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Subhankar Roy , Mingxuan Liu , Zhun Zhong , Nicu Sebe , Elisa Ricci

In general class-incremental learning, researchers typically use sample sets as a tool to avoid catastrophic forgetting during continuous learning. At the same time, researchers have also noted the differences between class-incremental…

Machine Learning · Computer Science 2024-08-16 Weimin Yin , Bin Chen adn Chunzhao Xie , Zhenhao Tan

Continual Learning (CL) is an emerging machine learning paradigm that aims to learn from a continuous stream of tasks without forgetting knowledge learned from the previous tasks. To avoid performance decrease caused by forgetting, prior…

Machine Learning · Computer Science 2023-01-02 Soobee Lee , Minindu Weerakoon , Jonghyun Choi , Minjia Zhang , Di Wang , Myeongjae Jeon

In Continual Learning, a Neural Network is trained on a stream of data whose distribution shifts over time. Under these assumptions, it is especially challenging to improve on classes appearing later in the stream while remaining accurate…

Machine Learning · Computer Science 2020-10-13 Pietro Buzzega , Matteo Boschini , Angelo Porrello , Simone Calderara

The main purpose of incremental learning is to learn new knowledge while not forgetting the knowledge which have been learned before. At present, the main challenge in this area is the catastrophe forgetting, namely the network will lose…

Machine Learning · Computer Science 2019-06-13 Qiuyu Zhu , Zikuang He , Xin Ye

Catastrophic forgetting, the tendency of neural networks to forget previously learned knowledge when learning new tasks, has been a major challenge in continual learning (CL). To tackle this challenge, CL methods have been proposed and…

Machine Learning · Computer Science 2026-03-04 Zhanwang Liu , Yuting Li , Haoyuan Gao , Yexin Li , Linghe Kong , Lichao Sun , Weiran Huang

Distantly-Supervised Named Entity Recognition (DS-NER) is widely used in real-world scenarios. It can effectively alleviate the burden of annotation by matching entities in existing knowledge bases with snippets in the text but suffer from…

Computation and Language · Computer Science 2025-07-04 Shuzheng Si , Helan Hu , Haozhe Zhao , Shuang Zeng , Kaikai An , Zefan Cai , Baobao Chang

Continual learning (CL) aims to empower models to learn new tasks without forgetting previously acquired knowledge. Most prior works concentrate on the techniques of architectures, replay data, regularization, \etc. However, the category…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Bolin Ni , Hongbo Zhao , Chenghao Zhang , Ke Hu , Gaofeng Meng , Zhaoxiang Zhang , Shiming Xiang

Cross-lingual Named Entity Recognition (NER) has recently become a research hotspot because it can alleviate the data-hungry problem for low-resource languages. However, few researches have focused on the scenario where the source-language…

Computation and Language · Computer Science 2022-04-05 Yingwen Fu , Nankai Lin , Ziyu Yang , Shengyi Jiang

Class-incremental learning for semantic segmentation (CiSS) is presently a highly researched field which aims at updating a semantic segmentation model by sequentially learning new semantic classes. A major challenge in CiSS is overcoming…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Tobias Kalb , Jürgen Beyerer

The primary goal of continual learning (CL) task in medical image segmentation field is to solve the "catastrophic forgetting" problem, where the model totally forgets previously learned features when it is extended to new categories…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Qian Chen , Lei Zhu , Hangzhou He , Xinliang Zhang , Shuang Zeng , Qiushi Ren , Yanye Lu

Cross-lingual named entity recognition (NER) suffers from data scarcity in the target languages, especially under zero-shot settings. Existing translate-train or knowledge distillation methods attempt to bridge the language gap, but often…

Computation and Language · Computer Science 2022-11-18 Ran Zhou , Xin Li , Lidong Bing , Erik Cambria , Luo Si , Chunyan Miao

The ability to learn more and more concepts over time from incrementally arriving data is essential for the development of a life-long learning system. However, deep neural networks often suffer from forgetting previously learned concepts…

Machine Learning · Computer Science 2019-07-08 Huaiyu Li , Weiming Dong , Bao-Gang Hu