English
Related papers

Related papers: Restoring Forgotten Knowledge in Non-Exemplar Clas…

200 papers

Class-incremental learning (CIL) is a particularly challenging variant of continual learning, where the goal is to learn to discriminate between all classes presented in an incremental fashion. Existing approaches often suffer from…

Machine Learning · Computer Science 2024-03-12 Michał Zając , Tinne Tuytelaars , Gido M. van de Ven

Current class-incremental learning research mainly focuses on single-label classification tasks while multi-label class-incremental learning (MLCIL) with more practical application scenarios is rarely studied. Although there have been many…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Songlin Dong , Haoyu Luo , Yuhang He , Xing Wei , Yihong Gong

In real-world applications, dynamic scenarios require the models to possess the capability to learn new tasks continuously without forgetting the old knowledge. Experience-Replay methods store a subset of the old images for joint training.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Xinyuan Gao , Songlin Dong , Yuhang He , Xing Wei , Yihong Gong

Few-shot class-incremental learning (FSCIL) aims to incrementally learn models from a small amount of novel data, which requires strong representation and adaptation ability of models learned under few-example supervision to avoid…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Kexin Bao , Yong Li , Dan Zeng , Shiming Ge

Non-exemplar class-incremental learning is to recognize both the old and new classes when old class samples cannot be saved. It is a challenging task since representation optimization and feature retention can only be achieved under…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Kai Zhu , Wei Zhai , Yang Cao , Jiebo Luo , Zheng-Jun Zha

As a front-burner problem in incremental learning, class incremental semantic segmentation (CISS) is plagued by catastrophic forgetting and semantic drift. Although recent methods have utilized knowledge distillation to transfer knowledge…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Danpei Zhao , Bo Yuan , Zhenwei Shi

In this paper, we consider the problem of fine-grained image retrieval in an incremental setting, when new categories are added over time. On the one hand, repeatedly training the representation on the extended dataset is time-consuming. On…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Wei Chen , Yu Liu , Weiping Wang , Tinne Tuytelaars , Erwin M. Bakker , Michael Lew

Few-shot class incremental learning (FSCIL) portrays the problem of learning new concepts gradually, where only a few examples per concept are available to the learner. Due to the limited number of examples for training, the techniques…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Ali Cheraghian , Shafin Rahman , Pengfei Fang , Soumava Kumar Roy , Lars Petersson , Mehrtash Harandi

To accommodate real-world dynamics, artificial intelligence systems need to cope with sequentially arriving content in an online manner. Beyond regular Continual Learning (CL) attempting to address catastrophic forgetting with offline…

Machine Learning · Computer Science 2024-04-02 HongWei Yan , Liyuan Wang , Kaisheng Ma , Yi Zhong

Few-shot class-incremental learning (FSCIL), which targets at continuously expanding model's representation capacity under few supervisions, is an important yet challenging problem. On the one hand, when fitting new tasks (novel classes),…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Boyu Yang , Mingbao Lin , Binghao Liu , Mengying Fu , Chang Liu , Rongrong Ji , Qixiang Ye

The main purpose of incremental learning is to learn new knowledge while not forgetting the knowledge which have been learned before. At present, the main challenge in this area is the catastrophe forgetting, namely the network will lose…

Machine Learning · Computer Science 2019-06-13 Qiuyu Zhu , Zikuang He , Xin Ye

Time series with missing data are signals encountered in important settings for machine learning. Some of the most successful prior approaches for modeling such time series are based on recurrent neural networks that transform the input and…

Machine Learning · Computer Science 2021-04-20 Alberto García-Durán , Robert West

With the memory-resource-limited constraints, class-incremental learning (CIL) usually suffers from the "catastrophic forgetting" problem when updating the joint classification model on the arrival of newly added classes. To cope with the…

Machine Learning · Computer Science 2021-05-19 Hanbin Zhao , Hui Wang , Yongjian Fu , Fei Wu , Xi Li

Although deep learning approaches have stood out in recent years due to their state-of-the-art results, they continue to suffer from catastrophic forgetting, a dramatic decrease in overall performance when training with new classes added…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Francisco M. Castro , Manuel J. Marín-Jiménez , Nicolás Guil , Cordelia Schmid , Karteek Alahari

In this work, we propose a new setting of continual learning: data-incremental continual offline reinforcement learning (DICORL), in which an agent is asked to learn a sequence of datasets of a single offline reinforcement learning (RL)…

Machine Learning · Computer Science 2024-12-17 Sibo Gai , Donglin Wang

Artificial neural networks thrive in solving the classification problem for a particular rigid task, acquiring knowledge through generalized learning behaviour from a distinct training phase. The resulting network resembles a static entity…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Matthias De Lange , Rahaf Aljundi , Marc Masana , Sarah Parisot , Xu Jia , Ales Leonardis , Gregory Slabaugh , Tinne Tuytelaars

New objects are continuously emerging in the dynamically changing world and a real-world artificial intelligence system should be capable of continual and effectual adaptation to new emerging classes without forgetting old ones. In view of…

Machine Learning · Computer Science 2023-05-04 Xuejun Han , Yuhong Guo

Class-incremental learning is becoming more popular as it helps models widen their applicability while not forgetting what they already know. A trend in this area is to use a mixture-of-expert technique, where different models work together…

Continual Learning (CL) aims at incrementally learning new tasks without forgetting the knowledge acquired from old ones. Experience Replay (ER) is a simple and effective rehearsal-based strategy, which optimizes the model with current…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Tao Zhuo , Zhiyong Cheng , Zan Gao , Hehe Fan , Mohan Kankanhalli

Class incremental learning (CIL) requires an agent to learn distinct tasks consecutively with knowledge retention against forgetting. Problems impeding the practical applications of CIL methods are twofold: (1) non-i.i.d batch streams and…

Machine Learning · Computer Science 2025-10-27 Junda Wang , Minghui Hu , Ning Li , Abdulaziz Al-Ali , Ponnuthurai Nagaratnam Suganthan