English
Related papers

Related papers: Queried Unlabeled Data Improves and Robustifies Cl…

200 papers

This paper presents a practical and simple yet efficient method to effectively deal with the catastrophic forgetting for Class Incremental Learning (CIL) tasks. CIL tends to learn new concepts perfectly, but not at the expense of…

Machine Learning · Computer Science 2021-03-30 Bahram Mohammadi , Mohammad Sabokrou

Class incremental learning (CIL) trains a network on sequential tasks with separated categories in each task but suffers from catastrophic forgetting, where models quickly lose previously learned knowledge when acquiring new tasks. The…

Machine Learning · Computer Science 2024-11-05 Huiping Zhuang , Yizhu Chen , Di Fang , Run He , Kai Tong , Hongxin Wei , Ziqian Zeng , Cen Chen

Algorithm selection is commonly used to predict the best solver from a portfolio per per-instance. In many real scenarios, instances arrive in a stream: new instances become available over time, while the number of class labels can also…

Machine Learning · Computer Science 2025-06-03 Mate Botond Nemeth , Emma Hart , Kevin Sim , Quentin Renau

Neural networks suffer from catastrophic forgetting in class-incremental learning (CIL) settings. Rehearsal$\unicode{x2013}$replaying a subset of past samples$\unicode{x2013}$is a well-established mitigation strategy. However, recent…

Machine Learning · Computer Science 2026-05-15 Alberto Tamajo , Srinandan Dasmahapatra , Rahman Attar

Many applications of computer vision require the ability to adapt to novel data distributions after deployment. Adaptation requires algorithms capable of continual learning (CL). Continual learners must be plastic to adapt to novel tasks…

Machine Learning · Computer Science 2025-04-24 Edison Mucllari , Aswin Raghavan , Zachary Alan Daniels

Instance-incremental learning (IIL) focuses on learning continually with data of the same classes. Compared to class-incremental learning (CIL), the IIL is seldom explored because IIL suffers less from catastrophic forgetting (CF). However,…

Machine Learning · Computer Science 2024-06-06 Qiang Nie , Weifu Fu , Yuhuan Lin , Jialin Li , Yifeng Zhou , Yong Liu , Lei Zhu , Chengjie Wang

The focus of this study is on Unsupervised Continual Learning (UCL), as it presents an alternative to Supervised Continual Learning which needs high-quality manual labeled data. The experiments under the UCL paradigm indicate a phenomenon…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Chen Cheng , Jingkuan Song , Xiaosu Zhu , Junchen Zhu , Lianli Gao , Hengtao Shen

Current research on class-incremental learning primarily focuses on single-label classification tasks. However, real-world applications often involve multi-label scenarios, such as image retrieval and medical imaging. Therefore, this paper…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Chenhao Ding , Songlin Dong , Zhengdong Zhou , Jizhou Han , Qiang Wang , Yuhang He , Yihong Gong

As Web technology continues to develop, it has become increasingly common to use data stored on different clients. At the same time, federated learning has received widespread attention due to its ability to protect data privacy when let…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Xin Luo , Fang-Yi Liang , Jiale Liu , Yu-Wei Zhan , Zhen-Duo Chen , Xin-Shun Xu

We study the new task of class-incremental Novel Class Discovery (class-iNCD), which refers to the problem of discovering novel categories in an unlabelled data set by leveraging a pre-trained model that has been trained on a labelled data…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Subhankar Roy , Mingxuan Liu , Zhun Zhong , Nicu Sebe , Elisa Ricci

Class-Incremental Learning (CIL) [40] trains classifiers under a strict memory budget: in each incremental phase, learning is done for new data, most of which is abandoned to free space for the next phase. The preserved data are exemplars…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Yaoyao Liu , Bernt Schiele , Qianru Sun

This study focuses on incremental learning for image classification, exploring how to reduce catastrophic forgetting of all learned knowledge when access to old data is restricted. The challenge lies in balancing plasticity (learning new…

Machine Learning · Computer Science 2026-03-12 Zhiping Zhou , Xuchen Xie , Yiqiao Qiu , Run Lin , Weishi Zheng , Ruixuan Wang

Class-Incremental Learning (CIL) struggles with catastrophic forgetting when learning new knowledge, and Data-Free CIL (DFCIL) is even more challenging without access to the training data of previously learned classes. Though recent DFCIL…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Qiankun Gao , Chen Zhao , Bernard Ghanem , Jian Zhang

Class incremental learning (CIL) algorithms aim to continually learn new object classes from incrementally arriving data while not forgetting past learned classes. The common evaluation protocol for CIL algorithms is to measure the average…

Machine Learning · Computer Science 2024-06-26 Sungmin Cha , Jihwan Kwak , Dongsub Shim , Hyunwoo Kim , Moontae Lee , Honglak Lee , Taesup Moon

Class-incremental learning (CIL) enables continuous learning of new classes while mitigating catastrophic forgetting of old ones. For the performance breakthrough of CIL, it is essential yet challenging to effectively refine past knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Yuanzhi Su , Siyuan Chen , Yuan-Gen Wang

Traditional Incremental Learning (IL) targets to handle sequential fully-supervised learning problems where novel classes emerge from time to time. However, due to inherent annotation uncertainty and ambiguity, collecting high-quality…

Machine Learning · Computer Science 2025-05-08 Rui Wang , Mingxuan Xia , Chang Yao , Lei Feng , Junbo Zhao , Gang Chen , Haobo Wang

Existing continual learning (CL) research regards catastrophic forgetting (CF) as almost the only challenge. This paper argues for another challenge in class-incremental learning (CIL), which we call cross-task class discrimination…

Machine Learning · Computer Science 2023-05-25 Yiduo Guo , Bing Liu , Dongyan Zhao

Due to the model aging problem, Deep Neural Networks (DNNs) need updates to adjust them to new data distributions. The common practice leverages incremental learning (IL), e.g., Class-based Incremental Learning (CIL) that updates output…

Machine Learning · Computer Science 2023-04-11 Xuanqi Gao , Juan Zhai , Shiqing Ma , Chao Shen , Yufei Chen , Shiwei Wang

Class incremental learning (CIL) requires an agent to learn distinct tasks consecutively with knowledge retention against forgetting. Problems impeding the practical applications of CIL methods are twofold: (1) non-i.i.d batch streams and…

Machine Learning · Computer Science 2025-10-27 Junda Wang , Minghui Hu , Ning Li , Abdulaziz Al-Ali , Ponnuthurai Nagaratnam Suganthan

Deep neural networks perform remarkably well in close-world scenarios. However, novel classes emerged continually in real applications, making it necessary to learn incrementally. Class-incremental learning (CIL) aims to gradually recognize…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Wenzhuo Liu , Fei Zhu , Cheng-Lin Liu