English
Related papers

Related papers: EKPC: Elastic Knowledge Preservation and Compensat…

200 papers

Class-incremental learning (CIL) aims to develop a learning system that can continually learn new classes from a data stream without forgetting previously learned classes. When learning classes incrementally, the classifier must be…

Computation and Language · Computer Science 2023-05-29 Minqian Liu , Lifu Huang

Rehearsal approaches in class incremental learning (CIL) suffer from decision boundary overfitting to new classes, which is mainly caused by two factors: insufficiency of old classes data for knowledge distillation and imbalanced data…

Machine Learning · Computer Science 2024-09-27 Kunchi Li , Jun Wan , Shan Yu

Continual learning (CL) enables deep networks to acquire new knowledge while avoiding catastrophic forgetting. The powerful generalization ability of pre-trained models (PTMs), such as the Contrastive Language-Image Pre-training (CLIP)…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Haodong Lu , Xinyu Zhang , Kristen Moore , Jason Xue , Lina Yao , Anton van den Hengel , Dong Gong

Class-Incremental Learning aims to update a deep classifier to learn new categories while maintaining or improving its accuracy on previously observed classes. Common methods to prevent forgetting previously learned classes include…

Machine Learning · Computer Science 2024-07-02 Elif Ceren Gok Yildirim , Murat Onur Yildirim , Mert Kilickaya , Joaquin Vanschoren

Class-Incremental Learning (CIL) is a critical capability for real-world applications, enabling learning systems to adapt to new tasks while retaining knowledge from previous ones. Recent advancements in pre-trained models (PTMs) have…

Machine Learning · Computer Science 2025-04-28 Kun He , Zijian Song , Shuoxi Zhang , John E. Hopcroft

Exemplar-Free Class Incremental Learning (efCIL) aims to continuously incorporate the knowledge from new classes while retaining previously learned information, without storing any old-class exemplars (i.e., samples). For this purpose,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Libo Huang , Zhulin An , Yan Zeng , Chuanguang Yang , Xinqiang Yu , Yongjun Xu

The ability to learn in dynamic, nonstationary environments without forgetting previous knowledge, also known as Continual Learning (CL), is a key enabler for scalable and trustworthy deployments of adaptive solutions. While the importance…

Machine Learning · Computer Science 2021-03-25 Andrea Cossu , Antonio Carta , Davide Bacciu

Incremental Learning (IL) aims to accumulate knowledge from sequential input tasks while overcoming catastrophic forgetting. Existing IL methods typically assume that an incoming task has only increments of classes or domains, referred to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Min-Yeong Park , Jae-Ho Lee , Gyeong-Moon Park

Class-Incremental Learning (CIL) aims to solve the neural networks' catastrophic forgetting problem, which refers to the fact that once the network updates on a new task, its performance on previously-learned tasks drops dramatically. Most…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Libo Huang , Yan Zeng , Chuanguang Yang , Zhulin An , Boyu Diao , Yongjun Xu

Class-incremental learning is a challenging problem, where the goal is to train a model that can classify data from an increasing number of classes over time. With the advancement of vision-language pre-trained models such as CLIP, they…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Linlan Huang , Xusheng Cao , Haori Lu , Xialei Liu

Real-world applications require the classification model to adapt to new classes without forgetting old ones. Correspondingly, Class-Incremental Learning (CIL) aims to train a model with limited memory size to meet this requirement. Typical…

Machine Learning · Computer Science 2023-02-17 Da-Wei Zhou , Qi-Wei Wang , Han-Jia Ye , De-Chuan Zhan

Deep neural networks perform remarkably well in close-world scenarios. However, novel classes emerged continually in real applications, making it necessary to learn incrementally. Class-incremental learning (CIL) aims to gradually recognize…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Wenzhuo Liu , Fei Zhu , Cheng-Lin Liu

Continual learning (CL) is a paradigm that aims to replicate the human ability to learn and accumulate knowledge continually without forgetting previous knowledge and transferring it to new tasks. Recent instruction tuning (IT) involves…

Computation and Language · Computer Science 2023-10-24 Zihan Zhang , Meng Fang , Ling Chen , Mohammad-Reza Namazi-Rad

This study focuses on incremental learning for image classification, exploring how to reduce catastrophic forgetting of all learned knowledge when access to old data is restricted. The challenge lies in balancing plasticity (learning new…

Machine Learning · Computer Science 2026-03-12 Zhiping Zhou , Xuchen Xie , Yiqiao Qiu , Run Lin , Weishi Zheng , Ruixuan Wang

The emergence of large pre-trained networks has revolutionized the AI field, unlocking new possibilities and achieving unprecedented performance. However, these models inherit a fundamental limitation from traditional Machine Learning…

Class-Incremental Learning (CIL) aims to build classification models from data streams. At each step of the CIL process, new classes must be integrated into the model. Due to catastrophic forgetting, CIL is particularly challenging when…

Machine Learning · Computer Science 2023-09-28 Grégoire Petit , Michael Soumm , Eva Feillet , Adrian Popescu , Bertrand Delezoide , David Picard , Céline Hudelot

Class-Incremental Learning (CIL) trains a model to continually recognize new classes from non-stationary data while retaining learned knowledge. A major challenge of CIL arises when applying to real-world data characterized by non-uniform…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jiangpeng He , Fengqing Zhu

This paper studies the problem of class-incremental learning (CIL), a core setting within continual learning where a model learns a sequence of tasks, each containing a distinct set of classes. Traditional CIL methods, which do not leverage…

Machine Learning · Computer Science 2025-11-19 Saleh Momeni , Changnan Xiao , Bing Liu

Continual learning (CL) studies how models acquire tasks sequentially while retaining previously learned knowledge. Despite substantial progress in benchmarking CL methods, comparative evaluations typically keep the fine-tuning regime…

Machine Learning · Computer Science 2026-04-28 Paul-Tiberiu Iordache , Elena Burceanu

Class-incremental learning of deep networks sequentially increases the number of classes to be classified. During training, the network has only access to data of one task at a time, where each task contains several classes. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Lu Yu , Bartłomiej Twardowski , Xialei Liu , Luis Herranz , Kai Wang , Yongmei Cheng , Shangling Jui , Joost van de Weijer