English
Related papers

Related papers: Gradient Reweighting: Towards Imbalanced Class-Inc…

200 papers

Class Incremental Learning (CIL) is challenging due to catastrophic forgetting. On top of that, Exemplar-free Class Incremental Learning is even more challenging due to forbidden access to previous task data. Recent exemplar-free CIL…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zichong Meng , Jie Zhang , Changdi Yang , Zheng Zhan , Pu Zhao , Yanzhi Wang

Batch Normalization (BN) and its variants has been extensively studied for neural nets in various computer vision tasks, but relatively little work has been dedicated to studying the effect of BN in continual learning. To that end, we…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Sungmin Cha , Sungjun Cho , Dasol Hwang , Sunwon Hong , Moontae Lee , Taesup Moon

Class-Incremental Learning (CIL) aims to solve the neural networks' catastrophic forgetting problem, which refers to the fact that once the network updates on a new task, its performance on previously-learned tasks drops dramatically. Most…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Libo Huang , Yan Zeng , Chuanguang Yang , Zhulin An , Boyu Diao , Yongjun Xu

Incremental learning is useful if an AI agent needs to integrate data from a stream. The problem is non trivial if the agent runs on a limited computational budget and has a bounded memory of past data. In a deep learning approach, the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-17 Eden Belouadah , Adrian Popescu

Algorithm selection is commonly used to predict the best solver from a portfolio per per-instance. In many real scenarios, instances arrive in a stream: new instances become available over time, while the number of class labels can also…

Machine Learning · Computer Science 2025-06-03 Mate Botond Nemeth , Emma Hart , Kevin Sim , Quentin Renau

Class-Incremental Learning (CIL) aims to sequentially learn new classes while mitigating catastrophic forgetting of previously learned knowledge. Conventional CIL approaches implicitly assume that classes are morphologically static,…

Machine Learning · Computer Science 2026-02-03 Zheng Zhang , Tao Hu , Xueheng Li , Yang Wang , Rui Li , Jie Zhang , Chengjun Xie

Class-incremental learning (CIL) aims to acquire new classes over time while retaining prior knowledge, yet most setups and methods assume balanced task streams. In practice, the number of classes per task often varies significantly. We…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Xiaoyan Zhang , Jiangpeng He

Class-incremental learning (CIL) has been widely studied under the setting of starting from a small number of classes (base classes). Instead, we explore an understudied real-world setting of CIL that starts with a strong model pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Tz-Ying Wu , Gurumurthy Swaminathan , Zhizhong Li , Avinash Ravichandran , Nuno Vasconcelos , Rahul Bhotika , Stefano Soatto

Class-Incremental Learning (CIL) aims to build classification models from data streams. At each step of the CIL process, new classes must be integrated into the model. Due to catastrophic forgetting, CIL is particularly challenging when…

Machine Learning · Computer Science 2023-09-28 Grégoire Petit , Michael Soumm , Eva Feillet , Adrian Popescu , Bertrand Delezoide , David Picard , Céline Hudelot

Class incremental learning (CIL) algorithms aim to continually learn new object classes from incrementally arriving data while not forgetting past learned classes. The common evaluation protocol for CIL algorithms is to measure the average…

Machine Learning · Computer Science 2024-06-26 Sungmin Cha , Jihwan Kwak , Dongsub Shim , Hyunwoo Kim , Moontae Lee , Honglak Lee , Taesup Moon

Class-Incremental Learning (CIL) is a practical and challenging problem for achieving general artificial intelligence. Recently, Pre-Trained Models (PTMs) have led to breakthroughs in both visual and natural language processing tasks.…

Machine Learning · Computer Science 2024-02-16 Junhao Zheng , Ruiyan Wang , Chongzhi Zhang , Huawen Feng , Qianli Ma

Class incremental learning (CIL) aims to incrementally update a trained model with the new classes of samples (plasticity) while retaining previously learned ability (stability). To address the most challenging issue in this goal, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Yuhang Zhou , Jiangchao Yao , Feng Hong , Ya Zhang , Yanfeng Wang

In today's connected world, the generation of massive streaming data across diverse domains has become commonplace. In the presence of concept drift, class imbalance, label scarcity, and new class emergence, they jointly degrade…

Machine Learning · Computer Science 2026-02-11 Jin Li , Kleanthis Malialis , Marios Polycarpou

Class-incremental learning (CIL) is typically evaluated under predefined schedules with equal-sized tasks, leaving more realistic and complex cases unexplored. However, a practical CIL system should learns immediately when any number of new…

Machine Learning · Computer Science 2026-04-06 Zhiming Xu , Baile Xu , Jian Zhao , Furao Shen , Suorong Yang

In the scenario of class-incremental learning (CIL), deep neural networks have to adapt their model parameters to non-stationary data distributions, e.g., the emergence of new classes over time. However, CIL models are challenged by the…

Machine Learning · Computer Science 2023-06-22 Depeng Li , Zhigang Zeng

Class-incremental learning (CIL) has emerged as a means to learn new classes incrementally without catastrophic forgetting of previous classes. Recently, CIL has undergone a paradigm shift towards dynamic architectures due to their superior…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Sunyuan Qiang , Yanyan Liang , Jun Wan , Du Zhang

The dynamic expansion architecture is becoming popular in class incremental learning, mainly due to its advantages in alleviating catastrophic forgetting. However, task confusion is not well assessed within this framework, e.g., the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Bingchen Huang , Zhineng Chen , Peng Zhou , Jiayin Chen , Zuxuan Wu

Incremental Learning (IL) is useful when artificial systems need to deal with streams of data and do not have access to all data at all times. The most challenging setting requires a constant complexity of the deep model and an incremental…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Eden Belouadah , Adrian Popescu , Ioannis Kanellos

Class-incremental learning (CIL) aims to recognize new classes incrementally while maintaining the discriminability of old classes. Most existing CIL methods are exemplar-based, i.e., storing a part of old data for retraining. Without…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Fei Zhu , Xu-Yao Zhang , Zhen Cheng , Cheng-Lin Liu

Deep learning approaches are successful in a wide range of AI problems and in particular for visual recognition tasks. However, there are still open problems among which is the capacity to handle streams of visual information and the…

Machine Learning · Computer Science 2022-02-02 Umang Aggarwal , Adrian Popescu , Eden Belouadah , Céline Hudelot