English
Related papers

Related papers: Causally Sufficient and Necessary Feature Expansio…

200 papers

This paper presents a practical and simple yet efficient method to effectively deal with the catastrophic forgetting for Class Incremental Learning (CIL) tasks. CIL tends to learn new concepts perfectly, but not at the expense of…

Machine Learning · Computer Science 2021-03-30 Bahram Mohammadi , Mohammad Sabokrou

Existing Class Incremental Learning (CIL) methods are based on a supervised classification framework sensitive to data labels. When updating them based on the new class data, they suffer from catastrophic forgetting: the model cannot…

Machine Learning · Computer Science 2021-11-23 Zixuan Ni , Siliang Tang , Yueting Zhuang

Class-incremental Learning (CIL) enables the model to incrementally absorb knowledge from new classes and build a generic classifier across all previously encountered classes. When the model optimizes with new classes, the knowledge of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Juncen Guo , Xiaoguang Zhu , Liangyu Teng , Hao Yang , Jing Liu , Yang Liu , Liang Song

Current Reinforcement Learning (RL) methods often suffer from sample-inefficiency, resulting from blind exploration strategies that neglect causal relationships among states, actions, and rewards. Although recent causal approaches aim to…

Artificial Intelligence · Computer Science 2025-02-17 Hongye Cao , Fan Feng , Tianpei Yang , Jing Huo , Yang Gao

We consider class incremental learning (CIL) problem, in which a learning agent continuously learns new classes from incrementally arriving training data batches and aims to predict well on all the classes learned so far. The main challenge…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Hongjoon Ahn , Jihwan Kwak , Subin Lim , Hyeonsu Bang , Hyojun Kim , Taesup Moon

The dynamic nature of open-world scenarios has attracted more attention to class incremental learning (CIL). However, existing CIL methods typically presume the availability of complete ground-truth labels throughout the training process,…

Machine Learning · Computer Science 2024-08-20 Jiaming Liu , Hongyuan Liu , Zhili Qin , Wei Han , Yulu Fan , Qinli Yang , Junming Shao

Class incremental learning (CIL) is a challenging setting of continual learning, which learns a series of tasks sequentially. Each task consists of a set of unique classes. The key feature of CIL is that no task identifier (or task-id) is…

Machine Learning · Computer Science 2024-03-14 Haowei Lin , Yijia Shao , Weinan Qian , Ningxin Pan , Yiduo Guo , Bing Liu

Class-incremental learning (CIL) seeks to enable a model to sequentially learn new classes while retaining knowledge of previously learned ones. Balancing flexibility and stability remains a significant challenge, particularly when the task…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Fangwen Wu , Lechao Cheng , Shengeng Tang , Xiaofeng Zhu , Chaowei Fang , Dingwen Zhang , Meng Wang

This paper studies the problem of class-incremental learning (CIL), a core setting within continual learning where a model learns a sequence of tasks, each containing a distinct set of classes. Traditional CIL methods, which do not leverage…

Machine Learning · Computer Science 2025-11-19 Saleh Momeni , Changnan Xiao , Bing Liu

In text classification tasks, models often rely on spurious correlations for predictions, incorrectly associating irrelevant features with the target labels. This issue limits the robustness and generalization of models, especially when…

Machine Learning · Computer Science 2025-02-04 Yuqing Zhou , Ziwei Zhu

How to enable learnability for new classes while keeping the capability well on old classes has been a crucial challenge for class incremental learning. Beyond the normal case, long-tail class incremental learning and few-shot class…

Machine Learning · Computer Science 2023-08-04 Yibo Yang , Haobo Yuan , Xiangtai Li , Jianlong Wu , Lefei Zhang , Zhouchen Lin , Philip Torr , Dacheng Tao , Bernard Ghanem

This paper proposes a simple but highly efficient expansion-based model for continual learning. The recent feature transformation, masking and factorization-based methods are efficient, but they grow the model only over the global or shared…

Machine Learning · Computer Science 2023-12-05 Soumya Roy , Vinay K Verma , Deepak Gupta

Algorithm selection is commonly used to predict the best solver from a portfolio per per-instance. In many real scenarios, instances arrive in a stream: new instances become available over time, while the number of class labels can also…

Machine Learning · Computer Science 2025-06-03 Mate Botond Nemeth , Emma Hart , Kevin Sim , Quentin Renau

Probability of necessity and sufficiency (PNS) measures the likelihood of a feature set being both necessary and sufficient for predicting an outcome. It has proven effective in guiding representation learning for unimodal data, enhancing…

Machine Learning · Computer Science 2024-11-28 Boyu Chen , Junjie Liu , Zhu Li , Mengyue Yang

Task-incremental continual learning refers to continually training a model in a sequence of tasks while overcoming the problem of catastrophic forgetting (CF). The issue arrives for the reason that the learned representations are forgotten…

Machine Learning · Computer Science 2023-05-23 Yun Luo , Xiaotian Lin , Zhen Yang , Fandong Meng , Jie Zhou , Yue Zhang

$\textit{Implicit neural representations}$ (INRs) aim to learn a $\textit{continuous function}$ (i.e., a neural network) to represent an image, where the input and output of the function are pixel coordinates and RGB/Gray values,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Ke Liu , Feng Liu , Haishuai Wang , Ning Ma , Jiajun Bu , Bo Han

Class-Incremental Learning (CIL) aims to build classification models from data streams. At each step of the CIL process, new classes must be integrated into the model. Due to catastrophic forgetting, CIL is particularly challenging when…

Machine Learning · Computer Science 2023-09-28 Grégoire Petit , Michael Soumm , Eva Feillet , Adrian Popescu , Bertrand Delezoide , David Picard , Céline Hudelot

Few-shot class-incremental learning (FSCIL) aims to incrementally learn models from a small amount of novel data, which requires strong representation and adaptation ability of models learned under few-example supervision to avoid…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Kexin Bao , Yong Li , Dan Zeng , Shiming Ge

With the widespread adoption of deep learning in visual tasks, Class-Incremental Learning (CIL) has become an important paradigm for handling dynamically evolving data distributions. However, CIL faces the core challenge of catastrophic…

Machine Learning · Computer Science 2026-03-04 Jinge Ma , Fengqing Zhu

Aiming to incrementally learn new classes with only few samples while preserving the knowledge of base (old) classes, few-shot class-incremental learning (FSCIL) faces several challenges, such as overfitting and catastrophic forgetting.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Junghun Oh , Sungyong Baik , Kyoung Mu Lee