English
Related papers

Related papers: Class Incremental Learning with Task-Specific Batc…

200 papers

Due to the model aging problem, Deep Neural Networks (DNNs) need updates to adjust them to new data distributions. The common practice leverages incremental learning (IL), e.g., Class-based Incremental Learning (CIL) that updates output…

Machine Learning · Computer Science 2023-04-11 Xuanqi Gao , Juan Zhai , Shiqing Ma , Chao Shen , Yufei Chen , Shiwei Wang

Extensive researches have applied deep neural networks (DNNs) in class incremental learning (Class-IL). As building blocks of DNNs, batch normalization (BN) standardizes intermediate feature maps and has been widely validated to improve…

Machine Learning · Computer Science 2022-02-17 Minghao Zhou , Quanziang Wang , Jun Shu , Qian Zhao , Deyu Meng

With the widespread adoption of deep learning in visual tasks, Class-Incremental Learning (CIL) has become an important paradigm for handling dynamically evolving data distributions. However, CIL faces the core challenge of catastrophic…

Machine Learning · Computer Science 2026-03-04 Jinge Ma , Fengqing Zhu

Incremental Task learning (ITL) is a category of continual learning that seeks to train a single network for multiple tasks (one after another), where training data for each task is only available during the training of that task. Neural…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Rakib Hyder , Ken Shao , Boyu Hou , Panos Markopoulos , Ashley Prater-Bennette , M. Salman Asif

Invariance learning methods aim to learn invariant features in the hope that they generalize under distributional shifts. Although many tasks are naturally characterized by continuous domains, current invariance learning techniques…

Machine Learning · Computer Science 2024-04-24 Yong Lin , Fan Zhou , Lu Tan , Lintao Ma , Jiameng Liu , Yansu He , Yuan Yuan , Yu Liu , James Zhang , Yujiu Yang , Hao Wang

With the memory-resource-limited constraints, class-incremental learning (CIL) usually suffers from the "catastrophic forgetting" problem when updating the joint classification model on the arrival of newly added classes. To cope with the…

Machine Learning · Computer Science 2021-05-19 Hanbin Zhao , Hui Wang , Yongjian Fu , Fei Wu , Xi Li

Class-Incremental Learning (CIL) trains a model to continually recognize new classes from non-stationary data while retaining learned knowledge. A major challenge of CIL arises when applying to real-world data characterized by non-uniform…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jiangpeng He , Fengqing Zhu

The rehearsal strategy is widely used to alleviate the catastrophic forgetting problem in class incremental learning (CIL) by preserving limited exemplars from previous tasks. With imbalanced sample numbers between old and new classes, the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Xiuwei Chen , Xiaobin Chang

Most modern neural networks for classification fail to take into account the concept of the unknown. Trained neural networks are usually tested in an unrealistic scenario with only examples from a closed set of known classes. In an attempt…

Machine Learning · Computer Science 2022-12-27 Justin Leo , Jugal Kalita

Class-incremental learning (CIL) aims to develop a learning system that can continually learn new classes from a data stream without forgetting previously learned classes. When learning classes incrementally, the classifier must be…

Computation and Language · Computer Science 2023-05-29 Minqian Liu , Lifu Huang

Existing Class Incremental Learning (CIL) methods are based on a supervised classification framework sensitive to data labels. When updating them based on the new class data, they suffer from catastrophic forgetting: the model cannot…

Machine Learning · Computer Science 2021-11-23 Zixuan Ni , Siliang Tang , Yueting Zhuang

Class-Incremental Learning (CIL) aims to continuously acquire new categories while preserving previously learned knowledge. Recently, Contrastive Language-Image Pre-trained (CLIP) models have shown strong potential for CIL due to their…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Tianqi Wang , Jingcai Guo

Continual learning (or class incremental learning) is a realistic learning scenario for computer vision systems, where deep neural networks are trained on episodic data, and the data from previous episodes are generally inaccessible to the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Aditya R. Bhattacharya , Debanjan Goswami , Shayok Chakraborty

Current research on class-incremental learning primarily focuses on single-label classification tasks. However, real-world applications often involve multi-label scenarios, such as image retrieval and medical imaging. Therefore, this paper…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Chenhao Ding , Songlin Dong , Zhengdong Zhou , Jizhou Han , Qiang Wang , Yuhang He , Yihong Gong

Class-Incremental learning (CIL) refers to the ability of artificial agents to integrate new classes as they appear in a stream. It is particularly interesting in evolving environments where agents have limited access to memory and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Eden Belouadah , Arnaud Dapogny , Kevin Bailly

We observe a high level of imbalance in the accuracy of different classes in the same old task for the first time. This intriguing phenomenon, discovered in replay-based Class Incremental Learning (CIL), highlights the imbalanced forgetting…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Shixiong Xu , Gaofeng Meng , Xing Nie , Bolin Ni , Bin Fan , Shiming Xiang

Real-world environments are inherently non-stationary, frequently introducing new classes over time. This is especially common in time series classification, such as the emergence of new disease classification in healthcare or the addition…

Machine Learning · Computer Science 2024-08-06 Zhongzheng Qiao , Quang Pham , Zhen Cao , Hoang H Le , P. N. Suganthan , Xudong Jiang , Ramasamy Savitha

Image-point class incremental learning helps the 3D-points-vision robots continually learn category knowledge from 2D images, improving their perceptual capability in dynamic environments. However, some incremental learning methods address…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Chao Qi , Jianqin Yin , Ren Zhang

Class incremental learning (CIL) aims to enable models to continuously learn new classes without catastrophically forgetting old ones. A promising direction is to learn and use prototypes of classes during incremental updates. Despite…

Machine Learning · Computer Science 2025-03-25 Huitong Chen , Yu Wang , Yan Fan , Guosong Jiang , Qinghua Hu

Continual learning (CL) learns a sequence of tasks incrementally. This paper studies the challenging CL setting of class-incremental learning (CIL). CIL has two key challenges: catastrophic forgetting (CF) and inter-task class separation…

Machine Learning · Computer Science 2024-12-23 Saleh Momeni , Sahisnu Mazumder , Bing Liu