English
Related papers

Related papers: Heterogeneous Forgetting Compensation for Class-In…

200 papers

Federated Class Incremental Learning (FCIL) aims to collaboratively process continuously increasing incoming tasks across multiple clients. Among various approaches, data replay has become a promising solution, which can alleviate…

Machine Learning · Computer Science 2025-12-15 Zhuang Qi , Ying-Peng Tang , Lei Meng , Han Yu , Xiaoxiao Li , Xiangxu Meng

Incremental learning often encounter challenges such as overfitting to new data and catastrophic forgetting of old data. Existing methods can effectively extend the model for new tasks while freezing the parameters of the old model, but…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Chuangxin Zhang , Guangfeng Lin , Enhui Zhao , Kaiyang Liao , Yajun Chen

Incremental learning attempts to develop a classifier which learns continuously from a stream of data segregated into different classes. Deep learning approaches suffer from catastrophic forgetting when learning classes incrementally, while…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Ali Ayub , Alan Wagner

Continual learning (CL) is a fundamental topic in machine learning, where the goal is to train a model with continuously incoming data and tasks. Due to the memory limit, we cannot store all the historical data, and therefore confront the…

Machine Learning · Computer Science 2024-07-31 Weichen Lin , Jiaxiang Chen , Ruomin Huang , Hu Ding

In class-incremental learning (CIL) scenarios, the phenomenon of catastrophic forgetting caused by the classifier's bias towards the current task has long posed a significant challenge. It is mainly caused by the characteristic of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Xusheng Cao , Haori Lu , Linlan Huang , Xialei Liu , Ming-Ming Cheng

Low-Earth-orbit (LEO) satellite constellations are increasingly performing on-board computing. However, the continuous emergence of new classes under strict memory and communication constraints poses major challenges for collaborative…

Networking and Internet Architecture · Computer Science 2026-04-06 Heng Zhang , Xiaohong Deng , Sijing Duan , Wu Ouyang , KM Mahfujul , Yiqin Deng , Zhigang Chen

Current research on class-incremental learning primarily focuses on single-label classification tasks. However, real-world applications often involve multi-label scenarios, such as image retrieval and medical imaging. Therefore, this paper…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Chenhao Ding , Songlin Dong , Zhengdong Zhou , Jizhou Han , Qiang Wang , Yuhang He , Yihong Gong

Federated learning-based semantic segmentation (FSS) has drawn widespread attention via decentralized training on local clients. However, most FSS models assume categories are fixed in advance, thus heavily undergoing forgetting on old…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Jiahua Dong , Duzhen Zhang , Yang Cong , Wei Cong , Henghui Ding , Dengxin Dai

Class incremental learning (CIL) aims to incrementally update a trained model with the new classes of samples (plasticity) while retaining previously learned ability (stability). To address the most challenging issue in this goal, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Yuhang Zhou , Jiangchao Yao , Feng Hong , Ya Zhang , Yanfeng Wang

We consider class incremental learning (CIL) problem, in which a learning agent continuously learns new classes from incrementally arriving training data batches and aims to predict well on all the classes learned so far. The main challenge…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Hongjoon Ahn , Jihwan Kwak , Subin Lim , Hyeonsu Bang , Hyojun Kim , Taesup Moon

Deep neural networks (DNNs) often suffer from "catastrophic forgetting" during incremental learning (IL) --- an abrupt degradation of performance on the original set of classes when the training objective is adapted to a newly added set of…

Computer Vision and Pattern Recognition · Computer Science 2020-01-17 Junting Zhang , Jie Zhang , Shalini Ghosh , Dawei Li , Serafettin Tasci , Larry Heck , Heming Zhang , C. -C. Jay Kuo

Video instance segmentation (VIS) has gained significant attention for its capability in tracking and segmenting object instances across video frames. However, most of the existing VIS approaches unrealistically assume that the categories…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Jiahua Dong , Hui Yin , Wenqi Liang , Hanbin Zhao , Henghui Ding , Nicu Sebe , Salman Khan , Fahad Shahbaz Khan

Continual learning (CL) learns a sequence of tasks incrementally. This paper studies the challenging CL setting of class-incremental learning (CIL). CIL has two key challenges: catastrophic forgetting (CF) and inter-task class separation…

Machine Learning · Computer Science 2024-12-23 Saleh Momeni , Sahisnu Mazumder , Bing Liu

Exemplar-free class-incremental learning using a backbone trained from scratch and starting from a small first task presents a significant challenge for continual representation learning. Prototype-based approaches, when continually…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Alex Gomez-Villa , Dipam Goswami , Kai Wang , Andrew D. Bagdanov , Bartlomiej Twardowski , Joost van de Weijer

Continual learning (CL) remains a significant challenge for deep neural networks, as it is prone to forgetting previously acquired knowledge. Several approaches have been proposed in the literature, such as experience rehearsal,…

Machine Learning · Computer Science 2024-05-24 Prashant Bhat , Bharath Renjith , Elahe Arani , Bahram Zonooz

Exemplar-based class-incremental learning is to recognize new classes while not forgetting old ones, whose samples can only be saved in limited memory. The ratio fluctuation of new samples to old exemplars, which is caused by the variation…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Zhiheng Liu , Kai Zhu , Yang Cao

Catastrophic forgetting is one of the most critical challenges in Continual Learning (CL). Recent approaches tackle this problem by projecting the gradient update orthogonal to the gradient subspace of existing tasks. While the results are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Cheng Chen , Ji Zhang , Jingkuan Song , Lianli Gao

Class Incremental Learning (CIL) aims to handle the scenario where data of novel classes occur continuously and sequentially. The model should recognize the sequential novel classes while alleviating the catastrophic forgetting. In the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Xiaoshuang Chen , Zhongyi Sun , Ke Yan , Shouhong Ding , Hongtao Lu

Recent years have witnessed a burgeoning interest in federated learning (FL). However, the contexts in which clients engage in sequential learning remain under-explored. Bridging FL and continual learning (CL) gives rise to a challenging…

Machine Learning · Computer Science 2025-02-21 Abudukelimu Wuerkaixi , Sen Cui , Jingfeng Zhang , Kunda Yan , Bo Han , Gang Niu , Lei Fang , Changshui Zhang , Masashi Sugiyama

Class incremental learning (CIL) trains a network on sequential tasks with separated categories in each task but suffers from catastrophic forgetting, where models quickly lose previously learned knowledge when acquiring new tasks. The…

Machine Learning · Computer Science 2024-11-05 Huiping Zhuang , Yizhu Chen , Di Fang , Run He , Kai Tong , Hongxin Wei , Ziqian Zeng , Cen Chen