English
Related papers

Related papers: Scalable Class-Incremental Learning Based on Param…

200 papers

Class-Incremental Learning aims to update a deep classifier to learn new categories while maintaining or improving its accuracy on previously observed classes. Common methods to prevent forgetting previously learned classes include…

Machine Learning · Computer Science 2024-07-02 Elif Ceren Gok Yildirim , Murat Onur Yildirim , Mert Kilickaya , Joaquin Vanschoren

User modeling in large e-commerce platforms aims to optimize user experiences by incorporating various customer activities. Traditional models targeting a single task often focus on specific business metrics, neglecting the comprehensive…

Information Retrieval · Computer Science 2025-02-28 Mingdai Yang , Fan Yang , Yanhui Guo , Shaoyuan Xu , Tianchen Zhou , Yetian Chen , Simone Shao , Jia Liu , Yan Gao

In continual learning (CL), model growth enhances adaptability to new data. However, when model growth is applied improperly, especially in task-agnostic CL, where the entire grown model is used for inference, it can lead to severe…

Machine Learning · Computer Science 2025-12-23 Yuqing Zhao , Jiannong Cao , Divya Saxena , Xiaoyun Liu , Changlin Song , Bo Yuan , Julie McCann

We study class-incremental learning, a training setup in which new classes of data are observed over time for the model to learn from. Despite the straightforward problem formulation, the naive application of classification models to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Ahmet Iscen , Thomas Bird , Mathilde Caron , Alireza Fathi , Cordelia Schmid

We study the new task of class-incremental Novel Class Discovery (class-iNCD), which refers to the problem of discovering novel categories in an unlabelled data set by leveraging a pre-trained model that has been trained on a labelled data…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Subhankar Roy , Mingxuan Liu , Zhun Zhong , Nicu Sebe , Elisa Ricci

Contrastive Learning (CL) performances as a rising approach to address the challenge of sparse and noisy recommendation data. Although having achieved promising results, most existing CL methods only perform either hand-crafted data or…

Information Retrieval · Computer Science 2023-11-22 Xiuyuan Qin , Huanhuan Yuan , Pengpeng Zhao , Junhua Fang , Fuzhen Zhuang , Guanfeng Liu , Victor Sheng

Class-incremental learning aims to learn new classes in an incremental fashion without forgetting the previously learned ones. Several research works have shown how additional data can be used by incremental models to help mitigate…

Machine Learning · Computer Science 2023-10-11 Quentin Jodelet , Xin Liu , Yin Jun Phua , Tsuyoshi Murata

Deep neural networks are susceptible to catastrophic forgetting when trained on sequential tasks. Various continual learning (CL) methods often rely on exemplar buffers or/and network expansion for balancing model stability and plasticity,…

Machine Learning · Computer Science 2024-01-18 Depeng Li , Tianqi Wang , Junwei Chen , Qining Ren , Kenji Kawaguchi , Zhigang Zeng

Class-incremental learning (CIL) in medical image-guided diagnosis requires retaining prior diagnostic knowledge while adapting to newly emerging disease categories, which is critical for scalable clinical deployment. This problem is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Xinyao Wu , Zhe Xu , Cheng Chen , Jiawei Ma , Yefeng Zheng , Raymond Kai-yu Tong

Few-shot class-incremental learning (FSCIL), which targets at continuously expanding model's representation capacity under few supervisions, is an important yet challenging problem. On the one hand, when fitting new tasks (novel classes),…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Boyu Yang , Mingbao Lin , Binghao Liu , Mengying Fu , Chang Liu , Rongrong Ji , Qixiang Ye

The main purpose of incremental learning is to learn new knowledge while not forgetting the knowledge which have been learned before. At present, the main challenge in this area is the catastrophe forgetting, namely the network will lose…

Machine Learning · Computer Science 2019-06-13 Qiuyu Zhu , Zikuang He , Xin Ye

The goal of Continual Learning (CL) is to continuously learn from new data streams and accomplish the corresponding tasks. Previously studied CL assumes that data are given in sequence nose-to-tail for different tasks, thus indeed belonging…

Machine Learning · Computer Science 2024-01-03 Fan Lyu , Wei Feng , Yuepan Li , Qing Sun , Fanhua Shang , Liang Wan , Liang Wang

We propose a novel class incremental learning approach by incorporating a feature augmentation technique motivated by adversarial attacks. We employ a classifier learned in the past to complement training examples rather than simply play a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Taehoon Kim , Jaeyoo Park , Bohyung Han

Despite the outstanding performance in many individual tasks, deep neural networks suffer from catastrophic forgetting when learning from continuous data streams in real-world scenarios. Current Non-Exemplar Class-Incremental Learning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Liang Bai , Hong Song , Yucong Lin , Tianyu Fu , Deqiang Xiao , Danni Ai , Jingfan Fan , Jian Yang

Class-incremental learning (CIL) has achieved remarkable successes in learning new classes consecutively while overcoming catastrophic forgetting on old categories. However, most existing CIL methods unreasonably assume that all old…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Jiahua Dong , Wenqi Liang , Yang Cong , Gan Sun

Although deep neural networks perform extremely well in controlled environments, they fail in real-world scenarios where data isn't available all at once, and the model must adapt to a new data distribution that may or may not follow the…

Machine Learning · Computer Science 2026-03-17 Vaishnavi Nagabhushana , Kartikay Agrawal , Ayon Borthakur

Continual learning (CL) aims to train models that can learn a sequence of tasks without forgetting previously acquired knowledge. A core challenge in CL is balancing stability -- preserving performance on old tasks -- and plasticity --…

Machine Learning · Computer Science 2025-05-14 Zhenrong Liu , Janne M. J. Huttunen , Mikko Honkala

Deep neural networks suffer from catastrophic forgetting when continually learning new concepts. In this paper, we analyze this problem from a data imbalance point of view. We argue that the imbalance between old task and new task data…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Leyuan Wang , Liuyu Xiang , Yunlong Wang , Huijia Wu , Zhaofeng He

Online continual learning suffers from an underfitted solution due to insufficient training for prompt model update (e.g., single-epoch training). To address the challenge, we propose an efficient online continual learning method using the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Minhyuk Seo , Hyunseo Koh , Wonje Jeung , Minjae Lee , San Kim , Hankook Lee , Sungjun Cho , Sungik Choi , Hyunwoo Kim , Jonghyun Choi

Non-exemplar class-incremental learning is to recognize both the old and new classes when old class samples cannot be saved. It is a challenging task since representation optimization and feature retention can only be achieved under…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Kai Zhu , Wei Zhai , Yang Cao , Jiebo Luo , Zheng-Jun Zha