English
Related papers

Related papers: Class Incremental Learning with Task-Specific Batc…

200 papers

Supervised causal learning has shown promise in causal discovery, yet it often struggles with generalization across diverse interventional settings, particularly when intervention targets are unknown. To address this, we propose TICL…

Machine Learning · Computer Science 2026-02-24 Wei Chen , Rui Ding , Bojun Huang , Yang Zhang , Qiang Fu , Yuxuan Liang , Han Shi , Dongmei Zhang

Class-incremental learning (CIL) suffers from the notorious dilemma between learning newly added classes and preserving previously learned class knowledge. That catastrophic forgetting issue could be mitigated by storing historical data for…

Machine Learning · Computer Science 2022-06-20 Tianlong Chen , Sijia Liu , Shiyu Chang , Lisa Amini , Zhangyang Wang

Deep networks have shown remarkable results in the task of object detection. However, their performance suffers critical drops when they are subsequently trained on novel classes without any sample from the base classes originally used to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Na Dong , Yongqiang Zhang , Mingli Ding , Gim Hee Lee

Continual learning (CL) with Vision-Language Models (VLMs) has overcome the constraints of traditional CL, which only focuses on previously encountered classes. During the CL of VLMs, we need not only to prevent the catastrophic forgetting…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Yicheng Xu , Yuxin Chen , Jiahao Nie , Yusong Wang , Huiping Zhuang , Manabu Okumura

Few-Shot Class-Incremental Learning has shown remarkable efficacy in efficient learning new concepts with limited annotations. Nevertheless, the heuristic few-shot annotations may not always cover the most informative samples, which largely…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Zitong Huang , Ze Chen , Yuanze Li , Bowen Dong , Erjin Zhou , Yong Liu , Rick Siow Mong Goh , Chun-Mei Feng , Wangmeng Zuo

Existing continual learning (CL) research regards catastrophic forgetting (CF) as almost the only challenge. This paper argues for another challenge in class-incremental learning (CIL), which we call cross-task class discrimination…

Machine Learning · Computer Science 2023-05-25 Yiduo Guo , Bing Liu , Dongyan Zhao

Continual learning (CL) aims to train models that can learn a sequence of tasks without forgetting previously acquired knowledge. A core challenge in CL is balancing stability -- preserving performance on old tasks -- and plasticity --…

Machine Learning · Computer Science 2025-05-14 Zhenrong Liu , Janne M. J. Huttunen , Mikko Honkala

Continual learning aims to acquire new knowledge while retaining past information. Class-incremental learning (CIL) presents a challenging scenario where classes are introduced sequentially. For video data, the task becomes more complex…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Tieyuan Chen , Huabin Liu , Chern Hong Lim , John See , Xing Gao , Junhui Hou , Weiyao Lin

Lifelong or continual learning remains to be a challenge for artificial neural network, as it is required to be both stable for preservation of old knowledge and plastic for acquisition of new knowledge. It is common to see previous…

Machine Learning · Computer Science 2020-10-08 Song Zhang , Gehui Shen , Jinsong Huang , Zhi-Hong Deng

Class-incremental learning (CIL) learns a classification model with training data of different classes arising progressively. Existing CIL either suffers from serious accuracy loss due to catastrophic forgetting, or invades data privacy by…

Machine Learning · Computer Science 2022-12-13 Huiping Zhuang , Zhenyu Weng , Hongxin Wei , Renchunzi Xie , Kar-Ann Toh , Zhiping Lin

Traditional machine learning systems are deployed under the closed-world setting, which requires the entire training data before the offline training process. However, real-world applications often face the incoming new classes, and a model…

Machine Learning · Computer Science 2022-10-27 Da-Wei Zhou , Fu-Yun Wang , Han-Jia Ye , De-Chuan Zhan

Task Incremental Learning (TIL) is a specialized form of Continual Learning (CL) in which a model incrementally learns from non-stationary data streams. Existing TIL methodologies operate under the closed-world assumption, presuming that…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Yuhang Liu , Wenjie Zhao , Yunhui Guo

Class-incremental learning (CIL) enables models to learn new classes progressively while preserving knowledge of previously learned ones. Recent advances in this field have shifted towards parameter-efficient fine-tuning techniques, with…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Haoran Chen , Ping Wang , Zihan Zhou , Xu Zhang , Zuxuan Wu , Yu-Gang Jiang

Although well-trained deep neural networks have shown remarkable performance on numerous tasks, they rapidly forget what they have learned as soon as they begin to learn with additional data with the previous data stop being provided. In…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Byungju Kim , Jaeyoung Lee , Kyungsu Kim , Sungjin Kim , Junmo Kim

Although deep learning approaches have stood out in recent years due to their state-of-the-art results, they continue to suffer from catastrophic forgetting, a dramatic decrease in overall performance when training with new classes added…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Francisco M. Castro , Manuel J. Marín-Jiménez , Nicolás Guil , Cordelia Schmid , Karteek Alahari

Learning new tasks continuously without forgetting on a constantly changing data distribution is essential for real-world problems but extremely challenging for modern deep learning. In this work we propose HCL, a Hybrid…

Class-incremental learning (CIL) enables continuous learning of new classes while mitigating catastrophic forgetting of old ones. For the performance breakthrough of CIL, it is essential yet challenging to effectively refine past knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Yuanzhi Su , Siyuan Chen , Yuan-Gen Wang

This paper introduces a two-stage framework designed to enhance long-tail class incremental learning, enabling the model to progressively learn new classes, while mitigating catastrophic forgetting in the context of long-tailed data…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Jayateja Kalla , Soma Biswas

Real-world applications require the classification model to adapt to new classes without forgetting old ones. Correspondingly, Class-Incremental Learning (CIL) aims to train a model with limited memory size to meet this requirement. Typical…

Machine Learning · Computer Science 2023-02-17 Da-Wei Zhou , Qi-Wei Wang , Han-Jia Ye , De-Chuan Zhan

A fundamental and challenging problem in deep learning is catastrophic forgetting, i.e. the tendency of neural networks to fail to preserve the knowledge acquired from old tasks when learning new tasks. This problem has been widely…

Computer Vision and Pattern Recognition · Computer Science 2022-05-23 Guanglei Yang , Enrico Fini , Dan Xu , Paolo Rota , Mingli Ding , Moin Nabi , Xavier Alameda-Pineda , Elisa Ricci