English
Related papers

Related papers: Incremental Prototype Tuning for Class Incremental…

200 papers

Continual instruction tuning(CIT) during the post-training phase is crucial for adapting multimodal large language models (MLLMs) to evolving real-world demands. However, the progress is hampered by the lack of benchmarks with rigorous,…

Computation and Language · Computer Science 2026-02-16 Haiyun Guo , Zhiyan Hou , Yandu Sun , Jinghan He , Yu Chen , Yuzhe Zhou , Yuheng Jia , Jinqiao Wang , Tat-Seng Chua

Instance-incremental learning (IIL) focuses on learning continually with data of the same classes. Compared to class-incremental learning (CIL), the IIL is seldom explored because IIL suffers less from catastrophic forgetting (CF). However,…

Machine Learning · Computer Science 2024-06-06 Qiang Nie , Weifu Fu , Yuhuan Lin , Jialin Li , Yifeng Zhou , Yong Liu , Lei Zhu , Chengjie Wang

The dynamic nature of open-world scenarios has attracted more attention to class incremental learning (CIL). However, existing CIL methods typically presume the availability of complete ground-truth labels throughout the training process,…

Machine Learning · Computer Science 2024-08-20 Jiaming Liu , Hongyuan Liu , Zhili Qin , Wei Han , Yulu Fan , Qinli Yang , Junming Shao

We consider class incremental learning (CIL) problem, in which a learning agent continuously learns new classes from incrementally arriving training data batches and aims to predict well on all the classes learned so far. The main challenge…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Hongjoon Ahn , Jihwan Kwak , Subin Lim , Hyeonsu Bang , Hyojun Kim , Taesup Moon

Class-incremental learning (CIL) aims to continuously introduce novel categories into a classification system without forgetting previously learned ones, thus adapting to evolving data distributions. Researchers are currently focusing on…

Machine Learning · Computer Science 2024-12-30 Yongchun Qin , Pengfei Fang , Hui Xue

Due to the model aging problem, Deep Neural Networks (DNNs) need updates to adjust them to new data distributions. The common practice leverages incremental learning (IL), e.g., Class-based Incremental Learning (CIL) that updates output…

Machine Learning · Computer Science 2023-04-11 Xuanqi Gao , Juan Zhai , Shiqing Ma , Chao Shen , Yufei Chen , Shiwei Wang

In-context learning (ICL) is a new paradigm for natural language processing that utilizes Generative Pre-trained Transformer (GPT)-like models. This approach uses prompts that include in-context demonstrations to generate the corresponding…

Computation and Language · Computer Science 2024-01-24 Momin Abbas , Yi Zhou , Parikshit Ram , Nathalie Baracaldo , Horst Samulowitz , Theodoros Salonidis , Tianyi Chen

Class-incremental learning (CIL) for time series data faces critical challenges in balancing stability against catastrophic forgetting and plasticity for new knowledge acquisition, particularly under real-world constraints where historical…

Machine Learning · Computer Science 2025-03-11 Yuanlong Wu , Mingxing Nie , Tao Zhu , Liming Chen , Huansheng Ning , Yaping Wan

Classifying pill categories from real-world images is crucial for various smart healthcare applications. Although existing approaches in image classification might achieve a good performance on fixed pill categories, they fail to handle…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Trong-Tung Nguyen , Hieu H. Pham , Phi Le Nguyen , Thanh Hung Nguyen , Minh Do

We observe a high level of imbalance in the accuracy of different classes in the same old task for the first time. This intriguing phenomenon, discovered in replay-based Class Incremental Learning (CIL), highlights the imbalanced forgetting…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Shixiong Xu , Gaofeng Meng , Xing Nie , Bolin Ni , Bin Fan , Shiming Xiang

Class-Incremental Learning (CIL) or continual learning is a desired capability in the real world, which requires a learning system to adapt to new tasks without forgetting former ones. While traditional CIL methods focus on visual…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Da-Wei Zhou , Yuanhan Zhang , Yan Wang , Jingyi Ning , Han-Jia Ye , De-Chuan Zhan , Ziwei Liu

Class-incremental learning (CIL) is a particularly challenging variant of continual learning, where the goal is to learn to discriminate between all classes presented in an incremental fashion. Existing approaches often suffer from…

Machine Learning · Computer Science 2024-03-12 Michał Zając , Tinne Tuytelaars , Gido M. van de Ven

In the scenario of class-incremental learning (CIL), deep neural networks have to adapt their model parameters to non-stationary data distributions, e.g., the emergence of new classes over time. However, CIL models are challenged by the…

Machine Learning · Computer Science 2023-06-22 Depeng Li , Zhigang Zeng

Class-incremental learning (CIL) seeks to enable a model to sequentially learn new classes while retaining knowledge of previously learned ones. Balancing flexibility and stability remains a significant challenge, particularly when the task…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Fangwen Wu , Lechao Cheng , Shengeng Tang , Xiaofeng Zhu , Chaowei Fang , Dingwen Zhang , Meng Wang

Class incremental learning aims to enable models to learn from sequential, non-stationary data streams across different tasks without catastrophic forgetting. In class incremental semantic segmentation (CISS), the semantic content of image…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Xiao Yu , Yan Fang , Yao Zhao , Yunchao Wei

Class incremental learning (CIL) is a challenging setting of continual learning, which learns a series of tasks sequentially. Each task consists of a set of unique classes. The key feature of CIL is that no task identifier (or task-id) is…

Machine Learning · Computer Science 2024-03-14 Haowei Lin , Yijia Shao , Weinan Qian , Ningxin Pan , Yiduo Guo , Bing Liu

Graph Neural Networks (GNN) endure catastrophic forgetting, undermining their capacity to preserve previously acquired knowledge amid the assimilation of novel information. Rehearsal-based techniques revisit historical examples, adopted as…

Machine Learning · Computer Science 2025-05-16 Lei Song , Jiaxing Li , Shihan Guan , Youyong Kong

In this paper, we consider the problem of fine-grained image retrieval in an incremental setting, when new categories are added over time. On the one hand, repeatedly training the representation on the extended dataset is time-consuming. On…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Wei Chen , Yu Liu , Weiping Wang , Tinne Tuytelaars , Erwin M. Bakker , Michael Lew

Deep convolutional neural networks have made significant breakthroughs in medical image classification, under the assumption that training samples from all classes are simultaneously available. However, in real-world medical scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Xuze Hao , Wenqian Ni , Xuhao Jiang , Weimin Tan , Bo Yan

With the advent of large-scale pre-trained models, interest in adapting and exploiting them for continual learning scenarios has grown. In this paper, we propose an approach to exploiting pre-trained vision-language models (e.g. CLIP) that…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Xialei Liu , Xusheng Cao , Haori Lu , Jia-wen Xiao , Andrew D. Bagdanov , Ming-Ming Cheng