English
Related papers

Related papers: Does Prior Data Matter? Exploring Joint Training i…

200 papers

Few-Shot Class-Incremental Learning (FSCIL) faces a critical challenge: balancing the retention of prior knowledge with the acquisition of new classes. Existing methods either freeze the backbone to prevent catastrophic forgetting,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Xiaojie Li , Jianlong Wu , Yue Yu , Liqiang Nie , Min Zhang

Class-Incremental Learning (CIL) aims to learn new classes sequentially while retaining the knowledge of previously learned classes. Recently, pre-trained models (PTMs) combined with parameter-efficient fine-tuning (PEFT) have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Jiangpeng He , Zhihao Duan , Fengqing Zhu

Neural networks suffer from catastrophic forgetting in class-incremental learning (CIL) settings. Rehearsal$\unicode{x2013}$replaying a subset of past samples$\unicode{x2013}$is a well-established mitigation strategy. However, recent…

Machine Learning · Computer Science 2026-05-15 Alberto Tamajo , Srinandan Dasmahapatra , Rahman Attar

The application of activity recognition in the "AI + Education" field is gaining increasing attention. However, current work mainly focuses on the recognition of activities in manually captured videos and a limited number of activity types,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Yilei Qian , Kanglei Geng , Kailong Chen , Shaoxu Cheng , Linfeng Xu , Hongliang Li , Fanman Meng , Qingbo Wu

Class-incremental learning (CIL) aims to adapt to emerging new classes without forgetting old ones. Traditional CIL models are trained from scratch to continually acquire knowledge as data evolves. Recently, pre-training has achieved…

Machine Learning · Computer Science 2024-08-06 Da-Wei Zhou , Zi-Wen Cai , Han-Jia Ye , De-Chuan Zhan , Ziwei Liu

Few-shot class-incremental learning (FSCIL) receives significant attention from the public to perform classification continuously with a few training samples, which suffers from the key catastrophic forgetting problem. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Kexin Bao , Daichi Zhang , Hansong Zhang , Yong Li , Yutao Yue , Shiming Ge

Class-Incremental Learning (CIL) aims to learn new classes over time without forgetting previously acquired knowledge. The emergence of foundation models (FM) pretrained on large datasets presents new opportunities for CIL by offering rich,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Mohamed Elkhayat , Mohamed Mahmoud , Jamil Fayyad , Nourhan Bayasi

We propose Consistency-guided Asynchronous Contrastive Tuning (CoACT), a novel method for continuously tuning foundation models to learn new classes in few-shot settings. CoACT consists of three key components:(i) asynchronous contrastive…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Shuvendu Roy , Elham Dolatabadi , Arash Afkanpour , Ali Etemad

Deep learning based models have excelled in many computer vision tasks and appear to surpass humans' performance. However, these models require an avalanche of expensive human labeled training data and many iterations to train their large…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Yikai Wang , Li Zhang , Yuan Yao , Yanwei Fu

With the memory-resource-limited constraints, class-incremental learning (CIL) usually suffers from the "catastrophic forgetting" problem when updating the joint classification model on the arrival of newly added classes. To cope with the…

Machine Learning · Computer Science 2021-05-19 Hanbin Zhao , Hui Wang , Yongjian Fu , Fei Wu , Xi Li

Large language models (LLMs) excel at few-shot in-context learning (ICL) without requiring parameter updates. However, as ICL demonstrations increase from a few to many, performance tends to plateau and eventually decline. We identify two…

Machine Learning · Computer Science 2025-05-28 Xiaoqing Zhang , Ang Lv , Yuhan Liu , Flood Sung , Wei Liu , Jian Luan , Shuo Shang , Xiuying Chen , Rui Yan

Exemplar-free class-incremental learning (CIL) poses several challenges since it prohibits the rehearsal of data from previous tasks and thus suffers from catastrophic forgetting. Recent approaches to incrementally learning the classifier…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Dipam Goswami , Yuyang Liu , Bartłomiej Twardowski , Joost van de Weijer

Class Incremental Learning (CIL) requires models to continuously learn new classes without forgetting previously learned ones, while maintaining stable performance across all possible class sequences. In real-world settings, the order in…

Machine Learning · Computer Science 2026-03-05 Guannan Lai , Da-Wei Zhou , Xin Yang , Han-Jia Ye

Existing continual relation learning (CRL) methods rely on plenty of labeled training data for learning a new task, which can be hard to acquire in real scenario as getting large and representative labeled data is often expensive and…

Computation and Language · Computer Science 2022-03-07 Chengwei Qin , Shafiq Joty

Class-Incremental Learning (CIL) or continual learning is a desired capability in the real world, which requires a learning system to adapt to new tasks without forgetting former ones. While traditional CIL methods focus on visual…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Da-Wei Zhou , Yuanhan Zhang , Yan Wang , Jingyi Ning , Han-Jia Ye , De-Chuan Zhan , Ziwei Liu

Continual learning aims to acquire new knowledge while retaining past information. Class-incremental learning (CIL) presents a challenging scenario where classes are introduced sequentially. For video data, the task becomes more complex…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Tieyuan Chen , Huabin Liu , Chern Hong Lim , John See , Xing Gao , Junhui Hou , Weiyao Lin

Domain-Incremental Learning (DIL) focuses on continual learning in non-stationary environments, requiring models to adjust to evolving domains while preserving historical knowledge. DIL faces two critical challenges in the context of…

Machine Learning · Computer Science 2025-07-10 Lan Li , Da-Wei Zhou , Han-Jia Ye , De-Chuan Zhan

Class Incremental Learning (CIL) aims at learning a multi-class classifier in a phase-by-phase manner, in which only data of a subset of the classes are provided at each phase. Previous works mainly focus on mitigating forgetting in phases…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Yujun Shi , Kuangqi Zhou , Jian Liang , Zihang Jiang , Jiashi Feng , Philip Torr , Song Bai , Vincent Y. F. Tan

Class-Incremental Learning (CIL) is a practical and challenging problem for achieving general artificial intelligence. Recently, Pre-Trained Models (PTMs) have led to breakthroughs in both visual and natural language processing tasks.…

Machine Learning · Computer Science 2024-02-16 Junhao Zheng , Ruiyan Wang , Chongzhi Zhang , Huawen Feng , Qianli Ma

Incremental Learning (IL) is useful when artificial systems need to deal with streams of data and do not have access to all data at all times. The most challenging setting requires a constant complexity of the deep model and an incremental…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Eden Belouadah , Adrian Popescu , Ioannis Kanellos