English
Related papers

Related papers: Singular Value Fine-tuning for Few-Shot Class-Incr…

200 papers

Class incremental learning (CIL) algorithms aim to continually learn new object classes from incrementally arriving data while not forgetting past learned classes. The common evaluation protocol for CIL algorithms is to measure the average…

Machine Learning · Computer Science 2024-06-26 Sungmin Cha , Jihwan Kwak , Dongsub Shim , Hyunwoo Kim , Moontae Lee , Honglak Lee , Taesup Moon

Class-Incremental Learning (CIL) aims to learn new classes over time without forgetting previously acquired knowledge. The emergence of foundation models (FM) pretrained on large datasets presents new opportunities for CIL by offering rich,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Mohamed Elkhayat , Mohamed Mahmoud , Jamil Fayyad , Nourhan Bayasi

The ability to incrementally learn new classes is vital to all real-world artificial intelligence systems. A large portion of high-impact applications like social media, recommendation systems, E-commerce platforms, etc. can be represented…

Machine Learning · Computer Science 2021-12-28 Zhen Tan , Kaize Ding , Ruocheng Guo , Huan Liu

Humans are capable of learning new concepts from only a few (labeled) exemplars, incrementally and continually. This happens within the context that we can differentiate among the exemplars, and between the exemplars and large amounts of…

Machine Learning · Computer Science 2022-02-08 Daniel T. Chang

Class Incremental Learning (CIL) aims to handle the scenario where data of novel classes occur continuously and sequentially. The model should recognize the sequential novel classes while alleviating the catastrophic forgetting. In the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Xiaoshuang Chen , Zhongyi Sun , Ke Yan , Shouhong Ding , Hongtao Lu

In Class-Incremental Learning (CIL) an image classification system is exposed to new classes in each learning session and must be updated incrementally. Methods approaching this problem have updated both the classification head and the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Aristeidis Panos , Yuriko Kobe , Daniel Olmeda Reino , Rahaf Aljundi , Richard E. Turner

Few-Shot Class-Incremental Learning (FSCIL) can be particularly susceptible to acquisition contexts with only a few labeled samples. A typical scenario is tactile sensing, where the acquisition context ({\it e.g.}, diverse devices, contact…

Artificial Intelligence · Computer Science 2026-03-27 Yifeng Lin , Aiping Huang , Wenxi Liu , Si Wu , Tiesong Zhao , Zheng-Jun Zha

Node classification with Graph Neural Networks (GNN) under a fixed set of labels is well known in contrast to Graph Few-Shot Class Incremental Learning (GFSCIL), which involves learning a GNN classifier as graph nodes and classes growing…

Machine Learning · Computer Science 2024-11-12 Yayong Li , Peyman Moghadam , Can Peng , Nan Ye , Piotr Koniusz

Large language models (LLMs) possess a remarkable ability to perform in-context learning (ICL), which enables them to handle multiple downstream tasks simultaneously without requiring task-specific fine-tuning. Recent studies have shown…

Computation and Language · Computer Science 2026-03-04 Wenchong He , Liqian Peng , Zhe Jiang , Alex Go

Despite the great success of pre-trained language models, it is still a challenge to use these models for continual learning, especially for the class-incremental learning (CIL) setting due to catastrophic forgetting (CF). This paper…

Computation and Language · Computer Science 2023-07-21 Yijia Shao , Yiduo Guo , Dongyan Zhao , Bing Liu

Incremental Learning (IL) is useful when artificial systems need to deal with streams of data and do not have access to all data at all times. The most challenging setting requires a constant complexity of the deep model and an incremental…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Eden Belouadah , Adrian Popescu , Ioannis Kanellos

Recent research in self-supervised learning (SSL) has shown its capability in learning useful semantic representations from images for classification tasks. Through our work, we study the usefulness of SSL for Fine-Grained Visual…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Muhammad Maaz , Hanoona Abdul Rasheed , Dhanalaxmi Gaddam

This study presents a novel approach to Generative Class Incremental Learning (GCIL) by introducing the forgetting mechanism, aimed at dynamically managing class information for better adaptation to streaming data. GCIL is one of the hot…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Taro Togo , Ren Togo , Keisuke Maeda , Takahiro Ogawa , Miki Haseyama

Instance-incremental learning (IIL) focuses on learning continually with data of the same classes. Compared to class-incremental learning (CIL), the IIL is seldom explored because IIL suffers less from catastrophic forgetting (CF). However,…

Machine Learning · Computer Science 2024-06-06 Qiang Nie , Weifu Fu , Yuhuan Lin , Jialin Li , Yifeng Zhou , Yong Liu , Lei Zhu , Chengjie Wang

Class-incremental learning (CIL) in medical image-guided diagnosis requires retaining prior diagnostic knowledge while adapting to newly emerging disease categories, which is critical for scalable clinical deployment. This problem is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Xinyao Wu , Zhe Xu , Cheng Chen , Jiawei Ma , Yefeng Zheng , Raymond Kai-yu Tong

Class-incremental learning (CIL) has achieved remarkable successes in learning new classes consecutively while overcoming catastrophic forgetting on old categories. However, most existing CIL methods unreasonably assume that all old…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Jiahua Dong , Wenqi Liang , Yang Cong , Gan Sun

Few-shot classification (FSC) entails learning novel classes given only a few examples per class after a pre-training (or meta-training) phase on a set of base classes. Recent works have shown that simply fine-tuning a pre-trained Vision…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Samyadeep Basu , Daniela Massiceti , Shell Xu Hu , Soheil Feizi

Supervised fine-tuning (SFT), supervised instruction tuning (SIT) and in-context learning (ICL) are three alternative, de facto standard approaches to few-shot learning. ICL has gained popularity recently with the advent of LLMs due to its…

Computation and Language · Computer Science 2024-03-05 Evgeniia Razumovskaia , Ivan Vulić , Anna Korhonen

This paper studies the problem of class-incremental learning (CIL), a core setting within continual learning where a model learns a sequence of tasks, each containing a distinct set of classes. Traditional CIL methods, which do not leverage…

Machine Learning · Computer Science 2025-11-19 Saleh Momeni , Changnan Xiao , Bing Liu

Continual learning (CL) learns a sequence of tasks incrementally. This paper studies the challenging CL setting of class-incremental learning (CIL). CIL has two key challenges: catastrophic forgetting (CF) and inter-task class separation…

Machine Learning · Computer Science 2024-12-23 Saleh Momeni , Sahisnu Mazumder , Bing Liu