English
Related papers

Related papers: Adaptive Additive Parameter Updates of Vision Tran…

200 papers

Few-shot classification (FSC) entails learning novel classes given only a few examples per class after a pre-training (or meta-training) phase on a set of base classes. Recent works have shown that simply fine-tuning a pre-trained Vision…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Samyadeep Basu , Daniela Massiceti , Shell Xu Hu , Soheil Feizi

Class-incremental learning (CIL) aims to enable models to continuously learn new classes while overcoming catastrophic forgetting. The introduction of pre-trained models has brought new tuning paradigms to CIL. In this paper, we revisit…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Qinhao Zhou , Yuwen Tan , Boqing Gong , Xiang Xiang

Vision Transformer (ViT) models have recently emerged as powerful and versatile models for various visual tasks. Recently, a work called PMF has achieved promising results in few-shot image classification by utilizing pre-trained vision…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Junjie Zhu , Yiying Li , Chunping Qiu , Ke Yang , Naiyang Guan , Xiaodong Yi

Few-Shot Class-Incremental Learning (FSCIL) can be particularly susceptible to acquisition contexts with only a few labeled samples. A typical scenario is tactile sensing, where the acquisition context ({\it e.g.}, diverse devices, contact…

Artificial Intelligence · Computer Science 2026-03-27 Yifeng Lin , Aiping Huang , Wenxi Liu , Si Wu , Tiesong Zhao , Zheng-Jun Zha

Node classification with Graph Neural Networks (GNN) under a fixed set of labels is well known in contrast to Graph Few-Shot Class Incremental Learning (GFSCIL), which involves learning a GNN classifier as graph nodes and classes growing…

Machine Learning · Computer Science 2024-11-12 Yayong Li , Peyman Moghadam , Can Peng , Nan Ye , Piotr Koniusz

Continuous learning of novel classes is crucial for edge devices to preserve data privacy and maintain reliable performance in dynamic environments. However, the scenario becomes particularly challenging when data samples are insufficient,…

Machine Learning · Computer Science 2026-05-12 Huijing Zhang , Muyang Cao , Linshan Jiang , Xin Du , Di Yu , Changze Lv , Shuiguang Deng

Exemplar-free Class Incremental Learning (EFCIL) aims to learn from a sequence of tasks without having access to previous task data. In this paper, we consider the challenging Cold Start scenario in which insufficient data is available in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Simone Magistri , Tomaso Trinci , Albin Soutif-Cormerais , Joost van de Weijer , Andrew D. Bagdanov

Vision Transformers (ViTs) have shown significant promise in computer vision applications. However, their performance in few-shot learning is limited by challenges in refining token-level interactions, struggling with limited training data,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Mohammed Al-Habib , Zuping Zhang , Abdulrahman Noman

Modern computer vision applications suffer from catastrophic forgetting when incrementally learning new concepts over time. The most successful approaches to alleviate this forgetting require extensive replay of previously seen data, which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 James Smith , Yen-Chang Hsu , Jonathan Balloch , Yilin Shen , Hongxia Jin , Zsolt Kira

Exemplar-Free Class Incremental Learning (EFCIL) aims to learn from a sequence of tasks without having access to previous task data. In this paper, we consider the challenging Cold Start scenario in which insufficient data is available in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Simone Magistri , Tomaso Trinci , Albin Soutif-Cormerais , Joost van de Weijer , Andrew D. Bagdanov

The application of activity recognition in the "AI + Education" field is gaining increasing attention. However, current work mainly focuses on the recognition of activities in manually captured videos and a limited number of activity types,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Yilei Qian , Kanglei Geng , Kailong Chen , Shaoxu Cheng , Linfeng Xu , Hongliang Li , Fanman Meng , Qingbo Wu

Recently, foundation models based on Vision Transformers (ViTs) have become widely available. However, their fine-tuning process is highly resource-intensive, and it hinders their adoption in several edge or low-energy applications. To this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Alessio Devoto , Federico Alvetreti , Jary Pomponi , Paolo Di Lorenzo , Pasquale Minervini , Simone Scardapane

Continual learning (CL) can help pre-trained vision-language models efficiently adapt to new or under-trained data distributions without re-training. Nevertheless, during the continual training of the Contrastive Language-Image Pre-training…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Zangwei Zheng , Mingyuan Ma , Kai Wang , Ziheng Qin , Xiangyu Yue , Yang You

We uncover an ever-overlooked deficiency in the prevailing Few-Shot Learning (FSL) methods: the pre-trained knowledge is indeed a confounder that limits the performance. This finding is rooted from our causal assumption: a Structural Causal…

Machine Learning · Computer Science 2020-12-07 Zhongqi Yue , Hanwang Zhang , Qianru Sun , Xian-Sheng Hua

Learning with little data is challenging but often inevitable in various application scenarios where the labeled data is limited and costly. Recently, few-shot learning (FSL) gained increasing attention because of its generalizability of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-23 Yuzhong Chen , Zhenxiang Xiao , Lin Zhao , Lu Zhang , Haixing Dai , David Weizhong Liu , Zihao Wu , Changhe Li , Tuo Zhang , Changying Li , Dajiang Zhu , Tianming Liu , Xi Jiang

The ability to incrementally learn new classes from limited samples is crucial to the development of artificial intelligence systems for real clinical application. Although existing incremental learning techniques have attempted to address…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Hao Yang , Weijian Huang , Jiarun Liu , Cheng Li , Shanshan Wang

The goal of few-shot learning is to learn a classifier that can recognize unseen classes from limited support data with labels. A common practice for this task is to train a model on the base set first and then transfer to novel classes…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Zhiqiang Shen , Zechun Liu , Jie Qin , Marios Savvides , Kwang-Ting Cheng

Vision Transformer (ViT) has achieved remarkable success due to its large-scale pretraining on general domains, but it still faces challenges when applying it to downstream distant domains that have only scarce training data, which gives…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Shuai Yi , Yixiong Zou , Yuhua Li , Ruixuan Li

Deep learning has achieved remarkable success in object recognition tasks through the availability of large scale datasets like ImageNet. However, deep learning systems suffer from catastrophic forgetting when learning incrementally without…

Robotics · Computer Science 2022-04-22 Ali Ayub , Alan R. Wagner

Few-shot class-incremental learning is crucial for developing scalable and adaptive intelligent systems, as it enables models to acquire new classes with minimal annotated data while safeguarding the previously accumulated knowledge.…

Machine Learning · Computer Science 2024-09-19 Cuiwei Liu , Siang Xu , Huaijun Qiu , Jing Zhang , Zhi Liu , Liang Zhao