English
Related papers

Related papers: Learning Prompt with Distribution-Based Feature Re…

200 papers

Despite the recent progress in incremental learning, addressing catastrophic forgetting under distributional drift is still an open and important problem. Indeed, while state-of-the-art domain incremental learning (DIL) methods perform…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Julien Nicolas , Florent Chiaroni , Imtiaz Ziko , Ola Ahmad , Christian Desrosiers , Jose Dolz

Exemplar-free class-incremental learning (EFCIL) poses significant challenges, primarily due to catastrophic forgetting, necessitating a delicate balance between stability and plasticity to accurately recognize both new and previous…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Eduard Hogea , Adrian Popescu , Darian Onchis , Grégoire Petit

Due to the limited availability of data, existing few-shot learning methods trained from scratch fail to achieve satisfactory performance. In contrast, large-scale pre-trained models such as CLIP demonstrate remarkable few-shot and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Kun Song , Huimin Ma , Bochao Zou , Huishuai Zhang , Weiran Huang

Feature Distillation (FD) strategies are proven to be effective in mitigating Catastrophic Forgetting (CF) seen in Class Incremental Learning (CIL). However, current FD approaches enforce strict alignment of feature magnitudes and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 S Balasubramanian , Yedu Krishna P , Talasu Sai Sriram , M Sai Subramaniam , Manepalli Pranav Phanindra Sai , Darshan Gera

Foundation models (FMs) such as CLIP have demonstrated impressive zero-shot performance across various tasks by leveraging large-scale, unsupervised pre-training. However, they often inherit harmful or unwanted knowledge from noisy…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Zeliang Zhang , Gaowen Liu , Charles Fleming , Ramana Rao Kompella , Chenliang Xu

Data-Free Class Incremental Learning (DFCIL) aims to enable models to continuously learn new classes while retraining knowledge of old classes, even when the training data for old classes is unavailable. Although explored primarily with…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Zhenyu Lu , Hao Tang

Few-shot classification (FSC) is a fundamental yet challenging task in computer vision that involves recognizing novel classes from limited data. While previous methods have focused on enhancing visual features or incorporating additional…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Fan Liu , Wenwen Cai , Jian Huo , Chuanyi Zhang , Delong Chen , Jun Zhou

Few-shot Learning (FSL), which endeavors to develop the generalization ability for recognizing novel classes using only a few images, faces significant challenges due to data scarcity. Recent CLIP-like methods based on contrastive…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Wei Zhuo , Runjie Luo , Wufeng Xue , Linlin Shen

Vision-language models, such as CLIP, have shown impressive generalization capacities when using appropriate text descriptions. While optimizing prompts on downstream labeled data has proven effective in improving performance, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Xingyu Zhu , Beier Zhu , Yi Tan , Shuo Wang , Yanbin Hao , Hanwang Zhang

Real-world applications often face data privacy constraints and high acquisition costs, making the assumption of sufficient training data in incremental tasks unrealistic and leading to significant performance degradation in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Liang Bai , Hong Song , Jinfu Li , Yucong Lin , Jingfan Fan , Tianyu Fu , Danni Ai , Deqiang Xiao , Jian Yang

In Class-Incremental Learning (CIL) an image classification system is exposed to new classes in each learning session and must be updated incrementally. Methods approaching this problem have updated both the classification head and the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Aristeidis Panos , Yuriko Kobe , Daniel Olmeda Reino , Rahaf Aljundi , Richard E. Turner

The proliferation of Few-Shot Class Incremental Learning (FSCIL) methodologies has highlighted the critical challenge of maintaining robust anti-amnesia capabilities in FSCIL learners. In this paper, we present a novel conceptualization of…

Machine Learning · Computer Science 2024-12-06 Jingren Liu , Zhong Ji , Yanwei Pang , YunLong Yu

Federated Learning (FL) enables collaborative model training among participants while guaranteeing the privacy of raw data. Mainstream FL methodologies overlook the dynamic nature of real-world data, particularly its tendency to grow in…

Machine Learning · Computer Science 2024-04-18 Zhiyuan Wu , Tianliu He , Sheng Sun , Yuwei Wang , Min Liu , Bo Gao , Xuefeng Jiang

Few-Shot Class-Incremental Learning (FSCIL) introduces a paradigm in which the problem space expands with limited data. FSCIL methods inherently face the challenge of catastrophic forgetting as data arrives incrementally, making models…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Noor Ahmed , Anna Kukleva , Bernt Schiele

Class Incremental Learning (CIL) based on pre-trained models offers a promising direction for open-world continual learning. Existing methods typically rely on correlation-based strategies, where an image's classification feature is used as…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Libo Huang , Zhulin An , Chuanguang Yang , Boyu Diao , Fei Wang , Yan Zeng , Zhifeng Hao , Yongjun Xu

We tackle the problem of class incremental learning (CIL) in the realm of landcover classification from optical remote sensing (RS) images in this paper. The paradigm of CIL has recently gained much prominence given the fact that data are…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 S Divakar Bhat , Biplab Banerjee , Subhasis Chaudhuri , Avik Bhattacharya

Few-shot learning (FSL) aims to recognize new objects with extremely limited training data for each category. Previous efforts are made by either leveraging meta-learning paradigm or novel principles in data augmentation to alleviate this…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Yikai Wang , Chengming Xu , Chen Liu , Li Zhang , Yanwei Fu

As a challenging problem, few-shot class-incremental learning (FSCIL) continually learns a sequence of tasks, confronting the dilemma between slow forgetting of old knowledge and fast adaptation to new knowledge. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Hanbin Zhao , Yongjian Fu , Mintong Kang , Qi Tian , Fei Wu , Xi Li

Deep learning based models have excelled in many computer vision tasks and appear to surpass humans' performance. However, these models require an avalanche of expensive human labeled training data and many iterations to train their large…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Yikai Wang , Li Zhang , Yuan Yao , Yanwei Fu

Prompt-tuning methods for Continual Learning (CL) freeze a large pre-trained model and train a few parameter vectors termed prompts. Most of these methods organize these vectors in a pool of key-value pairs and use the input image as query…