English
Related papers

Related papers: Foundation Models as Class-Incremental Learners fo…

200 papers

To tackle the issues of catastrophic forgetting and overfitting in few-shot class-incremental learning (FSCIL), previous work has primarily concentrated on preserving the memory of old knowledge during the incremental phase. The role of…

Machine Learning · Computer Science 2024-02-05 Wenhao Jiang , Duo Li , Menghan Hu , Guangtao Zhai , Xiaokang Yang , Xiao-Ping Zhang

Few-Shot Class Incremental Learning (FSCIL) is a challenging continual learning task, where limited training examples are available during several learning sessions. To succeed in this task, it is necessary to avoid over-fitting new classes…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Marco D'Alessandro , Alberto Alonso , Enrique Calabrés , Mikel Galar

Scenarios in which restrictions in data transfer and storage limit the possibility to compose a single dataset -- also exploiting different data sources -- to perform a batch-based training procedure, make the development of robust models…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Lorenzo Pellegrini , Guido Borghi , Annalisa Franco , Davide Maltoni

This study aims to address the problem of multi-domain task incremental learning~(MTIL), which requires that vision-language models~(VLMs) continuously acquire new knowledge while maintaining their inherent zero-shot recognition capability.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Songlin Dong , Chenhao Ding , Jiangyang Li , Jizhou Han , Qiang Wang , Yuhang He , Yihong Gong

With the explosion of digital data in recent years, continuously learning new tasks from a stream of data without forgetting previously acquired knowledge has become increasingly important. In this paper, we propose a new continual learning…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Bo Zhao , Shixiang Tang , Dapeng Chen , Hakan Bilen , Rui Zhao

Cross-silo federated learning (FL) enables decentralized organizations to collaboratively train models while preserving data privacy and has made significant progress in medical image classification. One common assumption is task…

Machine Learning · Computer Science 2024-06-28 Zhaobin Sun , Nannan Wu , Junjie Shi , Li Yu , Xin Yang , Kwang-Ting Cheng , Zengqiang Yan

Few-shot class-incremental learning (FSCIL) aims to continually fit new classes with limited training data, while maintaining the performance of previously learned classes. The main challenges are overfitting the rare new training samples…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Mingli Zhu , Zihao Zhu , Sihong Chen , Chen Chen , Baoyuan Wu

Federated Continual Learning (FCL) enables distributed clients to collaboratively train a global model from online task streams in dynamic real-world scenarios. However, existing FCL methods face challenges of both spatial data…

Foundation models (FMs) are large-scale deep learning models trained on massive datasets, often using self-supervised learning techniques. These models serve as a versatile base for a wide range of downstream tasks, including those in…

Machine Learning · Computer Science 2025-01-17 Wasif Khan , Seowung Leem , Kyle B. See , Joshua K. Wong , Shaoting Zhang , Ruogu Fang

Existing work on continual learning (CL) is primarily devoted to developing algorithms for models trained from scratch. Despite their encouraging performance on contrived benchmarks, these algorithms show dramatic performance drops in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Kuan-Ying Lee , Yuanyi Zhong , Yu-Xiong Wang

Machine-learned interatomic potentials are revolutionising atomistic materials simulations by providing accurate and scalable predictions within the scope covered by the training data. However, generation of an accurate and robust training…

Materials Science · Physics 2025-07-30 Mariia Radova , Wojciech G. Stark , Connor S. Allen , Reinhard J. Maurer , Albert P. Bartók

Few-shot class-incremental learning (FSCIL) aims to mitigate the catastrophic forgetting issue when a model is incrementally trained on limited data. However, many of these works lack effective exploration of prior knowledge, rendering them…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Wan Xu , Tianyu Huang , Tianyu Qu , Guanglei Yang , Yiwen Guo , Wangmeng Zuo

Class-incremental learning (CIL) learns a classification model with training data of different classes arising progressively. Existing CIL either suffers from serious accuracy loss due to catastrophic forgetting, or invades data privacy by…

Machine Learning · Computer Science 2022-12-13 Huiping Zhuang , Zhenyu Weng , Hongxin Wei , Renchunzi Xie , Kar-Ann Toh , Zhiping Lin

Foundational models are trained on extensive datasets to capture the general trends of a domain. However, in medical imaging, the scarcity of data makes pre-training for every domain, modality, or task challenging. Continual learning offers…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Mohammad Areeb Qazi , Munachiso S Nwadike , Ibrahim Almakky , Mohammad Yaqub , Numan Saeed

Many healthcare sensing applications utilize multimodal time-series data from sensors embedded in mobile and wearable devices. Federated Learning (FL), with its privacy-preserving advantages, is particularly well-suited for health…

Machine Learning · Computer Science 2024-11-28 Adiba Orzikulova , Jaehyun Kwak , Jaemin Shin , Sung-Ju Lee

Few-shot class-incremental learning (FSCIL), which targets at continuously expanding model's representation capacity under few supervisions, is an important yet challenging problem. On the one hand, when fitting new tasks (novel classes),…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Boyu Yang , Mingbao Lin , Binghao Liu , Mengying Fu , Chang Liu , Rongrong Ji , Qixiang Ye

Salient Object Detection (SOD) with deep learning often requires substantial computational resources and large annotated datasets, making it impractical for resource-constrained applications. Lightweight models address computational demands…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Leonardo M. Joao , Jancarlo F. Gomes , Silvio J. F. Guimaraes , Ewa Kijak , Alexandre X. Falcao

The emergence of foundation models in computational pathology has transformed histopathological image analysis, with whole slide imaging (WSI) diagnosis being a core application. Traditionally, weakly supervised fine-tuning via multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Jiawen Li , Jiali Hu , Qiehe Sun , Renao Yan , Minxi Ouyang , Tian Guan , Anjia Han , Chao He , Yonghong He

Deep learning (DL) has been increasingly applied in medical imaging, however, it requires large amounts of data, which raises many challenges related to data privacy, storage, and transfer. Federated learning (FL) is a training paradigm…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Jan Fiszer , Dominika Ciupek , Maciej Malawski

Modern incremental learning for semantic segmentation methods usually learn new categories based on dense annotations. Although achieve promising results, pixel-by-pixel labeling is costly and time-consuming. Weakly incremental learning for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Chaohui Yu , Qiang Zhou , Jingliang Li , Jianlong Yuan , Zhibin Wang , Fan Wang