中文
相关论文

相关论文: Foundation Models as Class-Incremental Learners fo…

200 篇论文

To tackle the issues of catastrophic forgetting and overfitting in few-shot class-incremental learning (FSCIL), previous work has primarily concentrated on preserving the memory of old knowledge during the incremental phase. The role of…

机器学习 · 计算机科学 2024-02-05 Wenhao Jiang , Duo Li , Menghan Hu , Guangtao Zhai , Xiaokang Yang , Xiao-Ping Zhang

Few-Shot Class Incremental Learning (FSCIL) is a challenging continual learning task, where limited training examples are available during several learning sessions. To succeed in this task, it is necessary to avoid over-fitting new classes…

计算机视觉与模式识别 · 计算机科学 2024-01-09 Marco D'Alessandro , Alberto Alonso , Enrique Calabrés , Mikel Galar

Scenarios in which restrictions in data transfer and storage limit the possibility to compose a single dataset -- also exploiting different data sources -- to perform a batch-based training procedure, make the development of robust models…

计算机视觉与模式识别 · 计算机科学 2023-07-31 Lorenzo Pellegrini , Guido Borghi , Annalisa Franco , Davide Maltoni

This study aims to address the problem of multi-domain task incremental learning~(MTIL), which requires that vision-language models~(VLMs) continuously acquire new knowledge while maintaining their inherent zero-shot recognition capability.…

计算机视觉与模式识别 · 计算机科学 2025-05-13 Songlin Dong , Chenhao Ding , Jiangyang Li , Jizhou Han , Qiang Wang , Yuhang He , Yihong Gong

With the explosion of digital data in recent years, continuously learning new tasks from a stream of data without forgetting previously acquired knowledge has become increasingly important. In this paper, we propose a new continual learning…

计算机视觉与模式识别 · 计算机科学 2021-03-09 Bo Zhao , Shixiang Tang , Dapeng Chen , Hakan Bilen , Rui Zhao

Cross-silo federated learning (FL) enables decentralized organizations to collaboratively train models while preserving data privacy and has made significant progress in medical image classification. One common assumption is task…

机器学习 · 计算机科学 2024-06-28 Zhaobin Sun , Nannan Wu , Junjie Shi , Li Yu , Xin Yang , Kwang-Ting Cheng , Zengqiang Yan

Few-shot class-incremental learning (FSCIL) aims to continually fit new classes with limited training data, while maintaining the performance of previously learned classes. The main challenges are overfitting the rare new training samples…

计算机视觉与模式识别 · 计算机科学 2024-03-22 Mingli Zhu , Zihao Zhu , Sihong Chen , Chen Chen , Baoyuan Wu

Federated Continual Learning (FCL) enables distributed clients to collaboratively train a global model from online task streams in dynamic real-world scenarios. However, existing FCL methods face challenges of both spatial data…

Foundation models (FMs) are large-scale deep learning models trained on massive datasets, often using self-supervised learning techniques. These models serve as a versatile base for a wide range of downstream tasks, including those in…

机器学习 · 计算机科学 2025-01-17 Wasif Khan , Seowung Leem , Kyle B. See , Joshua K. Wong , Shaoting Zhang , Ruogu Fang

Existing work on continual learning (CL) is primarily devoted to developing algorithms for models trained from scratch. Despite their encouraging performance on contrived benchmarks, these algorithms show dramatic performance drops in…

计算机视觉与模式识别 · 计算机科学 2024-07-08 Kuan-Ying Lee , Yuanyi Zhong , Yu-Xiong Wang

Machine-learned interatomic potentials are revolutionising atomistic materials simulations by providing accurate and scalable predictions within the scope covered by the training data. However, generation of an accurate and robust training…

Few-shot class-incremental learning (FSCIL) aims to mitigate the catastrophic forgetting issue when a model is incrementally trained on limited data. However, many of these works lack effective exploration of prior knowledge, rendering them…

计算机视觉与模式识别 · 计算机科学 2025-01-09 Wan Xu , Tianyu Huang , Tianyu Qu , Guanglei Yang , Yiwen Guo , Wangmeng Zuo

Class-incremental learning (CIL) learns a classification model with training data of different classes arising progressively. Existing CIL either suffers from serious accuracy loss due to catastrophic forgetting, or invades data privacy by…

机器学习 · 计算机科学 2022-12-13 Huiping Zhuang , Zhenyu Weng , Hongxin Wei , Renchunzi Xie , Kar-Ann Toh , Zhiping Lin

Foundational models are trained on extensive datasets to capture the general trends of a domain. However, in medical imaging, the scarcity of data makes pre-training for every domain, modality, or task challenging. Continual learning offers…

图像与视频处理 · 电气工程与系统科学 2025-08-20 Mohammad Areeb Qazi , Munachiso S Nwadike , Ibrahim Almakky , Mohammad Yaqub , Numan Saeed

Many healthcare sensing applications utilize multimodal time-series data from sensors embedded in mobile and wearable devices. Federated Learning (FL), with its privacy-preserving advantages, is particularly well-suited for health…

机器学习 · 计算机科学 2024-11-28 Adiba Orzikulova , Jaehyun Kwak , Jaemin Shin , Sung-Ju Lee

Few-shot class-incremental learning (FSCIL), which targets at continuously expanding model's representation capacity under few supervisions, is an important yet challenging problem. On the one hand, when fitting new tasks (novel classes),…

计算机视觉与模式识别 · 计算机科学 2021-04-07 Boyu Yang , Mingbao Lin , Binghao Liu , Mengying Fu , Chang Liu , Rongrong Ji , Qixiang Ye

Salient Object Detection (SOD) with deep learning often requires substantial computational resources and large annotated datasets, making it impractical for resource-constrained applications. Lightweight models address computational demands…

计算机视觉与模式识别 · 计算机科学 2025-04-16 Leonardo M. Joao , Jancarlo F. Gomes , Silvio J. F. Guimaraes , Ewa Kijak , Alexandre X. Falcao

The emergence of foundation models in computational pathology has transformed histopathological image analysis, with whole slide imaging (WSI) diagnosis being a core application. Traditionally, weakly supervised fine-tuning via multiple…

计算机视觉与模式识别 · 计算机科学 2025-03-03 Jiawen Li , Jiali Hu , Qiehe Sun , Renao Yan , Minxi Ouyang , Tian Guan , Anjia Han , Chao He , Yonghong He

Deep learning (DL) has been increasingly applied in medical imaging, however, it requires large amounts of data, which raises many challenges related to data privacy, storage, and transfer. Federated learning (FL) is a training paradigm…

计算机视觉与模式识别 · 计算机科学 2025-10-09 Jan Fiszer , Dominika Ciupek , Maciej Malawski

Modern incremental learning for semantic segmentation methods usually learn new categories based on dense annotations. Although achieve promising results, pixel-by-pixel labeling is costly and time-consuming. Weakly incremental learning for…

计算机视觉与模式识别 · 计算机科学 2023-04-21 Chaohui Yu , Qiang Zhou , Jingliang Li , Jianlong Yuan , Zhibin Wang , Fan Wang