English
Related papers

Related papers: CD^2: Constrained Dataset Distillation for Few-Sho…

200 papers

Unsupervised Continual Learning (UCL) is a burgeoning field in machine learning, focusing on enabling neural networks to sequentially learn tasks without explicit label information. Catastrophic Forgetting (CF), where models forget…

Machine Learning · Computer Science 2024-05-30 Mohammadreza Sadeghi , Zihan Wang , Narges Armanfard

This paper introduces a solid state-of-the-art baseline for a class-incremental semantic segmentation (CISS) problem. While the recent CISS algorithms utilize variants of the knowledge distillation (KD) technique to tackle the problem, they…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Sungmin Cha , Beomyoung Kim , Youngjoon Yoo , Taesup Moon

To tackle the issues of catastrophic forgetting and overfitting in few-shot class-incremental learning (FSCIL), previous work has primarily concentrated on preserving the memory of old knowledge during the incremental phase. The role of…

Machine Learning · Computer Science 2024-02-05 Wenhao Jiang , Duo Li , Menghan Hu , Guangtao Zhai , Xiaokang Yang , Xiao-Ping Zhang

Few-shot class incremental learning (FSCIL) is a more realistic and challenging paradigm in continual learning to incrementally learn unseen classes and overcome catastrophic forgetting on base classes with only a few training examples.…

Machine Learning · Computer Science 2025-12-04 Haidong Kang , Wei Wu , Hanling Wang

Large-scale vision-language models (VLMs) have shown a strong zero-shot generalization capability on unseen-domain data. However, adapting pre-trained VLMs to a sequence of downstream tasks often leads to the forgetting of previously…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yu-Chu Yu , Chi-Pin Huang , Jr-Jen Chen , Kai-Po Chang , Yung-Hsuan Lai , Fu-En Yang , Yu-Chiang Frank Wang

Few-Shot Class-Incremental Learning (FSCIL) aims to continuously learn new classes from a limited set of training samples without forgetting knowledge of previously learned classes. Conventional FSCIL methods typically build a robust…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Linhao Li , Yongzhang Tan , Siyuan Yang , Hao Cheng , Yongfeng Dong , Liang Yang

The efficacy of multimodal learning in remote sensing (RS) is severely undermined by missing modalities. The challenge is exacerbated by the RS highly heterogeneous data and huge scale variation. Consequently, paradigms proven effective in…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Nhi Kieu , Kien Nguyen , Arnold Wiliem , Clinton Fookes , Sridha Sridharan

The task of Few-shot learning (FSL) aims to transfer the knowledge learned from base categories with sufficient labelled data to novel categories with scarce known information. It is currently an important research question and has great…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Chengming Xu , Chen Liu , Xinwei Sun , Siqian Yang , Yabiao Wang , Chengjie Wang , Yanwei Fu

Real-world contains an overwhelmingly large number of object classes, learning all of which at once is infeasible. Few shot learning is a promising learning paradigm due to its ability to learn out of order distributions quickly with only a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Jathushan Rajasegaran , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Mubarak Shah

Recent advances in deep learning for processing point clouds hold increased interest in Few-Shot Class Incremental Learning (FSCIL) for 3D computer vision. This paper introduces a new method to tackle the Few-Shot Continual Incremental…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Sahar Ahmadi , Ali Cheraghian , Morteza Saberi , Md. Towsif Abir , Hamidreza Dastmalchi , Farookh Hussain , Shafin Rahman

Incremental learning (IL) is an important task aimed at increasing the capability of a trained model, in terms of the number of classes recognizable by the model. The key problem in this task is the requirement of storing data (e.g. images)…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Prithviraj Dhar , Rajat Vikram Singh , Kuan-Chuan Peng , Ziyan Wu , Rama Chellappa

As Web technology continues to develop, it has become increasingly common to use data stored on different clients. At the same time, federated learning has received widespread attention due to its ability to protect data privacy when let…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Xin Luo , Fang-Yi Liang , Jiale Liu , Yu-Wei Zhan , Zhen-Duo Chen , Xin-Shun Xu

In this paper, we address the problem of distillation-based class-incremental learning with a single head. A central theme of this task is to learn new classes that arrive in sequential phases over time while keeping the model's capability…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Cheng-Hsun Lei , Yi-Hsin Chen , Wen-Hsiao Peng , Wei-Chen Chiu

Most meta-learning approaches assume the existence of a very large set of labeled data available for episodic meta-learning of base knowledge. This contrasts with the more realistic continual learning paradigm in which data arrives…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Kai Wang , Xialei Liu , Andy Bagdanov , Luis Herranz , Shangling Jui , Joost van de Weijer

Novel classes frequently arise in our dynamically changing world, e.g., new users in the authentication system, and a machine learning model should recognize new classes without forgetting old ones. This scenario becomes more challenging…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Da-Wei Zhou , Fu-Yun Wang , Han-Jia Ye , Liang Ma , Shiliang Pu , De-Chuan Zhan

Class-incremental learning (CIL) aims to adapt to continuously emerging new classes while preserving knowledge of previously learned ones. Few-shot class-incremental learning (FSCIL) presents a greater challenge that requires the model to…

Artificial Intelligence · Computer Science 2025-08-19 Shiwon Kim , Dongjun Hwang , Sungwon Woo , Rita Singh

In the field of intelligent multimedia analysis, ultra-fine-grained visual categorization (Ultra-FGVC) plays a vital role in distinguishing intricate subcategories within broader categories. However, this task is inherently challenging due…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Ziye Fang , Xin Jiang , Hao Tang , Zechao Li

A new algorithm for incremental learning in the context of Tiny Machine learning (TinyML) is presented, which is optimized for low-performance and energy efficient embedded devices. TinyML is an emerging field that deploys machine learning…

Machine Learning · Computer Science 2024-09-12 Marcus Rüb , Philipp Tuchel , Axel Sikora , Daniel Mueller-Gritschneder

Incremental language learning with pseudo-data can alleviate catastrophic forgetting in neural networks. However, to obtain better performance, former methods have higher demands for pseudo-data of the previous tasks. The performance…

Computation and Language · Computer Science 2021-10-19 Han Wang , Ruiliu Fu , Chengzhang Li , Xuejun Zhang , Jun Zhou , Yonghong Yan

The human visual system is remarkable in learning new visual concepts from just a few examples. This is precisely the goal behind few-shot class incremental learning (FSCIL), where the emphasis is additionally placed on ensuring the model…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Ayan Kumar Bhunia , Viswanatha Reddy Gajjala , Subhadeep Koley , Rohit Kundu , Aneeshan Sain , Tao Xiang , Yi-Zhe Song