English
Related papers

Related papers: Semantic-aware Knowledge Distillation for Few-Shot…

200 papers

The task of Long-tailed Class Incremental Learning (LT-CIL) addresses the sequential learning of new classes from datasets with imbalanced class distributions. This scenario intensifies the fundamental problem of catastrophic forgetting,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Taigo Sakai , Kazuhiro Hotta

Instance-incremental learning (IIL) focuses on learning continually with data of the same classes. Compared to class-incremental learning (CIL), the IIL is seldom explored because IIL suffers less from catastrophic forgetting (CF). However,…

Machine Learning · Computer Science 2024-06-06 Qiang Nie , Weifu Fu , Yuhuan Lin , Jialin Li , Yifeng Zhou , Yong Liu , Lei Zhu , Chengjie Wang

Few-shot class-incremental learning (FSCIL) poses significant challenges for artificial neural networks due to the need to efficiently learn from limited data while retaining knowledge of previously learned tasks. Inspired by the brain's…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Wanyi Li , Wei Wei , Yongkang Luo , Peng Wang

Few-Shot Class Incremental Learning (FSCIL) is crucial for adapting to the complex open-world environments. Contemporary prospective learning-based space construction methods struggle to balance old and new knowledge, as prototype bias and…

Machine Learning · Computer Science 2026-03-03 Qinzhe Wang , Zixuan Chen , Keke Huang , Xiu Su , Chunhua Yang , Chang Xu

Few-Shot Class-Incremental Learning (FSCIL) faces a critical challenge: balancing the retention of prior knowledge with the acquisition of new classes. Existing methods either freeze the backbone to prevent catastrophic forgetting,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Xiaojie Li , Jianlong Wu , Yue Yu , Liqiang Nie , Min Zhang

Despite their success for semantic segmentation, convolutional neural networks are ill-equipped for incremental learning, \ie, adapting the original segmentation model as new classes are available but the initial training data is not…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Zilong Huang , Wentian Hao , Xinggang Wang , Mingyuan Tao , Jianqiang Huang , Wenyu Liu , Xian-Sheng Hua

Few-shot class-incremental learning (FSCIL) faces challenges of memorizing old class distributions and estimating new class distributions given few training samples. In this study, we propose a learnable distribution calibration (LDC)…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Binghao Liu , Boyu Yang , Lingxi Xie , Ren Wang , Qi Tian , Qixiang Ye

Federated Learning (FL) enables collaborative model training among participants while guaranteeing the privacy of raw data. Mainstream FL methodologies overlook the dynamic nature of real-world data, particularly its tendency to grow in…

Machine Learning · Computer Science 2024-04-18 Zhiyuan Wu , Tianliu He , Sheng Sun , Yuwei Wang , Min Liu , Bo Gao , Xuefeng Jiang

Incremental few-shot semantic segmentation (IFSS) targets at incrementally expanding model's capacity to segment new class of images supervised by only a few samples. However, features learned on old classes could significantly drift,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Guangchen Shi , Yirui Wu , Jun Liu , Shaohua Wan , Wenhai Wang , Tong Lu

The task of Few-shot learning (FSL) aims to transfer the knowledge learned from base categories with sufficient labelled data to novel categories with scarce known information. It is currently an important research question and has great…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Chengming Xu , Chen Liu , Xinwei Sun , Siqian Yang , Yabiao Wang , Chengjie Wang , Yanwei Fu

Both accuracy and efficiency are of significant importance to the task of semantic segmentation. Existing deep FCNs suffer from heavy computations due to a series of high-resolution feature maps for preserving the detailed knowledge in…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Tong He , Chunhua Shen , Zhi Tian , Dong Gong , Changming Sun , Youliang Yan

Few-shot learning (FSL) aims to learn novel visual categories from very few samples, which is a challenging problem in real-world applications. Many methods of few-shot classification work well on general images to learn global…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Xiaojian He , Jinfu Lin , Junming Shen

Few-Shot Class-Incremental Learning (FSCIL) aims to continuously learn new classes from a limited set of training samples without forgetting knowledge of previously learned classes. Conventional FSCIL methods typically build a robust…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Linhao Li , Yongzhang Tan , Siyuan Yang , Hao Cheng , Yongfeng Dong , Liang Yang

Few-shot class-incremental learning (FSCIL) has been a challenging problem as only a few training samples are accessible for each novel class in the new sessions. Finetuning the backbone or adjusting the classifier prototypes trained in the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Yibo Yang , Haobo Yuan , Xiangtai Li , Zhouchen Lin , Philip Torr , Dacheng Tao

Few-shot learning is a promising way for reducing the label cost in new categories adaptation with the guidance of a small, well labeled support set. But for few-shot semantic segmentation, the pixel-level annotations of support images are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Jing Wang , Yuang Liu , Qiang Zhou , Fan Wang

Few-Shot learning aims to train and optimize a model that can adapt to unseen visual classes with only a few labeled examples. The existing few-shot learning (FSL) methods, heavily rely only on visual data, thus fail to capture the semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Mohamed Afham , Ranga Rodrigo

Recent advances in deep learning has lead to rapid developments in the field of image retrieval. However, the best performing architectures incur significant computational cost. Recent approaches tackle this issue using knowledge…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Zakaria Laskar , Juho Kannala

Knowledge distillation (KD) is the process of transferring knowledge from a large model to a small one. It has gained increasing attention in the natural language processing community, driven by the demands of compressing ever-growing…

Computation and Language · Computer Science 2023-07-31 Yuqiao Wen , Zichao Li , Wenyu Du , Lili Mou

Semantic segmentation models have two fundamental weaknesses: i) they require large training sets with costly pixel-level annotations, and ii) they have a static output space, constrained to the classes of the training set. Toward…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Fabio Cermelli , Massimiliano Mancini , Yongqin Xian , Zeynep Akata , Barbara Caputo

Exemplar-free class-incremental learning (EFCIL) poses significant challenges, primarily due to catastrophic forgetting, necessitating a delicate balance between stability and plasticity to accurately recognize both new and previous…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Eduard Hogea , Adrian Popescu , Darian Onchis , Grégoire Petit