English
Related papers

Related papers: Semantic-aware Knowledge Distillation for Few-Shot…

200 papers

Cross-Domain Few-Shot Semantic Segmentation (CD-FSS) seeks to segment unknown classes in unseen domains using only a few annotated examples. This setting is inherently challenging: source and target domains exhibit substantial distribution…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Pasquale De Marinis , Pieter M. Blok , Uzay Kaymak , Rogier Brussee , Gennaro Vessio , Giovanna Castellano

Class-incremental learning in the context of limited personal labeled samples (few-shot) is critical for numerous real-world applications, such as smart home devices. A key challenge in these scenarios is balancing the trade-off between…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Kirill Paramonov , Mete Ozay , Eunju Yang , Jijoong Moon , Umberto Michieli

Learning from a limited amount of data, namely Few-Shot Learning, stands out as a challenging computer vision task. Several works exploit semantics and design complicated semantic fusion mechanisms to compensate for rare representative…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Hai Zhang , Junzhe Xu , Shanlin Jiang , Zhenan He

Federated Learning has been introduced as a new machine learning paradigm enhancing the use of local devices. At a server level, FL regularly aggregates models learned locally on distributed clients to obtain a more general model. Current…

Machine Learning · Computer Science 2022-07-19 Anastasiia Usmanova , François Portet , Philippe Lalanda , German Vega

Class-incremental learning (CIL) enables continuous learning of new classes while mitigating catastrophic forgetting of old ones. For the performance breakthrough of CIL, it is essential yet challenging to effectively refine past knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Yuanzhi Su , Siyuan Chen , Yuan-Gen Wang

In this paper, we propose a simple but effective method for training neural networks with a limited amount of training data. Our approach inherits the idea of knowledge distillation that transfers knowledge from a deep or wide reference…

Machine Learning · Statistics 2018-07-06 Akisato Kimura , Zoubin Ghahramani , Koh Takeuchi , Tomoharu Iwata , Naonori Ueda

As a front-burner problem in incremental learning, class incremental semantic segmentation (CISS) is plagued by catastrophic forgetting and semantic drift. Although recent methods have utilized knowledge distillation to transfer knowledge…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Danpei Zhao , Bo Yuan , Zhenwei Shi

A new algorithm for incremental learning in the context of Tiny Machine learning (TinyML) is presented, which is optimized for low-performance and energy efficient embedded devices. TinyML is an emerging field that deploys machine learning…

Machine Learning · Computer Science 2024-09-12 Marcus Rüb , Philipp Tuchel , Axel Sikora , Daniel Mueller-Gritschneder

As a challenging problem, few-shot class-incremental learning (FSCIL) continually learns a sequence of tasks, confronting the dilemma between slow forgetting of old knowledge and fast adaptation to new knowledge. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Hanbin Zhao , Yongjian Fu , Mintong Kang , Qi Tian , Fei Wu , Xi Li

Generalized Few-Shot Intent Detection (GFSID) is challenging and realistic because it needs to categorize both seen and novel intents simultaneously. Previous GFSID methods rely on the episodic learning paradigm, which makes it hard to…

Computation and Language · Computer Science 2023-09-12 Chaiyut Luoyiching , Yangning Li , Yinghui Li , Rongsheng Li , Hai-Tao Zheng , Nannan Zhou , Hanjing Su

Class-incremental fault diagnosis requires a model to adapt to new fault classes while retaining previous knowledge. However, limited research exists for imbalanced and long-tailed data. Extracting discriminative features from few-shot…

Machine Learning · Computer Science 2025-01-22 Hanrong Zhang , Yifei Yao , Zixuan Wang , Jiayuan Su , Mengxuan Li , Peng Peng , Hongwei Wang

Few-Shot Class-Incremental Learning (FSCIL) defines a practical but challenging task where models are required to continuously learn novel concepts with only a few training samples. Due to data scarcity, existing FSCIL methods resort to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Chengyan Liu , Linglan Zhao , Fan Lyu , Kaile Du , Fuyuan Hu , Tao Zhou

Few-shot Learning (FSL) aims to classify new concepts from a small number of examples. While there have been an increasing amount of work on few-shot object classification in the last few years, most current approaches are limited to images…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Mathieu Pagé Fortin , Brahim Chaib-draa

Existing continual relation learning (CRL) methods rely on plenty of labeled training data for learning a new task, which can be hard to acquire in real scenario as getting large and representative labeled data is often expensive and…

Computation and Language · Computer Science 2022-03-07 Chengwei Qin , Shafiq Joty

Few-shot learning (FSL) aims to recognize new concepts using a limited number of visual samples. Existing approaches attempt to incorporate semantic information into the limited visual data for category understanding. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Mushui Liu , Fangtai Wu , Bozheng Li , Ziqian Lu , Yunlong Yu , Xi Li

Few-shot learning aims at recognizing new instances from classes with limited samples. This challenging task is usually alleviated by performing meta-learning on similar tasks. However, the resulting models are black-boxes. There has been…

Machine Learning · Computer Science 2022-03-01 Mohammad Reza Zarei , Majid Komeili

Contrastive Language-Image Pre-training (CLIP) has shown powerful zero-shot learning performance. Few-shot learning aims to further enhance the transfer capability of CLIP by giving few images in each class, aka 'few shots'. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Yaohui Li , Qifeng Zhou , Haoxing Chen , Jianbing Zhang , Xinyu Dai , Hao Zhou

Successful continual learning of new knowledge would enable intelligent systems to recognize more and more classes of objects. However, current intelligent systems often fail to correctly recognize previously learned classes of objects when…

Computer Vision and Pattern Recognition · Computer Science 2021-08-21 Changhong Zhong , Zhiying Cui , Ruixuan Wang , Wei-Shi Zheng

The application of activity recognition in the "AI + Education" field is gaining increasing attention. However, current work mainly focuses on the recognition of activities in manually captured videos and a limited number of activity types,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Yilei Qian , Kanglei Geng , Kailong Chen , Shaoxu Cheng , Linfeng Xu , Hongliang Li , Fanman Meng , Qingbo Wu

One of the key differences between the learning mechanism of humans and Artificial Neural Networks (ANNs) is the ability of humans to learn one task at a time. ANNs, on the other hand, can only learn multiple tasks simultaneously. Any…

Machine Learning · Computer Science 2019-03-26 Khurram Javed , Faisal Shafait