English
Related papers

Related papers: Self-supervised Knowledge Distillation for Few-sho…

200 papers

Semi-supervised few-shot learning consists in training a classifier to adapt to new tasks with limited labeled data and a fixed quantity of unlabeled data. Many sophisticated methods have been developed to address the challenges this…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Xiu-Shen Wei , He-Yang Xu , Faen Zhang , Yuxin Peng , Wei Zhou

Few-shot learning (FSL) aims to learn models that generalize to novel classes with limited training samples. Recent works advance FSL towards a scenario where unlabeled examples are also available and propose semi-supervised FSL methods.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Linglan Zhao , Dashan Guo , Yunlu Xu , Liang Qiao , Zhanzhan Cheng , Shiliang Pu , Yi Niu , Xiangzhong Fang

Few-shot learning (FSL) aims to enable models to recognize novel objects or classes with limited labelled data. Feature generators, which synthesize new data points to augment limited datasets, have emerged as a promising solution to this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Heethanjan Kanagalingam , Thenukan Pathmanathan , Navaneethan Ketheeswaran , Mokeeshan Vathanakumar , Mohamed Afham , Ranga Rodrigo

With the exponential increase in image data, training an image restoration model is laborious. Dataset distillation is a potential solution to this problem, yet current distillation techniques are a blank canvas in the field of image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Zhuoran Zheng , Xin Su , Chen Wu , Xiuyi Jia

Meta-learning has been extensively applied in the domains of few-shot learning and fast adaptation, achieving remarkable performance. While Meta-learning methods like Model-Agnostic Meta-Learning (MAML) and its variants provide a good set…

Machine Learning · Computer Science 2024-08-09 Runxi Cheng , Yongxian Wei , Xianglong He , Wanyun Zhu , Songsong Huang , Fei Richard Yu , Fei Ma , Chun Yuan

Real-world imagery is often characterized by a significant imbalance of the number of images per class, leading to long-tailed distributions. An effective and simple approach to long-tailed visual recognition is to learn feature…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Ahmet Iscen , André Araujo , Boqing Gong , Cordelia Schmid

The goal of this paper is to bypass the need for labelled examples in few-shot video understanding at run time. While proven effective, in many practical video settings even labelling a few examples appears unrealistic. This is especially…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Pengwan Yang , Yuki M. Asano , Pascal Mettes , Cees G. M. Snoek

The conventional few-shot classification aims at learning a model on a large labeled base dataset and rapidly adapting to a target dataset that is from the same distribution as the base dataset. However, in practice, the base and the target…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Hao Zheng , Runqi Wang , Jianzhuang Liu , Asako Kanezaki

Discrete diffusion models (DDMs) have shown powerful generation ability for discrete data modalities like text and molecules. However, their practical application is hindered by inefficient sampling, requiring a large number of sampling…

Machine Learning · Computer Science 2025-09-25 Feiyang Fu , Tongxian Guo , Zhaoqiang Liu

Dataset distillation seeks to synthesize a highly compact dataset that achieves performance comparable to the original dataset on downstream tasks. For the classification task that use pre-trained self-supervised models as backbones,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Qianxin Xia , Jiawei Du , Xin Zhang , Yuhan Zhang , Jielei Wang , Guoming Lu

Few-shot learning models learn representations with limited human annotations, and such a learning paradigm demonstrates practicability in various tasks, e.g., image classification, object detection, etc. However, few-shot object detection…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Jiangmeng Li , Yanan Zhang , Wenwen Qiang , Lingyu Si , Chengbo Jiao , Xiaohui Hu , Changwen Zheng , Fuchun Sun

Few-shot learning addresses the challenge of learning how to address novel tasks given not just limited supervision but limited data as well. An attractive solution is synthetic data generation. However, most such methods are overly…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Michalis Lazarou , Tania Stathaki , Yannis Avrithis

Few-shot learning amounts to learning representations and acquiring knowledge such that novel tasks may be solved with both supervision and data being limited. Improved performance is possible by transductive inference, where the entire…

Machine Learning · Computer Science 2023-03-29 Michalis Lazarou , Tania Stathaki , Yannis Avrithis

Prototypical network for Few shot learning tries to learn an embedding function in the encoder that embeds images with similar features close to one another in the embedding space. However, in this process, the support set samples for a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Manas Gogoi , Sambhavi Tiwari , Shekhar Verma

In continual learning, there is a serious problem of catastrophic forgetting, in which previous knowledge is forgotten when a model learns new tasks. Various methods have been proposed to solve this problem. Replay methods which replay data…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Kotaro Nagata , Hiromu Ono , Kazuhiro Hotta

The ability to quickly recognize and learn new visual concepts from limited samples enables humans to swiftly adapt to new environments. This ability is enabled by semantic associations of novel concepts with those that have already been…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Zitian Chen , Yanwei Fu , Yinda Zhang , Yu-Gang Jiang , Xiangyang Xue , Leonid Sigal

Few-shot object detection (FSOD) aims at extending a generic detector for novel object detection with only a few training examples. It attracts great concerns recently due to the practical meanings. Meta-learning has been demonstrated to be…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Zichen Wang , Bo Yang , Haonan Yue , Zhenghao Ma

Meta-learning offers a promising avenue for few-shot learning (FSL), enabling models to glean a generalizable feature embedding through episodic training on synthetic FSL tasks in a source domain. Yet, in practical scenarios where the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Fei Zhou , Peng Wang , Lei Zhang , Zhenghua Chen , Wei Wei , Chen Ding , Guosheng Lin , Yanning Zhang

Knowledge distillation (KD) is a valuable technique for compressing large deep learning models into smaller, edge-suitable networks. However, conventional KD frameworks rely on pre-trained high-capacity teacher networks, which introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Hongjun Choi , Eun Som Jeon , Ankita Shukla , Pavan Turaga

Phase retrieval (PR) reconstructs phase information from magnitude measurements, known as coded diffraction patterns (CDPs), whose quality depends on the number of snapshots captured using coded phase masks. High-quality phase estimation…

Image and Video Processing · Electrical Eng. & Systems 2025-08-25 Karen Fonseca , Leon Suarez-Rodriguez , Andres Jerez , Felipe Gutierrez-Barragan , Henry Arguello