English
Related papers

Related papers: Supervised Momentum Contrastive Learning for Few-S…

200 papers

Contrastive learning applied to self-supervised representation learning has seen a resurgence in recent years, leading to state of the art performance in the unsupervised training of deep image models. Modern batch contrastive approaches…

Machine Learning · Computer Science 2021-03-12 Prannay Khosla , Piotr Teterwak , Chen Wang , Aaron Sarna , Yonglong Tian , Phillip Isola , Aaron Maschinot , Ce Liu , Dilip Krishnan

Conventional training of deep neural networks usually requires a substantial amount of data with expensive human annotations. In this paper, we utilize the idea of meta-learning to explain two very different streams of few-shot learning,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Shaobo Lin , Xingyu Zeng , Rui Zhao

Contrastive learning has become an important tool in learning representations from unlabeled data mainly relying on the idea of minimizing distance between positive data pairs, e.g., views from the same images, and maximizing distance…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Nina Shvetsova , Felix Petersen , Anna Kukleva , Bernt Schiele , Hilde Kuehne

We address the problem of few-shot semantic segmentation (FSS), which aims to segment novel class objects in a target image with a few annotated samples. Though recent advances have been made by incorporating prototype-based metric…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Hyeongjun Kwon , Somi Jeong , Sunok Kim , Kwanghoon Sohn

Scaling up visual category recognition to large numbers of classes remains challenging. A promising research direction is zero-shot learning, which does not require any training data to recognize new classes, but rather relies on some form…

Computer Vision and Pattern Recognition · Computer Science 2016-04-12 Zeynep Akata , Mateusz Malinowski , Mario Fritz , Bernt Schiele

Unsupervised meta-learning aims to learn feature representations from unsupervised datasets that can transfer to downstream tasks with limited labeled data. In this paper, we propose a novel approach to unsupervised meta-learning that…

Machine Learning · Computer Science 2025-02-11 Anna Vettoruzzo , Lorenzo Braccaioli , Joaquin Vanschoren , Marlena Nowaczyk

Few-shot learning or meta-learning leverages the data scarcity problem in machine learning. Traditionally, training data requires a multitude of samples and labeling for supervised learning. To address this issue, we propose a one-shot…

Machine Learning · Computer Science 2023-10-23 Atik Faysal , Mohammad Rostami , Huaxia Wang , Avimanyu Sahoo , Ryan Antle

While few-shot learning (FSL) aims for rapid generalization to new concepts with little supervision, self-supervised learning (SSL) constructs supervisory signals directly computed from unlabeled data. Exploiting the complementarity of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Zhengyu Chen , Jixie Ge , Heshen Zhan , Siteng Huang , Donglin Wang

Few-shot learning aims to generalize to novel classes with only a few samples with class labels. Research in few-shot learning has borrowed techniques from transfer learning, metric learning, meta-learning, and Bayesian methods. These…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Jaya Krishna Mandivarapu , Eric bunch , Glenn fung

Contrastive learning has shown remarkable results in recent self-supervised approaches for visual representation. By learning to contrast positive pairs' representation from the corresponding negatives pairs, one can train good visual…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Sungnyun Kim , Gihun Lee , Sangmin Bae , Se-Young Yun

We are interested in developing a unified machine learning model over many mobile devices for practical learning tasks, where each device only has very few training data. This is a commonly encountered situation in mobile computing…

Machine Learning · Computer Science 2021-04-02 Chenyou Fan , Jianwei Huang

The goal of few-shot classification is to learn a model that can classify novel classes using only a few training examples. Despite the promising results shown by existing meta-learning algorithms in solving the few-shot classification…

Machine Learning · Computer Science 2020-11-03 Shuman Peng , Weilian Song , Martin Ester

Time-series representation learning can extract representations from data with temporal dynamics and sparse labels. When labeled data are sparse but unlabeled data are abundant, contrastive learning, i.e., a framework to learn a latent…

Machine Learning · Computer Science 2023-03-03 Heejeong Choi , Pilsung Kang

The performance of meta-learning approaches for few-shot learning generally depends on three aspects: features suitable for comparison, the classifier ( base learner ) suitable for low-data scenarios, and valuable information from the…

Machine Learning · Computer Science 2020-09-15 Haoqing Wang , Zhi-Hong Deng

The prompt has become an effective linguistic tool for utilizing pre-trained language models. However, in few-shot scenarios, subtle changes in the prompt design always make the result widely different, and the prompt learning methods also…

Computation and Language · Computer Science 2024-03-13 Jinta Weng , Yifan Deng , d Donghao Li , Hao You , Yue Hu , Heyan Huang

Few-shot object detection aims to detect instances of specific categories in a query image with only a handful of support samples. Although this takes less effort than obtaining enough annotated images for supervised object detection, it…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Hojun Lee , Myunggi Lee , Nojun Kwak

Few-shot learning aims to classify unseen classes with only a limited number of labeled data. Recent works have demonstrated that training models with a simple transfer learning strategy can achieve competitive results in few-shot…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Jingquan Wang , Jing Xu , Yu Pan , Zenglin Xu

Few-shot class-incremental learning (FSCIL) presents the primary challenge of balancing underfitting to a new session's task and forgetting the tasks from previous sessions. To address this challenge, we develop a simple yet powerful…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 In-Ug Yoon , Tae-Min Choi , Young-Min Kim , Jong-Hwan Kim

Few-shot classification is a challenging task which aims to formulate the ability of humans to learn concepts from limited prior data and has drawn considerable attention in machine learning. Recent progress in few-shot classification has…

Machine Learning · Computer Science 2020-04-14 Meiyu Huang , Xueshuang Xiang , Yao Xu

Few-shot segmentation (FSS) is a dense prediction task that aims to infer the pixel-wise labels of unseen classes using only a limited number of annotated images. The key challenge in FSS is to classify the labels of query pixels using…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Wenbo Xu , Huaxi Huang , Ming Cheng , Litao Yu , Qiang Wu , Jian Zhang