English
Related papers

Related papers: Accelerating Neural Self-Improvement via Bootstrap…

200 papers

In real-world applications, data do not reflect the ones commonly used for neural networks training, since they are usually few, unlabeled and can be available as a stream. Hence many existing deep learning solutions suffer from a limited…

Machine Learning · Computer Science 2020-11-18 Alessia Bertugli , Stefano Vincenzi , Simone Calderara , Andrea Passerini

Semi-supervised few-shot learning consists in training a classifier to adapt to new tasks with limited labeled data and a fixed quantity of unlabeled data. Many sophisticated methods have been developed to address the challenges this…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Xiu-Shen Wei , He-Yang Xu , Faen Zhang , Yuxin Peng , Wei Zhou

Deep Learning shows very good performance when trained on large labeled data sets. The problem of training a deep net on a few or one sample per class requires a different learning approach which can generalize to unseen classes using only…

Machine Learning · Computer Science 2018-08-23 Jinchao Liu , Stuart J. Gibson , Margarita Osadchy

Few-shot learning-the ability to train models with access to limited data-has become increasingly popular in the natural language processing (NLP) domain, as large language models such as GPT and T0 have been empirically shown to achieve…

Software Engineering · Computer Science 2023-06-16 Robert Kraig Helmeczi , Mucahit Cevik , Savas Yıldırım

Training a neural network model that can quickly adapt to a new task is highly desirable yet challenging for few-shot learning problems. Recent few-shot learning methods mostly concentrate on developing various meta-learning strategies from…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Zihang Jiang , Bingyi Kang , Kuangqi Zhou , Jiashi Feng

Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Qianru Sun , Yaoyao Liu , Tat-Seng Chua , Bernt Schiele

We study the few-shot learning (FSL) problem, where a model learns to recognize new objects with extremely few labeled training data per category. Most of previous FSL approaches resort to the meta-learning paradigm, where the model…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Zejiang Hou , Sun-Yuan Kung

Many meta-learning approaches for few-shot learning rely on simple base learners such as nearest-neighbor classifiers. However, even in the few-shot regime, discriminatively trained linear predictors can offer better generalization. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 Kwonjoon Lee , Subhransu Maji , Avinash Ravichandran , Stefano Soatto

Modern deep learning requires large-scale extensively labelled datasets for training. Few-shot learning aims to alleviate this issue by learning effectively from few labelled examples. In previously proposed few-shot visual classifiers, it…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Peyman Bateni , Jarred Barber , Raghav Goyal , Vaden Masrani , Jan-Willem van de Meent , Leonid Sigal , Frank Wood

Meta-learning has received a tremendous recent attention as a possible approach for mimicking human intelligence, i.e., acquiring new knowledge and skills with little or even no demonstration. Most of the existing meta-learning methods are…

Machine Learning · Computer Science 2019-05-24 Fan Zhou , Chengtai Cao , Kunpeng Zhang , Goce Trajcevski , Ting Zhong , Ji Geng

Few-shot learning aims at rapidly adapting to novel categories with only a handful of samples at test time, which has been predominantly tackled with the idea of meta-learning. However, meta-learning approaches essentially learn across a…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Jinhai Yang , Hua Yang , Lin Chen

Deep neural networks have been able to outperform humans in some cases like image recognition and image classification. However, with the emergence of various novel categories, the ability to continuously widen the learning capability of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Nihar Bendre , Hugo Terashima Marín , Peyman Najafirad

The goal of this paper is to bypass the need for labelled examples in few-shot video understanding at run time. While proven effective, in many practical video settings even labelling a few examples appears unrealistic. This is especially…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Pengwan Yang , Yuki M. Asano , Pascal Mettes , Cees G. M. Snoek

The ability to learn new concepts with small amounts of data is a critical aspect of intelligence that has proven challenging for deep learning methods. Meta-learning has emerged as a promising technique for leveraging data from previous…

Machine Learning · Computer Science 2020-04-29 Mingzhang Yin , George Tucker , Mingyuan Zhou , Sergey Levine , Chelsea Finn

Just like other few-shot learning problems, few-shot segmentation aims to minimize the need for manual annotation, which is particularly costly in segmentation tasks. Even though the few-shot setting reduces this cost for novel test…

Computer Vision and Pattern Recognition · Computer Science 2021-11-04 Mustafa Sercan Amac , Ahmet Sencan , Orhun Bugra Baran , Nazli Ikizler-Cinbis , Ramazan Gokberk Cinbis

Few-shot learners aim to recognize new object classes based on a small number of labeled training examples. To prevent overfitting, state-of-the-art few-shot learners use meta-learning on convolutional-network features and perform…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Yan Wang , Wei-Lun Chao , Kilian Q. Weinberger , Laurens van der Maaten

We present a technique to improve the transferability of deep representations learned on small labeled datasets by introducing self-supervised tasks as auxiliary loss functions. While recent approaches for self-supervised learning have…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Jong-Chyi Su , Subhransu Maji , Bharath Hariharan

Despite its astounding success in learning deeper multi-dimensional data, the performance of deep learning declines on new unseen tasks mainly due to its focus on same-distribution prediction. Moreover, deep learning is notorious for poor…

Machine Learning · Computer Science 2023-03-15 Hassan Gharoun , Fereshteh Momenifar , Fang Chen , Amir H. Gandomi

Meta-learning has been the most common framework for few-shot learning in recent years. It learns the model from collections of few-shot classification tasks, which is believed to have a key advantage of making the training objective…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Yinbo Chen , Zhuang Liu , Huijuan Xu , Trevor Darrell , Xiaolong Wang

Pre-trained vision-language models learn massive data to model unified representations of images and natural languages, which can be widely applied to downstream machine learning tasks. In addition to zero-shot inference, in order to better…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Qian-Wei Wang , Yuqiu Xie , Letian Zhang , Zimo Liu , Shu-Tao Xia