English
Related papers

Related papers: Improving Few-Shot Learning through Multi-task Rep…

200 papers

Controlling the generative model to adapt a new domain with limited samples is a difficult challenge and it is receiving increasing attention. Recently, methods based on meta-learning have shown promising results for few-shot domain…

Computation and Language · Computer Science 2023-09-07 Pengsen Cheng , Jinqiao Dai , Jiamiao Liu , Jiayong Liu , Peng Jia

A meta-model is trained on a distribution of similar tasks such that it learns an algorithm that can quickly adapt to a novel task with only a handful of labeled examples. Most of current meta-learning methods assume that the meta-training…

Machine Learning · Computer Science 2019-04-12 Minseop Park , Jungtaek Kim , Saehoon Kim , Yanbin Liu , Seungjin Choi

Graph few-shot learning is of great importance among various graph learning tasks. Under the few-shot scenario, models are often required to conduct classification given limited labeled samples. Existing graph few-shot learning methods…

Machine Learning · Computer Science 2022-10-24 Song Wang , Chen Chen , Jundong Li

Few-shot Learning aims to learn and distinguish new categories with a very limited number of available images, presenting a significant challenge in the realm of deep learning. Recent researchers have sought to leverage the additional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Chunpeng Zhou , Haishuai Wang , Xilu Yuan , Zhi Yu , Jiajun Bu

Learning high quality class representations from few examples is a key problem in metric-learning approaches to few-shot learning. To accomplish this, we introduce a novel architecture where class representations are conditioned for each…

Machine Learning · Computer Science 2018-02-14 Nathan Hilliard , Lawrence Phillips , Scott Howland , Artëm Yankov , Courtney D. Corley , Nathan O. Hodas

Few-shot algorithms aim at learning new tasks provided only a handful of training examples. In this work we investigate few-shot learning in the setting where the data points are sequences of tokens and propose an efficient learning…

Machine Learning · Computer Science 2020-12-18 Lajanugen Logeswaran , Ann Lee , Myle Ott , Honglak Lee , Marc'Aurelio Ranzato , Arthur Szlam

Majority of the modern meta-learning methods for few-shot classification tasks operate in two phases: a meta-training phase where the meta-learner learns a generic representation by solving multiple few-shot tasks sampled from a large…

Machine Learning · Computer Science 2020-04-23 Qing Liu , Orchid Majumder , Alessandro Achille , Avinash Ravichandran , Rahul Bhotika , Stefano Soatto

Few-Shot Learning is the challenge of training a model with only a small amount of data. Many solutions to this problem use meta-learning algorithms, i.e. algorithms that learn to learn. By sampling few-shot tasks from a larger dataset, we…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Etienne Bennequin

Pre-training text representations has recently been shown to significantly improve the state-of-the-art in many natural language processing tasks. The central goal of pre-training is to learn text representations that are useful for…

Computation and Language · Computer Science 2020-04-14 Shangwen Lv , Yuechen Wang , Daya Guo , Duyu Tang , Nan Duan , Fuqing Zhu , Ming Gong , Linjun Shou , Ryan Ma , Daxin Jiang , Guihong Cao , Ming Zhou , Songlin Hu

Recent work on few-shot learning \cite{tian2020rethinking} showed that quality of learned representations plays an important role in few-shot classification performance. On the other hand, the goal of self-supervised learning is to recover…

Machine Learning · Computer Science 2021-01-26 Nathaniel Simard , Guillaume Lagrange

The task of segmentation of multispectral images, which are images with numerous channels or bands, each capturing a specific range of wavelengths of electromagnetic radiation, has been previously explored in contexts with large amounts of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Dilith Jayakody , Thanuja Ambegoda

Much like humans, robots should have the ability to leverage knowledge from previously learned tasks in order to learn new tasks quickly in new and unfamiliar environments. Despite this, most robot learning approaches have focused on…

Robotics · Computer Science 2018-10-09 Stephen James , Michael Bloesch , Andrew J. Davison

Representation learning based on multi-task pretraining has become a powerful approach in many domains. In particular, task-aware representation learning aims to learn an optimal representation for a specific target task by sampling data…

Machine Learning · Computer Science 2023-06-16 Yifang Chen , Yingbing Huang , Simon S. Du , Kevin Jamieson , Guanya Shi

In this paper, we propose an approach to improve few-shot classification performance using a composite rotation based auxiliary task. Few-shot classification methods aim to produce neural networks that perform well for classes with a large…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Pratik Mazumder , Pravendra Singh , Vinay P. Namboodiri

Reinforcement learning methods can achieve significant performance but require a large amount of training data collected on the same robotic platform. A policy trained with expensive data is rendered useless after making even a minor change…

Robotics · Computer Science 2021-03-08 Ali Ghadirzadeh , Xi Chen , Petra Poklukar , Chelsea Finn , Mårten Björkman , Danica Kragic

Few-shot learning is often motivated by the ability of humans to learn new tasks from few examples. However, standard few-shot classification benchmarks assume that the representation is learned on a limited amount of base class data,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Yann Lifchitz , Yannis Avrithis , Sylvaine Picard

Multi-task learning (MTL) aims to improve generalization performance by learning multiple related tasks simultaneously. While sometimes the underlying task relationship structure is known, often the structure needs to be estimated from data…

Meta-learning is a popular framework for learning with limited data in which an algorithm is produced by training over multiple few-shot learning tasks. For classification problems, these tasks are typically constructed by sampling a small…

Machine Learning · Computer Science 2021-10-08 Amrith Setlur , Oscar Li , Virginia Smith

The goal of few-shot learning is to classify unseen categories with few labeled samples. Recently, the low-level information metric-learning based methods have achieved satisfying performance, since local representations (LRs) are more…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Haoxing Chen , Huaxiong Li , Yaohui Li , Chunlin Chen

Reinforcement learning and planning methods require an objective or reward function that encodes the desired behavior. Yet, in practice, there is a wide range of scenarios where an objective is difficult to provide programmatically, such as…

Machine Learning · Computer Science 2018-10-02 Annie Xie , Avi Singh , Sergey Levine , Chelsea Finn