English
Related papers

Related papers: What Matters For Meta-Learning Vision Regression T…

200 papers

In real-world applications, data do not reflect the ones commonly used for neural networks training, since they are usually few, unlabeled and can be available as a stream. Hence many existing deep learning solutions suffer from a limited…

Machine Learning · Computer Science 2020-11-18 Alessia Bertugli , Stefano Vincenzi , Simone Calderara , Andrea Passerini

Meta-learning algorithms use past experience to learn to quickly solve new tasks. In the context of reinforcement learning, meta-learning algorithms acquire reinforcement learning procedures to solve new problems more efficiently by…

Machine Learning · Computer Science 2020-05-01 Abhishek Gupta , Benjamin Eysenbach , Chelsea Finn , Sergey Levine

Meta-learning has gained wide popularity as a training framework that is more data-efficient than traditional machine learning methods. However, its generalization ability in complex task distributions, such as multimodal tasks, has not…

Machine Learning · Computer Science 2022-05-10 Yao Ma , Shilin Zhao , Weixiao Wang , Yaoman Li , Irwin King

This work proposes Multi-task Meta Learning (MTML), integrating two learning paradigms Multi-Task Learning (MTL) and meta learning, to bring together the best of both worlds. In particular, it focuses simultaneous learning of multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Richa Upadhyay , Prakash Chandra Chhipa , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki

The use of meta-learning and transfer learning in the task of few-shot image classification is a well researched area with many papers showcasing the advantages of transfer learning over meta-learning in cases where data is plentiful and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Joshua Ball

Meta learning is a promising solution to few-shot learning problems. However, existing meta learning methods are restricted to the scenarios where training and application tasks share the same out-put structure. To obtain a meta model…

Machine Learning · Computer Science 2019-04-22 Yingtian Zou , Jiashi Feng

We propose regression networks for the problem of few-shot classification, where a classifier must generalize to new classes not seen in the training set, given only a small number of examples of each class. In high dimensional embedding…

Machine Learning · Computer Science 2020-06-22 Arnout Devos , Matthias Grossglauser

In few-shot learning scenarios, the challenge is to generalize and perform well on new unseen examples when only very few labeled examples are available for each task. Model-agnostic meta-learning (MAML) has gained the popularity as one of…

Machine Learning · Computer Science 2021-10-19 Sungyong Baik , Janghoon Choi , Heewon Kim , Dohee Cho , Jaesik Min , Kyoung Mu Lee

Neural network-based anomaly detection methods have shown to achieve high performance. However, they require a large amount of training data for each task. We propose a neural network-based meta-learning method for supervised anomaly…

Machine Learning · Statistics 2021-03-02 Tomoharu Iwata , Atsutoshi Kumagai

Deep neural networks (DNNs) have achieved state-of-the-art results on time series classification (TSC) tasks. In this work, we focus on leveraging DNNs in the often-encountered practical scenario where access to labeled training data is…

Machine Learning · Computer Science 2021-03-05 Jyoti Narwariya , Pankaj Malhotra , Lovekesh Vig , Gautam Shroff , Vishnu Tv

Existing meta-learning based few-shot learning (FSL) methods typically adopt an episodic training strategy whereby each episode contains a meta-task. Across episodes, these tasks are sampled randomly and their relationships are ignored. In…

Machine Learning · Computer Science 2020-09-29 Nanyi Fei , Zhiwu Lu , Yizhao Gao , Jia Tian , Tao Xiang , Ji-Rong Wen

Meta-learning algorithms are widely used for few-shot learning. For example, image recognition systems that readily adapt to unseen classes after seeing only a few labeled examples. Despite their success, we show that modern meta-learning…

Machine Learning · Computer Science 2021-10-28 Mayank Agarwal , Mikhail Yurochkin , Yuekai Sun

The goal of meta-learning is to train a model on a variety of learning tasks, such that it can adapt to new problems within only a few iterations. Here we propose a principled information-theoretic model that optimally partitions the…

Machine Learning · Statistics 2020-09-10 Heinke Hihn , Daniel A. Braun

Meta-learning approaches enable machine learning systems to adapt to new tasks given few examples by leveraging knowledge from related tasks. However, a large number of meta-training tasks are still required for generalization to unseen…

Machine Learning · Computer Science 2024-10-24 Seanie Lee , Bruno Andreis , Kenji Kawaguchi , Juho Lee , Sung Ju Hwang

Meta-learning aims at learning quickly on novel tasks with limited data by transferring generic experience learned from previous tasks. Naturally, few-shot learning has been one of the most popular applications for meta-learning. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Yudong Chen , Chaoyu Guan , Zhikun Wei , Xin Wang , Wenwu Zhu

We explore the behavior of a standard convolutional neural net in a continual-learning setting that introduces visual classification tasks sequentially and requires the net to master new tasks while preserving mastery of previously learned…

Machine Learning · Computer Science 2020-04-01 Guy Davidson , Michael C. Mozer

Meta-learning has been the most common framework for few-shot learning in recent years. It learns the model from collections of few-shot classification tasks, which is believed to have a key advantage of making the training objective…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Yinbo Chen , Zhuang Liu , Huijuan Xu , Trevor Darrell , Xiaolong Wang

The capacity of meta-learning algorithms to quickly adapt to a variety of tasks, including ones they did not experience during meta-training, has been a key factor in the recent success of these methods on few-shot learning problems. This…

Machine Learning · Computer Science 2018-12-06 Tristan Deleu , Yoshua Bengio

Self-supervised learning has been successfully applied to pre-train video representations, which aims at efficient adaptation from pre-training domain to downstream tasks. Existing approaches merely leverage contrastive loss to learn…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Yuanze Lin , Xun Guo , Yan Lu

In this paper, we propose a learning algorithm that enables a model to quickly exploit commonalities among related tasks from an unseen task distribution, before quickly adapting to specific tasks from that same distribution. We investigate…

Machine Learning · Computer Science 2021-07-21 Arnout Devos , Yatin Dandi