English
Related papers

Related papers: Theoretical Convergence of Multi-Step Model-Agnost…

200 papers

In this paper, we establish the ordinary differential equation (ODE) that underlies the training dynamics of Model-Agnostic Meta-Learning (MAML). Our continuous-time limit view of the process eliminates the influence of the manually chosen…

Machine Learning · Statistics 2020-07-09 Ruitu Xu , Lin Chen , Amin Karbasi

Model-agnostic meta-learning (MAML) has emerged as one of the most successful meta-learning techniques in few-shot learning. It enables us to learn a meta-initialization} of model parameters (that we call meta-model) to rapidly adapt to new…

Machine Learning · Computer Science 2021-02-23 Ren Wang , Kaidi Xu , Sijia Liu , Pin-Yu Chen , Tsui-Wei Weng , Chuang Gan , Meng Wang

Model-agnostic meta learning (MAML) is currently one of the dominating approaches for few-shot meta-learning. Albeit its effectiveness, the optimization of MAML can be challenging due to the innate bilevel problem structure. Specifically,…

Machine Learning · Computer Science 2022-08-16 Momin Abbas , Quan Xiao , Lisha Chen , Pin-Yu Chen , Tianyi Chen

Gradient-based meta-learners such as MAML are able to learn a meta-prior from similar tasks to adapt to novel tasks from the same distribution with few gradient updates. One important limitation of such frameworks is that they seek a common…

Machine Learning · Computer Science 2018-12-19 Risto Vuorio , Shao-Hua Sun , Hexiang Hu , Joseph J. Lim

Although model-agnostic meta-learning (MAML) is a very successful algorithm in meta-learning practice, it can have high computational cost because it updates all model parameters over both the inner loop of task-specific adaptation and the…

Machine Learning · Computer Science 2020-10-26 Kaiyi Ji , Jason D. Lee , Yingbin Liang , H. Vincent Poor

Model-Agnostic Meta-Learning (MAML) and its variants are popular few-shot classification methods. They train an initializer across a variety of sampled learning tasks (also known as episodes) such that the initialized model can adapt…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Yangbin Chen , Yun Ma , Tom Ko , Jianping Wang , Qing Li

There is a growing interest in the learning-to-learn paradigm, also known as meta-learning, where models infer on new tasks using a few training examples. Recently, meta-learning based methods have been widely used in few-shot…

Machine Learning · Computer Science 2024-03-13 Anish Madan , Ranjitha Prasad

Meta learning aims at learning a model that can quickly adapt to unseen tasks. Widely used meta learning methods include model agnostic meta learning (MAML), implicit MAML, Bayesian MAML. Thanks to its ability of modeling uncertainty,…

Machine Learning · Computer Science 2022-03-08 Lisha Chen , Tianyi Chen

Model Agnostic Meta-Learning (MAML) has emerged as a standard framework for meta-learning, where a meta-model is learned with the ability of fast adapting to new tasks. However, as a double-looped optimization problem, MAML needs to…

Machine Learning · Computer Science 2021-02-10 Yufan Zhou , Zhenyi Wang , Jiayi Xian , Changyou Chen , Jinhui Xu

In past years model-agnostic meta-learning (MAML) has been one of the most promising approaches in meta-learning. It can be applied to different kinds of problems, e.g., reinforcement learning, but also shows good results on few-shot…

Machine Learning · Computer Science 2021-05-13 Thomas Goerttler , Klaus Obermayer

Meta-learning has emerged as an important framework for learning new tasks from just a few examples. The success of any meta-learning model depends on (i) its fast adaptation to new tasks, as well as (ii) having a shared representation…

Machine Learning · Computer Science 2019-10-21 Daniel Jiwoong Im , Yibo Jiang , Nakul Verma

Model-Agnostic Meta-Learning (MAML), a model-agnostic meta-learning method, is successfully employed in NLP applications including few-shot text classification and multi-domain low-resource language generation. Many impacting factors,…

Computation and Language · Computer Science 2024-04-25 Zequn Liu , Ruiyi Zhang , Yiping Song , Wei Ju , Ming Zhang

Meta-Reinforcement Learning (Meta-RL) aims to acquire meta-knowledge for quick adaptation to diverse tasks. However, applying these policies in real-world environments presents a significant challenge in balancing rapid adaptability with…

Machine Learning · Computer Science 2024-06-21 Karam Daaboul , Florian Kuhm , Tim Joseph , J. Marius Zoellner

Model agnostic meta-learning (MAML) is a popular state-of-the-art meta-learning algorithm that provides good weight initialization of a model given a variety of learning tasks. The model initialized by provided weight can be fine-tuned to…

Machine Learning · Computer Science 2021-06-11 Thanh Nguyen , Tung Luu , Trung Pham , Sanzhar Rakhimkul , Chang D. Yoo

The capacity of meta-learning algorithms to quickly adapt to a variety of tasks, including ones they did not experience during meta-training, has been a key factor in the recent success of these methods on few-shot learning problems. This…

Machine Learning · Computer Science 2018-12-06 Tristan Deleu , Yoshua Bengio

We propose an algorithm for meta-learning that is model-agnostic, in the sense that it is compatible with any model trained with gradient descent and applicable to a variety of different learning problems, including classification,…

Machine Learning · Computer Science 2017-07-19 Chelsea Finn , Pieter Abbeel , Sergey Levine

The field of few-shot learning has recently seen substantial advancements. Most of these advancements came from casting few-shot learning as a meta-learning problem. Model Agnostic Meta Learning or MAML is currently one of the best…

Machine Learning · Computer Science 2019-03-07 Antreas Antoniou , Harrison Edwards , Amos Storkey

Model-Agnostic Meta-Learning (MAML) and its variants have achieved success in meta-learning tasks on many datasets and settings. On the other hand, we have just started to understand and analyze how they are able to adapt fast to new tasks.…

Machine Learning · Computer Science 2021-01-26 Sébastien M. R. Arnold , Shariq Iqbal , Fei Sha

Meta-learning algorithms enable rapid adaptation to new tasks with minimal data, a critical capability for real-world robotic systems. This paper evaluates Model-Agnostic Meta-Learning (MAML) combined with Trust Region Policy Optimization…

Robotics · Computer Science 2025-11-18 Sanjar Atamuradov

Meta Learning has been in focus in recent years due to the meta-learner model's ability to adapt well and generalize to new tasks, thus, reducing both the time and data requirements for learning. However, a major drawback of meta learner is…

Machine Learning · Computer Science 2021-10-28 Varad Pimpalkhute , Amey Pandit , Mayank Mishra , Rekha Singhal