中文
相关论文

相关论文: When does MAML Work the Best? An Empirical Study o…

200 篇论文

Model-agnostic meta-learning (MAML) is a meta-learning technique to train a model on a multitude of learning tasks in a way that primes the model for few-shot learning of new tasks. The MAML algorithm performs well on few-shot learning…

机器学习 · 计算机科学 2020-01-22 Harkirat Singh Behl , Atılım Güneş Baydin , Philip H. S. Torr

Model-Agnostic Meta-Learning (MAML) has become increasingly popular for training models that can quickly adapt to new tasks via one or few stochastic gradient descent steps. However, the MAML objective is significantly more difficult to…

机器学习 · 计算机科学 2022-08-11 Liam Collins , Aryan Mokhtari , Sanjay Shakkottai

Learning general representations of text is a fundamental problem for many natural language understanding (NLU) tasks. Previously, researchers have proposed to use language model pre-training and multi-task learning to learn robust…

计算与语言 · 计算机科学 2019-08-29 Zi-Yi Dou , Keyi Yu , Antonios Anastasopoulos

Natural language understanding(NLU) is challenging for finance due to the lack of annotated data and the specialized language in that domain. As a result, researchers have proposed to use pre-trained language model and multi-task learning…

计算与语言 · 计算机科学 2023-03-28 Bixing Yan , Shaoling Chen , Yuxuan He , Zhihan Li

The field of few-shot learning has recently seen substantial advancements. Most of these advancements came from casting few-shot learning as a meta-learning problem. Model Agnostic Meta Learning or MAML is currently one of the best…

机器学习 · 计算机科学 2019-03-07 Antreas Antoniou , Harrison Edwards , Amos Storkey

Recent work has suggested that a good embedding is all we need to solve many few-shot learning benchmarks. Furthermore, other work has strongly suggested that Model Agnostic Meta-Learning (MAML) also works via this same method - by learning…

机器学习 · 计算机科学 2021-12-28 Brando Miranda , Yu-Xiong Wang , Sanmi Koyejo

Meta learning aims at learning a model that can quickly adapt to unseen tasks. Widely used meta learning methods include model agnostic meta learning (MAML), implicit MAML, Bayesian MAML. Thanks to its ability of modeling uncertainty,…

机器学习 · 计算机科学 2022-03-08 Lisha Chen , Tianyi Chen

The capacity of meta-learning algorithms to quickly adapt to a variety of tasks, including ones they did not experience during meta-training, has been a key factor in the recent success of these methods on few-shot learning problems. This…

机器学习 · 计算机科学 2018-12-06 Tristan Deleu , Yoshua Bengio

In past years model-agnostic meta-learning (MAML) has been one of the most promising approaches in meta-learning. It can be applied to different kinds of problems, e.g., reinforcement learning, but also shows good results on few-shot…

机器学习 · 计算机科学 2021-05-13 Thomas Goerttler , Klaus Obermayer

Model Agnostic Meta Learning or MAML has become the standard for few-shot learning as a meta-learning problem. MAML is simple and can be applied to any model, as its name suggests. However, it often suffers from instability and…

机器学习 · 计算机科学 2024-11-04 JuneYoung Park , MinJae Kang

Model-Agnostic Meta-Learning (MAML) is one of the most successful meta-learning techniques for few-shot learning. It uses gradient descent to learn commonalities between various tasks, enabling the model to learn the meta-initialization of…

机器学习 · 计算机科学 2022-08-18 Lin Ding , Peng Liu , Wenfeng Shen , Weijia Lu , Shengbo Chen

Meta-learning has emerged as an important framework for learning new tasks from just a few examples. The success of any meta-learning model depends on (i) its fast adaptation to new tasks, as well as (ii) having a shared representation…

机器学习 · 计算机科学 2019-10-21 Daniel Jiwoong Im , Yibo Jiang , Nakul Verma

Model-agnostic meta-learning (MAML) has been recently put forth as a strategy to learn resource-poor languages in a sample-efficient fashion. Nevertheless, the properties of these languages are often not well represented by those available…

计算与语言 · 计算机科学 2021-06-03 Edoardo Maria Ponti , Rahul Aralikatte , Disha Shrivastava , Siva Reddy , Anders Søgaard

Model-agnostic meta-learning (MAML) formulates meta-learning as a bilevel optimization problem, where the inner level solves each subtask based on a shared prior, while the outer level searches for the optimal shared prior by optimizing its…

机器学习 · 计算机科学 2020-06-24 Lingxiao Wang , Qi Cai , Zhuoran Yang , Zhaoran Wang

Model-Agnostic Meta-Learning (MAML), a popular gradient-based meta-learning framework, assumes that the contribution of each task or instance to the meta-learner is equal. Hence, it fails to address the domain shift between base and novel…

机器学习 · 计算机科学 2021-12-02 Krishnateja Killamsetty , Changbin Li , Chen Zhao , Rishabh Iyer , Feng Chen

Meta-learning, or learning to learn, is a technique that can help to overcome resource scarcity in cross-lingual NLP problems, by enabling fast adaptation to new tasks. We apply model-agnostic meta-learning (MAML) to the task of…

Model-agnostic meta-learning (MAML) has emerged as one of the most successful meta-learning techniques in few-shot learning. It enables us to learn a meta-initialization} of model parameters (that we call meta-model) to rapidly adapt to new…

机器学习 · 计算机科学 2021-02-23 Ren Wang , Kaidi Xu , Sijia Liu , Pin-Yu Chen , Tsui-Wei Weng , Chuang Gan , Meng Wang

Current deep learning based text classification methods are limited by their ability to achieve fast learning and generalization when the data is scarce. We address this problem by integrating a meta-learning procedure that uses the…

Meta-learning methods have shown an impressive ability to train models that rapidly learn new tasks. However, these methods only aim to perform well in expectation over tasks coming from some particular distribution that is typically…

机器学习 · 计算机科学 2020-06-22 Liam Collins , Aryan Mokhtari , Sanjay Shakkottai

Neural networks require a large amount of annotated data to learn. Meta-learning algorithms propose a way to decrease the number of training samples to only a few. One of the most prominent optimization-based meta-learning algorithms is…

机器学习 · 计算机科学 2022-06-14 Kostiantyn Khabarlak
‹ 上一页 1 2 3 10 下一页 ›