中文
相关论文

相关论文: Negative Inner-Loop Learning Rates Learn Universal…

200 篇论文

Deep learning models require a large amount of data to perform well. When data is scarce for a target task, we can transfer the knowledge gained by training on similar tasks to quickly learn the target. A successful approach is…

机器学习 · 计算机科学 2021-03-18 Alberto Bernacchia

Despite the superior empirical success of deep meta-learning, theoretical understanding of overparameterized meta-learning is still limited. This paper studies the generalization of a widely used meta-learning approach, Model-Agnostic…

机器学习 · 计算机科学 2022-06-22 Yu Huang , Yingbin Liang , Longbo Huang

The capacity of meta-learning algorithms to quickly adapt to a variety of tasks, including ones they did not experience during meta-training, has been a key factor in the recent success of these methods on few-shot learning problems. This…

机器学习 · 计算机科学 2018-12-06 Tristan Deleu , Yoshua Bengio

Model-Agnostic Meta-Learning (MAML) has become increasingly popular for training models that can quickly adapt to new tasks via one or few stochastic gradient descent steps. However, the MAML objective is significantly more difficult to…

机器学习 · 计算机科学 2022-08-11 Liam Collins , Aryan Mokhtari , Sanjay Shakkottai

Neural networks require a large amount of annotated data to learn. Meta-learning algorithms propose a way to decrease the number of training samples to only a few. One of the most prominent optimization-based meta-learning algorithms is…

机器学习 · 计算机科学 2022-06-14 Kostiantyn Khabarlak

Model Agnostic Meta Learning or MAML has become the standard for few-shot learning as a meta-learning problem. MAML is simple and can be applied to any model, as its name suggests. However, it often suffers from instability and…

机器学习 · 计算机科学 2024-11-04 JuneYoung Park , MinJae Kang

Optimization-based meta-learning aims to learn an initialization so that a new unseen task can be learned within a few gradient updates. Model Agnostic Meta-Learning (MAML) is a benchmark algorithm comprising two optimization loops. The…

机器学习 · 计算机科学 2024-05-28 S. Tiwari , M. Gogoi , S. Verma , K. P. Singh

An important research direction in machine learning has centered around developing meta-learning algorithms to tackle few-shot learning. An especially successful algorithm has been Model Agnostic Meta-Learning (MAML), a method that consists…

机器学习 · 计算机科学 2020-02-13 Aniruddh Raghu , Maithra Raghu , Samy Bengio , Oriol Vinyals

In few-shot learning scenarios, the challenge is to generalize and perform well on new unseen examples when only very few labeled examples are available for each task. Model-agnostic meta-learning (MAML) has gained the popularity as one of…

机器学习 · 计算机科学 2021-10-19 Sungyong Baik , Janghoon Choi , Heewon Kim , Dohee Cho , Jaesik Min , Kyoung Mu Lee

In past years model-agnostic meta-learning (MAML) has been one of the most promising approaches in meta-learning. It can be applied to different kinds of problems, e.g., reinforcement learning, but also shows good results on few-shot…

机器学习 · 计算机科学 2021-05-13 Thomas Goerttler , Klaus Obermayer

Model-agnostic meta-learners aim to acquire meta-learned parameters from similar tasks to adapt to novel tasks from the same distribution with few gradient updates. With the flexibility in the choice of models, those frameworks demonstrate…

机器学习 · 计算机科学 2019-10-31 Risto Vuorio , Shao-Hua Sun , Hexiang Hu , Joseph J. Lim

Adapting large language models (LLMs) to unseen tasks with in-context training samples without fine-tuning remains an important research problem. To learn a robust LLM that adapts well to unseen tasks, multiple meta-training approaches have…

计算与语言 · 计算机科学 2024-05-21 Sanchit Sinha , Yuguang Yue , Victor Soto , Mayank Kulkarni , Jianhua Lu , Aidong Zhang

Meta-learning algorithms enable rapid adaptation to new tasks with minimal data, a critical capability for real-world robotic systems. This paper evaluates Model-Agnostic Meta-Learning (MAML) combined with Trust Region Policy Optimization…

机器人学 · 计算机科学 2025-11-18 Sanjar Atamuradov

Recent work has suggested that a good embedding is all we need to solve many few-shot learning benchmarks. Furthermore, other work has strongly suggested that Model Agnostic Meta-Learning (MAML) also works via this same method - by learning…

机器学习 · 计算机科学 2021-12-28 Brando Miranda , Yu-Xiong Wang , Sanmi Koyejo

Model-Agnostic Meta-Learning (MAML) and its variants have achieved success in meta-learning tasks on many datasets and settings. On the other hand, we have just started to understand and analyze how they are able to adapt fast to new tasks.…

机器学习 · 计算机科学 2021-01-26 Sébastien M. R. Arnold , Shariq Iqbal , Fei Sha

Model-Agnostic Meta-Learning (MAML), a model-agnostic meta-learning method, is successfully employed in NLP applications including few-shot text classification and multi-domain low-resource language generation. Many impacting factors,…

计算与语言 · 计算机科学 2024-04-25 Zequn Liu , Ruiyi Zhang , Yiping Song , Wei Ju , Ming Zhang

As a popular meta-learning approach, the model-agnostic meta-learning (MAML) algorithm has been widely used due to its simplicity and effectiveness. However, the convergence of the general multi-step MAML still remains unexplored. In this…

机器学习 · 计算机科学 2020-07-14 Kaiyi Ji , Junjie Yang , Yingbin Liang

Model Agnostic Meta-Learning (MAML) has emerged as a standard framework for meta-learning, where a meta-model is learned with the ability of fast adapting to new tasks. However, as a double-looped optimization problem, MAML needs to…

机器学习 · 计算机科学 2021-02-10 Yufan Zhou , Zhenyi Wang , Jiayi Xian , Changyou Chen , Jinhui Xu

Model-Agnostic Meta-Learning (MAML) is one of the most successful meta-learning techniques for few-shot learning. It uses gradient descent to learn commonalities between various tasks, enabling the model to learn the meta-initialization of…

机器学习 · 计算机科学 2022-08-18 Lin Ding , Peng Liu , Wenfeng Shen , Weijia Lu , Shengbo Chen

Model-agnostic meta-learning (MAML) is a meta-learning technique to train a model on a multitude of learning tasks in a way that primes the model for few-shot learning of new tasks. The MAML algorithm performs well on few-shot learning…

机器学习 · 计算机科学 2020-01-22 Harkirat Singh Behl , Atılım Güneş Baydin , Philip H. S. Torr
‹ 上一页 1 2 3 10 下一页 ›