中文
相关论文

相关论文: Convergence of Meta-Learning with Task-Specific Ad…

200 篇论文

An important research direction in machine learning has centered around developing meta-learning algorithms to tackle few-shot learning. An especially successful algorithm has been Model Agnostic Meta-Learning (MAML), a method that consists…

机器学习 · 计算机科学 2020-02-13 Aniruddh Raghu , Maithra Raghu , Samy Bengio , Oriol Vinyals

Optimization-based meta-learning aims to learn an initialization so that a new unseen task can be learned within a few gradient updates. Model Agnostic Meta-Learning (MAML) is a benchmark algorithm comprising two optimization loops. The…

机器学习 · 计算机科学 2024-05-28 S. Tiwari , M. Gogoi , S. Verma , K. P. Singh

Model Agnostic Meta Learning or MAML has become the standard for few-shot learning as a meta-learning problem. MAML is simple and can be applied to any model, as its name suggests. However, it often suffers from instability and…

机器学习 · 计算机科学 2024-11-04 JuneYoung Park , MinJae Kang

Model-Agnostic Meta-Learning (MAML) has become increasingly popular for training models that can quickly adapt to new tasks via one or few stochastic gradient descent steps. However, the MAML objective is significantly more difficult to…

机器学习 · 计算机科学 2022-08-11 Liam Collins , Aryan Mokhtari , Sanjay Shakkottai

As a popular meta-learning approach, the model-agnostic meta-learning (MAML) algorithm has been widely used due to its simplicity and effectiveness. However, the convergence of the general multi-step MAML still remains unexplored. In this…

机器学习 · 计算机科学 2020-07-14 Kaiyi Ji , Junjie Yang , Yingbin Liang

The optimization-based meta-learning approach is gaining increased traction because of its unique ability to quickly adapt to a new task using only small amounts of data. However, existing optimization-based meta-learning approaches, such…

机器学习 · 计算机科学 2024-12-17 Honglin Yang , Ji Ma , Xiao Yu

Despite its popularity, several recent works question the effectiveness of MAML when test tasks are different from training tasks, thus suggesting various task-conditioned methodology to improve the initialization. Instead of searching for…

机器学习 · 计算机科学 2020-12-09 Sungyong Baik , Myungsub Choi , Janghoon Choi , Heewon Kim , Kyoung Mu Lee

Adapting large language models (LLMs) to unseen tasks with in-context training samples without fine-tuning remains an important research problem. To learn a robust LLM that adapts well to unseen tasks, multiple meta-training approaches have…

计算与语言 · 计算机科学 2024-05-21 Sanchit Sinha , Yuguang Yue , Victor Soto , Mayank Kulkarni , Jianhua Lu , Aidong Zhang

Model-Agnostic Meta-Learning (MAML) and its variants have achieved success in meta-learning tasks on many datasets and settings. On the other hand, we have just started to understand and analyze how they are able to adapt fast to new tasks.…

机器学习 · 计算机科学 2021-01-26 Sébastien M. R. Arnold , Shariq Iqbal , Fei Sha

Deep learning models require a large amount of data to perform well. When data is scarce for a target task, we can transfer the knowledge gained by training on similar tasks to quickly learn the target. A successful approach is…

机器学习 · 计算机科学 2021-03-18 Alberto Bernacchia

Model Agnostic Meta-Learning (MAML) has emerged as a standard framework for meta-learning, where a meta-model is learned with the ability of fast adapting to new tasks. However, as a double-looped optimization problem, MAML needs to…

机器学习 · 计算机科学 2021-02-10 Yufan Zhou , Zhenyi Wang , Jiayi Xian , Changyou Chen , Jinhui Xu

A core capability of intelligent systems is the ability to quickly learn new tasks by drawing on prior experience. Gradient (or optimization) based meta-learning has recently emerged as an effective approach for few-shot learning. In this…

机器学习 · 计算机科学 2019-09-11 Aravind Rajeswaran , Chelsea Finn , Sham Kakade , Sergey Levine

The capacity of meta-learning algorithms to quickly adapt to a variety of tasks, including ones they did not experience during meta-training, has been a key factor in the recent success of these methods on few-shot learning problems. This…

机器学习 · 计算机科学 2018-12-06 Tristan Deleu , Yoshua Bengio

Model-agnostic meta-learning (MAML) is a meta-learning technique to train a model on a multitude of learning tasks in a way that primes the model for few-shot learning of new tasks. The MAML algorithm performs well on few-shot learning…

机器学习 · 计算机科学 2020-01-22 Harkirat Singh Behl , Atılım Güneş Baydin , Philip H. S. Torr

Neural networks require a large amount of annotated data to learn. Meta-learning algorithms propose a way to decrease the number of training samples to only a few. One of the most prominent optimization-based meta-learning algorithms is…

机器学习 · 计算机科学 2022-06-14 Kostiantyn Khabarlak

In few-shot learning scenarios, the challenge is to generalize and perform well on new unseen examples when only very few labeled examples are available for each task. Model-agnostic meta-learning (MAML) has gained the popularity as one of…

机器学习 · 计算机科学 2021-10-19 Sungyong Baik , Janghoon Choi , Heewon Kim , Dohee Cho , Jaesik Min , Kyoung Mu Lee

Model-agnostic meta-learning (MAML) has emerged as one of the most successful meta-learning techniques in few-shot learning. It enables us to learn a meta-initialization} of model parameters (that we call meta-model) to rapidly adapt to new…

机器学习 · 计算机科学 2021-02-23 Ren Wang , Kaidi Xu , Sijia Liu , Pin-Yu Chen , Tsui-Wei Weng , Chuang Gan , Meng Wang

Model Agnostic Meta-Learning (MAML) consists of two optimization loops: the outer loop learns a meta-initialization of model parameters that is shared across tasks, and the inner loop task-specific adaptation step. A variant of MAML,…

机器学习 · 计算机科学 2022-03-22 Tom Starshak

Recent work has suggested that a good embedding is all we need to solve many few-shot learning benchmarks. Furthermore, other work has strongly suggested that Model Agnostic Meta-Learning (MAML) also works via this same method - by learning…

机器学习 · 计算机科学 2021-12-28 Brando Miranda , Yu-Xiong Wang , Sanmi Koyejo

Model-agnostic meta-learning (MAML) is one of the most popular and widely adopted meta-learning algorithms, achieving remarkable success in various learning problems. Yet, with the unique design of nested inner-loop and outer-loop updates,…

机器学习 · 计算机科学 2022-03-15 Chia-Hsiang Kao , Wei-Chen Chiu , Pin-Yu Chen
‹ 上一页 1 2 3 10 下一页 ›