中文
相关论文

相关论文: Convergence of Gradient-based MAML in LQR

200 篇论文

Learning new tasks by drawing on prior experience gathered from other (related) tasks is a core property of any intelligent system. Gradient-based meta-learning, especially MAML and its variants, has emerged as a viable solution to…

机器学习 · 计算机科学 2024-09-06 El Mahdi Chayti , Martin Jaggi

Model-Agnostic Meta-Learning (MAML) and its variants have achieved success in meta-learning tasks on many datasets and settings. On the other hand, we have just started to understand and analyze how they are able to adapt fast to new tasks.…

机器学习 · 计算机科学 2021-01-26 Sébastien M. R. Arnold , Shariq Iqbal , Fei Sha

The field of few-shot learning has recently seen substantial advancements. Most of these advancements came from casting few-shot learning as a meta-learning problem. Model Agnostic Meta Learning or MAML is currently one of the best…

机器学习 · 计算机科学 2019-03-07 Antreas Antoniou , Harrison Edwards , Amos Storkey

We study the convergence of a class of gradient-based Model-Agnostic Meta-Learning (MAML) methods and characterize their overall complexity as well as their best achievable accuracy in terms of gradient norm for nonconvex loss functions. We…

机器学习 · 计算机科学 2020-05-19 Alireza Fallah , Aryan Mokhtari , Asuman Ozdaglar

Despite the superior empirical success of deep meta-learning, theoretical understanding of overparameterized meta-learning is still limited. This paper studies the generalization of a widely used meta-learning approach, Model-Agnostic…

机器学习 · 计算机科学 2022-06-22 Yu Huang , Yingbin Liang , Longbo Huang

Meta-learning methods have shown an impressive ability to train models that rapidly learn new tasks. However, these methods only aim to perform well in expectation over tasks coming from some particular distribution that is typically…

机器学习 · 计算机科学 2020-06-22 Liam Collins , Aryan Mokhtari , Sanjay Shakkottai

Model Agnostic Meta-Learning (MAML) has emerged as a standard framework for meta-learning, where a meta-model is learned with the ability of fast adapting to new tasks. However, as a double-looped optimization problem, MAML needs to…

机器学习 · 计算机科学 2021-02-10 Yufan Zhou , Zhenyi Wang , Jiayi Xian , Changyou Chen , Jinhui Xu

Model-agnostic meta-learning (MAML) is one of the most popular and widely adopted meta-learning algorithms, achieving remarkable success in various learning problems. Yet, with the unique design of nested inner-loop and outer-loop updates,…

机器学习 · 计算机科学 2022-03-15 Chia-Hsiang Kao , Wei-Chen Chiu , Pin-Yu Chen

Model-agnostic meta-learners aim to acquire meta-learned parameters from similar tasks to adapt to novel tasks from the same distribution with few gradient updates. With the flexibility in the choice of models, those frameworks demonstrate…

机器学习 · 计算机科学 2019-10-31 Risto Vuorio , Shao-Hua Sun , Hexiang Hu , Joseph J. Lim

This paper focuses on adaptive control of the discrete-time linear quadratic regulator (adaptive LQR). Recent literature has made significant contributions in proving non-asymptotic convergence rates, but existing approaches have a few…

系统与控制 · 电气工程与系统科学 2026-04-27 Peter A. Fisher , Anuradha M. Annaswamy

Motivated by the growing use of artificial intelligence (AI) tools in control design, this paper analyses the intersection between results from gradient methods for the model-free linear quadratic regulator (LQR), and linear feedforward…

系统与控制 · 电气工程与系统科学 2025-05-27 Arthur Castello B. de Oliveira , Milad Siami , Eduardo D. Sontag

This paper presents a novel optimization method for maximizing generalization over tasks in meta-learning. The goal of meta-learning is to learn a model for an agent adapting rapidly when presented with previously unseen tasks. Tasks are…

机器学习 · 计算机科学 2018-10-19 Amir Erfan Eshratifar , David Eigen , Massoud Pedram

In this paper, we study the generalization properties of Model-Agnostic Meta-Learning (MAML) algorithms for supervised learning problems. We focus on the setting in which we train the MAML model over $m$ tasks, each with $n$ data points,…

机器学习 · 计算机科学 2021-11-18 Alireza Fallah , Aryan Mokhtari , Asuman Ozdaglar

This article introduces a novel framework for data-driven linear quadratic regulator (LQR) design. First, we introduce a reinforcement learning paradigm for on-policy data-driven LQR, where exploration and exploitation are simultaneously…

系统与控制 · 电气工程与系统科学 2024-02-23 Marco Borghesi , Alessandro Bosso , Giuseppe Notarstefano

In this paper, we will deal with a Linear Quadratic Optimal Control problem with unknown dynamics. As a modeling assumption, we will suppose that the knowledge that an agent has on the current system is represented by a probability…

最优化与控制 · 数学 2022-01-13 Andrea Pesare , Michele Palladino , Maurizio Falcone

Meta learning aims at learning a model that can quickly adapt to unseen tasks. Widely used meta learning methods include model agnostic meta learning (MAML), implicit MAML, Bayesian MAML. Thanks to its ability of modeling uncertainty,…

机器学习 · 计算机科学 2022-03-08 Lisha Chen , Tianyi Chen

Model-Agnostic Meta-Learning (MAML), a popular gradient-based meta-learning framework, assumes that the contribution of each task or instance to the meta-learner is equal. Hence, it fails to address the domain shift between base and novel…

机器学习 · 计算机科学 2021-12-02 Krishnateja Killamsetty , Changbin Li , Chen Zhao , Rishabh Iyer , Feng Chen

Model-agnostic meta-learning (MAML) is a well-known optimization-based meta-learning algorithm that works well in various computer vision tasks, e.g., few-shot classification. MAML is to learn an initialization so that a model can adapt to…

计算机视觉与模式识别 · 计算机科学 2021-10-22 Sanghyuk Lee , Seunghyun Lee , Byung Cheol Song

Meta-learning offers a principled framework leveraging \emph{task-invariant} priors from related tasks, with which \emph{task-specific} models can be fine-tuned on downstream tasks, even with limited data records. Gradient-based…

机器学习 · 计算机科学 2026-04-16 Yilang Zhang , Abraham Jaeger Mountain , Bingcong Li , Georgios B. Giannakis

Although model-agnostic meta-learning (MAML) is a very successful algorithm in meta-learning practice, it can have high computational cost because it updates all model parameters over both the inner loop of task-specific adaptation and the…

机器学习 · 计算机科学 2020-10-26 Kaiyi Ji , Jason D. Lee , Yingbin Liang , H. Vincent Poor