中文
相关论文

相关论文: Negative Inner-Loop Learning Rates Learn Universal…

200 篇论文

Gradient-based meta-learners such as Model-Agnostic Meta-Learning (MAML) have shown strong few-shot performance in supervised and reinforcement learning settings. However, specifically in the case of meta-reinforcement learning (meta-RL),…

机器学习 · 计算机科学 2020-02-20 Bhairav Mehta , Tristan Deleu , Sharath Chandra Raparthy , Chris J. Pal , Liam Paull

Gradient-based meta-learners such as MAML are able to learn a meta-prior from similar tasks to adapt to novel tasks from the same distribution with few gradient updates. One important limitation of such frameworks is that they seek a common…

机器学习 · 计算机科学 2018-12-19 Risto Vuorio , Shao-Hua Sun , Hexiang Hu , Joseph J. Lim

Recent work has shown that language models (LMs) trained with multi-task \textit{instructional learning} (MTIL) can solve diverse NLP tasks in zero- and few-shot settings with improved performance compared to prompt tuning. MTIL illustrates…

计算与语言 · 计算机科学 2022-10-24 Budhaditya Deb , Guoqing Zheng , Ahmed Hassan Awadallah

Model-agnostic meta-learning (MAML) is one of the most successful meta-learning algorithms. It has a bi-level optimization structure where the outer-loop process learns a shared initialization and the inner-loop process optimizes…

计算机视觉与模式识别 · 计算机科学 2023-11-30 Suhyun Kang , Duhun Hwang , Moonjung Eo , Taesup Kim , Wonjong Rhee

This study investigates the performance of robust anomaly detection models in industrial inspection, focusing particularly on their ability to handle noisy data. We propose to leverage the adaptation ability of meta learning approaches to…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Muhammad Aqeel , Shakiba Sharifi , Marco Cristani , Francesco Setti

This paper introduces Domain Generalization Sharpness-Aware Minimization Model-Agnostic Meta-Learning (DGS-MAML), a novel meta-learning algorithm designed to generalize across tasks with limited training data. DGS-MAML combines gradient…

机器学习 · 计算机科学 2025-08-14 Usman Anjum , Chris Stockman , Cat Luong , Justin Zhan

This letter presents a model-agnostic meta-learning (MAML) based framework for simultaneous and accurate estimation of human gait phase and terrain geometry using a small set of fabric-based wearable soft sensors, with efficient adaptation…

机器人学 · 计算机科学 2025-08-06 Zenan Zhu , Wenxi Chen , Pei-Chun Kao , Janelle Clark , Lily Behnke , Rebecca Kramer-Bottiglio , Holly Yanco , Yan Gu

Existing gradient-based meta-learning approaches to few-shot learning assume that all tasks have the same input feature space. However, in the real world scenarios, there are many cases that the input structures of tasks can be different,…

人工智能 · 计算机科学 2021-09-29 Jiayi Chen , Aidong Zhang

The aim of Few-Shot learning methods is to train models which can easily adapt to previously unseen tasks, based on small amounts of data. One of the most popular and elegant Few-Shot learning approaches is Model-Agnostic Meta-Learning…

机器学习 · 计算机科学 2024-07-09 M. Przewięźlikowski , P. Przybysz , J. Tabor , M. Zięba , P. Spurek

Meta-learning offers a principled framework leveraging \emph{task-invariant} priors from related tasks, with which \emph{task-specific} models can be fine-tuned on downstream tasks, even with limited data records. Gradient-based…

机器学习 · 计算机科学 2026-04-16 Yilang Zhang , Abraham Jaeger Mountain , Bingcong Li , Georgios B. Giannakis

Many meta-learning algorithms can be formulated into an interleaved process, in the sense that task-specific predictors are learned during inner-task adaptation and meta-parameters are updated during meta-update. The normal meta-training…

机器学习 · 计算机科学 2021-08-25 Jiaxin Chen , Li-Ming Zhan , Xiao-Ming Wu , Fu-Lai Chung

Model-Agnostic Meta-Learning (MAML) and its variants are popular few-shot classification methods. They train an initializer across a variety of sampled learning tasks (also known as episodes) such that the initialized model can adapt…

计算机视觉与模式识别 · 计算机科学 2020-10-13 Yangbin Chen , Yun Ma , Tom Ko , Jianping Wang , Qing Li

There is a growing interest in the learning-to-learn paradigm, also known as meta-learning, where models infer on new tasks using a few training examples. Recently, meta-learning based methods have been widely used in few-shot…

机器学习 · 计算机科学 2024-03-13 Anish Madan , Ranjitha Prasad

We consider a model-agnostic solution to the problem of Multi-Domain Learning (MDL) for multi-modal applications. Many existing MDL techniques are model-dependent solutions which explicitly require nontrivial architectural changes to…

计算机视觉与模式识别 · 计算机科学 2021-03-01 Anthony Sicilia , Xingchen Zhao , Davneet Minhas , Erin O'Connor , Howard Aizenstein , William Klunk , Dana Tudorascu , Seong Jae Hwang

This paper discusses an Enhanced Model-Agnostic Meta-Learning (E-MAML) algorithm that generates fast convergence of the policy function from a small number of training examples when applied to new learning tasks. Built on top of…

机器学习 · 计算机科学 2020-12-14 Ibrahim Ahmed , Marcos Quinones-Grueiro , Gautam Biswas

Meta-learning leverages related source tasks to learn an initialization that can be quickly fine-tuned to a target task with limited labeled examples. However, many popular meta-learning algorithms, such as model-agnostic meta-learning…

机器学习 · 统计学 2020-03-24 Diana Cai , Rishit Sheth , Lester Mackey , Nicolo Fusi

We present a novel Balanced Incremental Model Agnostic Meta Learning system (BI-MAML) for learning multiple tasks. Our method implements a meta-update rule to incrementally adapt its model to new tasks without forgetting old tasks. Such a…

机器学习 · 计算机科学 2020-06-16 Yang Zheng , Jinlin Xiang , Kun Su , Eli Shlizerman

In this paper, we introduce a discrete variant of the meta-learning framework. Meta-learning aims at exploiting prior experience and data to improve performance on future tasks. By now, there exist numerous formulations for meta-learning in…

机器学习 · 计算机科学 2021-01-12 Arman Adibi , Aryan Mokhtari , Hamed Hassani

Deep neural networks can yield good performance on various tasks but often require large amounts of data to train them. Meta-learning received considerable attention as one approach to improve the generalization of these networks from a…

机器学习 · 计算机科学 2023-10-11 Mike Huisman , Aske Plaat , Jan N. van Rijn

Meta-learning, or learning to learn, is a technique that can help to overcome resource scarcity in cross-lingual NLP problems, by enabling fast adaptation to new tasks. We apply model-agnostic meta-learning (MAML) to the task of…