中文
相关论文

相关论文: Hypernetwork approach to Bayesian MAML

200 篇论文

The goal of few-shot learning is to recognize new visual concepts with just a few amount of labeled samples in each class. Recent effective metric-based few-shot approaches employ neural networks to learn a feature similarity comparison…

计算机视觉与模式识别 · 计算机科学 2020-04-17 Xiaomeng Li , Lequan Yu , Chi-Wing Fu , Meng Fang , Pheng-Ann Heng

As a popular meta-learning approach, the model-agnostic meta-learning (MAML) algorithm has been widely used due to its simplicity and effectiveness. However, the convergence of the general multi-step MAML still remains unexplored. In this…

机器学习 · 计算机科学 2020-07-14 Kaiyi Ji , Junjie Yang , Yingbin Liang

In this paper, we study the generalization properties of Model-Agnostic Meta-Learning (MAML) algorithms for supervised learning problems. We focus on the setting in which we train the MAML model over $m$ tasks, each with $n$ data points,…

机器学习 · 计算机科学 2021-11-18 Alireza Fallah , Aryan Mokhtari , Asuman Ozdaglar

Few-shot learning aims to train models that can be generalized to novel classes with only a few samples. Recently, a line of works are proposed to enhance few-shot learning with accessible semantic information from class names. However,…

机器学习 · 计算机科学 2023-07-11 Zihao Jiang , Yunkai Dang , Dong Pang , Huishuai Zhang , Weiran Huang

We consider a new problem of few-shot learning of compact models. Meta-learning is a popular approach for few-shot learning. Previous work in meta-learning typically assumes that the model architecture during meta-training is the same as…

机器学习 · 计算机科学 2022-10-19 Yong Wu , Shekhor Chanda , Mehrdad Hosseinzadeh , Zhi Liu , Yang Wang

Training a neural network model that can quickly adapt to a new task is highly desirable yet challenging for few-shot learning problems. Recent few-shot learning methods mostly concentrate on developing various meta-learning strategies from…

计算机视觉与模式识别 · 计算机科学 2020-11-24 Zihang Jiang , Bingyi Kang , Kuangqi Zhou , Jiashi Feng

Learning to generate a task-aware base learner proves a promising direction to deal with few-shot learning (FSL) problem. Existing methods mainly focus on generating an embedding model utilized with a fixed metric (eg, cosine distance) for…

计算机视觉与模式识别 · 计算机科学 2020-12-04 Lei Zhang , Fei Zhou , Wei Wei , Yanning Zhang

Meta-learning (ML) has emerged as a promising direction in learning models under constrained resource settings like few-shot learning. The popular approaches for ML either learn a generalizable initial model or a generic parametric…

机器学习 · 计算机科学 2022-03-07 Aroof Aimen , Sahil Sidheekh , Narayanan C. Krishnan

In recent years, model-agnostic meta-learning (MAML) has become a popular research area. However, the stochastic optimization of MAML is still underdeveloped. Existing MAML algorithms rely on the ``episode'' idea by sampling a few tasks and…

机器学习 · 计算机科学 2023-04-26 Bokun Wang , Zhuoning Yuan , Yiming Ying , Tianbao Yang

Model-agnostic meta-learning (MAML) has emerged as one of the most successful meta-learning techniques in few-shot learning. It enables us to learn a meta-initialization} of model parameters (that we call meta-model) to rapidly adapt to new…

机器学习 · 计算机科学 2021-02-23 Ren Wang , Kaidi Xu , Sijia Liu , Pin-Yu Chen , Tsui-Wei Weng , Chuang Gan , Meng Wang

We derive a novel information-theoretic analysis of the generalization property of meta-learning algorithms. Concretely, our analysis proposes a generic understanding of both the conventional learning-to-learn framework and the modern…

机器学习 · 计算机科学 2021-12-13 Qi Chen , Changjian Shui , Mario Marchand

Few-Shot Learning (FSL) algorithms are commonly trained through Meta-Learning (ML), which exposes models to batches of tasks sampled from a meta-dataset to mimic tasks seen during evaluation. However, the standard training procedures…

机器学习 · 计算机科学 2024-10-28 Mateusz Ochal , Massimiliano Patacchiola , Amos Storkey , Jose Vazquez , Sen Wang

Sharpness-aware minimization (SAM) has been instrumental in improving deep neural network training by minimizing both the training loss and the sharpness of the loss landscape, leading the model into flatter minima that are associated with…

机器学习 · 计算机科学 2024-10-03 Van-Anh Nguyen , Quyen Tran , Tuan Truong , Thanh-Toan Do , Dinh Phung , Trung Le

Meta learning aims at learning a model that can quickly adapt to unseen tasks. Widely used meta learning methods include model agnostic meta learning (MAML), implicit MAML, Bayesian MAML. Thanks to its ability of modeling uncertainty,…

机器学习 · 计算机科学 2022-03-08 Lisha Chen , Tianyi Chen

A major problem of machine-learning approaches in structural dynamics is the frequent lack of structural data. Inspired by the recently-emerging field of population-based structural health monitoring (PBSHM), and the use of transfer…

机器学习 · 计算机科学 2023-02-17 G. Tsialiamanis , N. Dervilis , D. J. Wagg , K. Worden

Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which…

计算机视觉与模式识别 · 计算机科学 2019-10-10 Qianru Sun , Yaoyao Liu , Zhaozheng Chen , Tat-Seng Chua , Bernt Schiele

In this paper, we look at the problem of cross-domain few-shot classification that aims to learn a classifier from previously unseen classes and domains with few labeled samples. Recent approaches broadly solve this problem by…

计算机视觉与模式识别 · 计算机科学 2022-05-05 Wei-Hong Li , Xialei Liu , Hakan Bilen

Few-shot learning, a challenging task in machine learning, aims to learn a classifier adaptable to recognize new, unseen classes with limited labeled examples. Meta-learning has emerged as a prominent framework for few-shot learning. Its…

机器学习 · 计算机科学 2024-03-07 Weihao Jiang , Guodong Liu , Di He , Kun He

Meta-learning methods have shown an impressive ability to train models that rapidly learn new tasks. However, these methods only aim to perform well in expectation over tasks coming from some particular distribution that is typically…

机器学习 · 计算机科学 2020-06-22 Liam Collins , Aryan Mokhtari , Sanjay Shakkottai

Few-shot classification consists of learning a predictive model that is able to effectively adapt to a new class, given only a few annotated samples. To solve this challenging problem, meta-learning has become a popular paradigm that…

计算机视觉与模式识别 · 计算机科学 2019-09-02 Nikita Dvornik , Cordelia Schmid , Julien Mairal