中文
相关论文

相关论文: Chameleon: Learning Model Initializations Across T…

200 篇论文

Meta-learning of shared initialization parameters has shown to be highly effective in solving few-shot learning tasks. However, extending the framework to many-shot scenarios, which may further enhance its practicality, has been relatively…

机器学习 · 计算机科学 2022-02-17 Jaewoong Shin , Hae Beom Lee , Boqing Gong , Sung Ju Hwang

Meta-learning leverages related source tasks to learn an initialization that can be quickly fine-tuned to a target task with limited labeled examples. However, many popular meta-learning algorithms, such as model-agnostic meta-learning…

机器学习 · 统计学 2020-03-24 Diana Cai , Rishit Sheth , Lester Mackey , Nicolo Fusi

This paper considers meta-learning problems, where there is a distribution of tasks, and we would like to obtain an agent that performs well (i.e., learns quickly) when presented with a previously unseen task sampled from this distribution.…

机器学习 · 计算机科学 2018-10-23 Alex Nichol , Joshua Achiam , John Schulman

Despite the recent success of stochastic gradient descent in deep learning, it is often difficult to train a deep neural network with an inappropriate choice of its initial parameters. Even if training is successful, it has been known that…

机器学习 · 计算机科学 2023-02-10 Cheolhyoung Lee , Kyunghyun Cho

Model-Agnostic Meta-Learning (MAML) is one of the most successful meta-learning techniques for few-shot learning. It uses gradient descent to learn commonalities between various tasks, enabling the model to learn the meta-initialization of…

机器学习 · 计算机科学 2022-08-18 Lin Ding , Peng Liu , Wenfeng Shen , Weijia Lu , Shengbo Chen

Gradient-based meta-learners such as MAML are able to learn a meta-prior from similar tasks to adapt to novel tasks from the same distribution with few gradient updates. One important limitation of such frameworks is that they seek a common…

机器学习 · 计算机科学 2018-12-19 Risto Vuorio , Shao-Hua Sun , Hexiang Hu , Joseph J. Lim

Meta-learning, which pursues an effective initialization model, has emerged as a promising approach to handling unseen tasks. However, a limitation remains to be evident when a meta-learner tries to encompass a wide range of task…

机器学习 · 计算机科学 2024-03-12 Jae-Jun Lee , Sung Whan Yoon

We introduce a new, rigorously-formulated Bayesian meta-learning algorithm that learns a probability distribution of model parameter prior for few-shot learning. The proposed algorithm employs a gradient-based variational inference to infer…

机器学习 · 计算机科学 2022-03-21 Cuong Nguyen , Thanh-Toan Do , Gustavo Carneiro

A meta-model is trained on a distribution of similar tasks such that it learns an algorithm that can quickly adapt to a novel task with only a handful of labeled examples. Most of current meta-learning methods assume that the meta-training…

机器学习 · 计算机科学 2019-04-12 Minseop Park , Jungtaek Kim , Saehoon Kim , Yanbin Liu , Seungjin Choi

Transfer-learning and meta-learning are two effective methods to apply knowledge learned from large data sources to new tasks. In few-class, few-shot target task settings (i.e. when there are only a few classes and training examples…

机器学习 · 计算机科学 2019-02-11 Amir Erfan Eshratifar , Mohammad Saeed Abrishami , David Eigen , Massoud Pedram

Few-shot Learning aims to learn classifiers for new classes with only a few training examples per class. Existing meta-learning or metric-learning based few-shot learning approaches are limited in handling diverse domains with various…

机器学习 · 计算机科学 2019-01-30 Yu Cheng , Mo Yu , Xiaoxiao Guo , Bowen Zhou

This paper presents a novel optimization method for maximizing generalization over tasks in meta-learning. The goal of meta-learning is to learn a model for an agent adapting rapidly when presented with previously unseen tasks. Tasks are…

机器学习 · 计算机科学 2018-10-19 Amir Erfan Eshratifar , David Eigen , Massoud Pedram

Few-shot learning is a challenging problem where the goal is to achieve generalization from only few examples. Model-agnostic meta-learning (MAML) tackles the problem by formulating prior knowledge as a common initialization across tasks,…

机器学习 · 计算机科学 2020-06-17 Sungyong Baik , Seokil Hong , Kyoung Mu Lee

Model-Agnostic Meta-Learning (MAML), a popular gradient-based meta-learning framework, assumes that the contribution of each task or instance to the meta-learner is equal. Hence, it fails to address the domain shift between base and novel…

机器学习 · 计算机科学 2021-12-02 Krishnateja Killamsetty , Changbin Li , Chen Zhao , Rishabh Iyer , Feng Chen

This paper proposes a novel learning method for multi-task applications. Multi-task neural networks can learn to transfer knowledge across different tasks by using parameter sharing. However, sharing parameters between unrelated tasks can…

机器学习 · 计算机科学 2020-07-21 Krzysztof Maziarz , Efi Kokiopoulou , Andrea Gesmundo , Luciano Sbaiz , Gabor Bartok , Jesse Berent

This paper presents a simple unsupervised visual representation learning method with a pretext task of discriminating all images in a dataset using a parametric, instance-level classifier. The overall framework is a replica of a supervised…

计算机视觉与模式识别 · 计算机科学 2021-02-10 Yu Liu , Lianghua Huang , Pan Pan , Bin Wang , Yinghui Xu , Rong Jin

Model-Agnostic Meta-Learning (MAML) and its variants are popular few-shot classification methods. They train an initializer across a variety of sampled learning tasks (also known as episodes) such that the initialized model can adapt…

计算机视觉与模式识别 · 计算机科学 2020-10-13 Yangbin Chen , Yun Ma , Tom Ko , Jianping Wang , Qing Li

A learning task, understood as the problem of fitting a parametric model from supervised data, fundamentally requires the dataset to be large enough to be representative of the underlying distribution of the source. When data is limited,…

While tasks could come with varying the number of instances and classes in realistic settings, the existing meta-learning approaches for few-shot classification assume that the number of instances per task and class is fixed. Due to such…

机器学习 · 计算机科学 2022-02-15 Hae Beom Lee , Hayeon Lee , Donghyun Na , Saehoon Kim , Minseop Park , Eunho Yang , Sung Ju Hwang

In the paradigm of multi-task learning, mul- tiple related prediction tasks are learned jointly, sharing information across the tasks. We propose a framework for multi-task learn- ing that enables one to selectively share the information…

机器学习 · 计算机科学 2012-07-03 Abhishek Kumar , Hal Daume
‹ 上一页 1 2 3 10 下一页 ›