English
Related papers

Related papers: VIABLE: Fast Adaptation via Backpropagating Learne…

200 papers

Few-shot meta-learning methods consider the problem of learning new tasks from a small, fixed number of examples, by meta-learning across static data from a set of previous tasks. However, in many real world settings, it is more natural to…

Machine Learning · Computer Science 2020-12-15 Tianhe Yu , Xinyang Geng , Chelsea Finn , Sergey Levine

Despite its astounding success in learning deeper multi-dimensional data, the performance of deep learning declines on new unseen tasks mainly due to its focus on same-distribution prediction. Moreover, deep learning is notorious for poor…

Machine Learning · Computer Science 2023-03-15 Hassan Gharoun , Fereshteh Momenifar , Fang Chen , Amir H. Gandomi

Meta-learning algorithms are able to learn a new task using previously learned knowledge, but they often require a large number of meta-training tasks which may not be readily available. To address this issue, we propose a method for…

Machine Learning · Computer Science 2023-05-18 Wenfang Sun , Yingjun Du , Xiantong Zhen , Fan Wang , Ling Wang , Cees G. M. Snoek

Supervised learning typically optimizes the expected value risk functional of the loss, but in many cases, we want to optimize for other risk functionals. In full-batch gradient descent, this is done by taking gradients of a risk functional…

Machine Learning · Computer Science 2023-01-30 Jacob Tyo , Zachary C. Lipton

Recent progress in deep latent variable models has largely been driven by the development of flexible and scalable variational inference methods. Variational training of this type involves maximizing a lower bound on the log-likelihood,…

Machine Learning · Computer Science 2016-06-02 Andriy Mnih , Danilo J. Rezende

Metric-based meta-learning techniques have successfully been applied to few-shot classification problems. In this paper, we propose to leverage cross-modal information to enhance metric-based few-shot learning methods. Visual and semantic…

Machine Learning · Computer Science 2020-02-19 Chen Xing , Negar Rostamzadeh , Boris N. Oreshkin , Pedro O. Pinheiro

Metric learning is a widely used method for few shot learning in which the quality of prototypes plays a key role in the algorithm. In this paper we propose the trainable prototypes for distance measure instead of the artificial ones within…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Jianyi Li , Guizhong Liu

Reinforcement learning and planning methods require an objective or reward function that encodes the desired behavior. Yet, in practice, there is a wide range of scenarios where an objective is difficult to provide programmatically, such as…

Machine Learning · Computer Science 2018-10-02 Annie Xie , Avi Singh , Sergey Levine , Chelsea Finn

We present a technique to improve the transferability of deep representations learned on small labeled datasets by introducing self-supervised tasks as auxiliary loss functions. While recent approaches for self-supervised learning have…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Jong-Chyi Su , Subhransu Maji , Bharath Hariharan

Meta-learning for few-shot learning entails acquiring a prior over previous tasks and experiences, such that new tasks be learned from small amounts of data. However, a critical challenge in few-shot learning is task ambiguity: even when a…

Machine Learning · Computer Science 2019-10-18 Chelsea Finn , Kelvin Xu , Sergey Levine

Many concepts have been proposed for meta learning with neural networks (NNs), e.g., NNs that learn to reprogram fast weights, Hebbian plasticity, learned learning rules, and meta recurrent NNs. Our Variable Shared Meta Learning (VSML)…

Machine Learning · Computer Science 2022-03-15 Louis Kirsch , Jürgen Schmidhuber

Utilizing task-invariant knowledge acquired from related tasks as prior information, meta-learning offers a principled approach to learning a new task with limited data records. Sample-efficient adaptation of this prior information is a…

Machine Learning · Computer Science 2025-09-03 Yilang Zhang , Bingcong Li , Georgios B. Giannakis

We propose a meta-learning approach that learns from multiple tasks in a transductive setting, by leveraging the unlabeled query set in addition to the support set to generate a more powerful model for each task. To develop our framework,…

Machine Learning · Computer Science 2020-04-28 Shell Xu Hu , Pablo G. Moreno , Yang Xiao , Xi Shen , Guillaume Obozinski , Neil D. Lawrence , Andreas Damianou

Training a neural network model that can quickly adapt to a new task is highly desirable yet challenging for few-shot learning problems. Recent few-shot learning methods mostly concentrate on developing various meta-learning strategies from…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Zihang Jiang , Bingyi Kang , Kuangqi Zhou , Jiashi Feng

Deep learning has recently demonstrated its excellent performance on the task of multi-view stereo (MVS). However, loss functions applied for deep MVS are rarely studied. In this paper, we first analyze existing loss functions' properties…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Qinglu Min , Jie Zhao , Zhihao Zhang , Chen Min

Humans are capable of learning new concepts from small numbers of examples. In contrast, supervised deep learning models usually lack the ability to extract reliable predictive rules from limited data scenarios when attempting to classify…

Machine Learning · Computer Science 2020-07-17 Zhongjie Yu , Sebastian Raschka

Few-shot learning aims at rapidly adapting to novel categories with only a handful of samples at test time, which has been predominantly tackled with the idea of meta-learning. However, meta-learning approaches essentially learn across a…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Jinhai Yang , Hua Yang , Lin Chen

Few-shot text classification aims to classify the text under the few-shot scenario. Most of the previous methods adopt optimization-based meta learning to obtain task distribution. However, due to the neglect of matching between the few…

Computation and Language · Computer Science 2023-07-31 Tianyi Lei , Honghui Hu , Qiaoyang Luo , Dezhong Peng , Xu Wang

Active learning continues to remain significant in the industry since it is data efficient. Not only is it cost effective on a constrained budget, continuous refinement of the model allows for early detection and resolution of failure…

Computer Vision and Pattern Recognition · Computer Science 2021-09-06 Megh Shukla , Shuaib Ahmed

We introduce a new loss function for the weakly-supervised training of semantic image segmentation models based on three guiding principles: to seed with weak localization cues, to expand objects based on the information about which classes…

Computer Vision and Pattern Recognition · Computer Science 2016-08-09 Alexander Kolesnikov , Christoph H. Lampert