English
Related papers

Related papers: Meta-Learning with Latent Embedding Optimization

200 papers

The ability to walk in new scenarios is a key milestone on the path toward real-world applications of legged robots. In this work, we introduce Meta Strategy Optimization, a meta-learning algorithm for training policies with latent variable…

Robotics · Computer Science 2020-02-18 Wenhao Yu , Jie Tan , Yunfei Bai , Erwin Coumans , Sehoon Ha

We develop a Learning Direct Optimization (LiDO) method for the refinement of a latent variable model that describes input image x. Our goal is to explain a single image x with an interpretable 3D computer graphics model having scene graph…

Computer Vision and Pattern Recognition · Computer Science 2020-05-08 Lukasz Romaszko , Christopher K. I. Williams , John Winn

We consider the task of few shot link prediction on graphs. The goal is to learn from a distribution over graphs so that a model is able to quickly infer missing edges in a new graph after a small amount of training. We show that current…

Machine Learning · Computer Science 2020-03-03 Avishek Joey Bose , Ankit Jain , Piero Molino , William L. Hamilton

Few-shot learning focuses on learning a new visual concept with very limited labelled examples. A successful approach to tackle this problem is to compare the similarity between examples in a learned metric space based on convolutional…

Machine Learning · Computer Science 2024-02-06 Heda Song , Mercedes Torres Torres , Ender Özcan , Isaac Triguero

The focus of recent meta-learning research has been on the development of learning algorithms that can quickly adapt to test time tasks with limited data and low computational cost. Few-shot learning is widely used as one of the standard…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Yonglong Tian , Yue Wang , Dilip Krishnan , Joshua B. Tenenbaum , Phillip Isola

Gradient-based meta-learning methods have primarily been applied to classical machine learning tasks such as image classification. Recently, PDE-solving deep learning methods, such as neural operators, are starting to make an important…

Machine Learning · Computer Science 2023-02-06 Lu Zhang , Huaiqian You , Tian Gao , Mo Yu , Chung-Hao Lee , Yue Yu

Drawing inspiration from gradient-based meta-learning methods with infinitely small gradient steps, we introduce Continuous-Time Meta-Learning (COMLN), a meta-learning algorithm where adaptation follows the dynamics of a gradient vector…

Machine Learning · Computer Science 2022-03-04 Tristan Deleu , David Kanaa , Leo Feng , Giancarlo Kerg , Yoshua Bengio , Guillaume Lajoie , Pierre-Luc Bacon

Bayesian meta-learning enables robust and fast adaptation to new tasks with uncertainty assessment. The key idea behind Bayesian meta-learning is empirical Bayes inference of hierarchical model. In this work, we extend this framework to…

Machine Learning · Computer Science 2020-11-19 Yayi Zou , Xiaoqi Lu

Meta learning has demonstrated tremendous success in few-shot learning with limited supervised data. In those settings, the meta model is usually overparameterized. While the conventional statistical learning theory suggests that…

Machine Learning · Computer Science 2022-11-10 Lisha Chen , Songtao Lu , Tianyi Chen

The remarkable success of pretrain-then-finetune paradigm has led to a proliferation of available pre-trained models for vision tasks. This surge presents a significant challenge in efficiently choosing the most suitable pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Zixuan Hu , Xiaotong Li , Shixiang Tang , Jun Liu , Yichun Hu , Ling-Yu Duan

Meta-learning has emerged as an efficient approach for constructing target models based on support sets. For example, the meta-learned embeddings enable the construction of target nearest-neighbor classifiers for specific tasks by pulling…

Machine Learning · Computer Science 2023-09-19 Han-Jia Ye , Da-Wei Zhou , Lanqing Hong , Zhenguo Li , Xiu-Shen Wei , De-Chuan Zhan

Gradient-based meta-learning and hyperparameter optimization have seen significant progress recently, enabling practical end-to-end training of neural networks together with many hyperparameters. Nevertheless, existing approaches are…

Machine Learning · Computer Science 2021-10-28 Ondrej Bohdal , Yongxin Yang , Timothy Hospedales

Few-Shot Learning (FSL) is a challenging task, which aims to recognize novel classes with few examples. Pre-training based methods effectively tackle the problem by pre-training a feature extractor and then performing class prediction via a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Baoquan Zhang , Shanshan Feng , Bingqi Shan , Xutao Li , Yunming Ye , Yew-Soon Ong

Meta-learning has emerged as a trending technique to tackle few-shot text classification and achieved state-of-the-art performance. However, existing solutions heavily rely on the exploitation of lexical features and their distributional…

Computation and Language · Computer Science 2021-07-27 ChengCheng Han , Zeqiu Fan , Dongxiang Zhang , Minghui Qiu , Ming Gao , Aoying Zhou

We present a deep generative model for learning to predict classes not seen at training time. Unlike most existing methods for this problem, that represent each class as a point (via a semantic embedding), we represent each seen/unseen…

Machine Learning · Computer Science 2017-11-21 Wenlin Wang , Yunchen Pu , Vinay Kumar Verma , Kai Fan , Yizhe Zhang , Changyou Chen , Piyush Rai , Lawrence Carin

Humans are capable of learning new concepts from small numbers of examples. In contrast, supervised deep learning models usually lack the ability to extract reliable predictive rules from limited data scenarios when attempting to classify…

Machine Learning · Computer Science 2020-07-17 Zhongjie Yu , Sebastian Raschka

The development of artificial intelligence (AI) for science has led to the emergence of learning-based research paradigms, necessitating a compelling reevaluation of the design of multi-objective optimization (MOO) methods. The new…

Machine Learning · Computer Science 2023-11-02 Linxi Yang , Xinmin Yang , Liping Tang

There has been a significant increase in the deployment of neural network models, presenting substantial challenges in model adaptation and fine-tuning. Efficient adaptation is crucial in maintaining model performance across diverse tasks…

Machine Learning · Computer Science 2025-04-02 Maolin Wang , Xiangyu Zhao

Meta-learning is a powerful paradigm for few-shot learning. Although with remarkable success witnessed in many applications, the existing optimization based meta-learning models with over-parameterized neural networks have been evidenced to…

Machine Learning · Computer Science 2020-07-23 Hongduan Tian , Bo Liu , Xiao-Tong Yuan , Qingshan Liu

Meta-learning has received a tremendous recent attention as a possible approach for mimicking human intelligence, i.e., acquiring new knowledge and skills with little or even no demonstration. Most of the existing meta-learning methods are…

Machine Learning · Computer Science 2019-05-24 Fan Zhou , Chengtai Cao , Kunpeng Zhang , Goce Trajcevski , Ting Zhong , Ji Geng