English
Related papers

Related papers: Probabilistic Model-Agnostic Meta-Learning

200 papers

The training of deep-learning-based text classification models relies heavily on a huge amount of annotation data, which is difficult to obtain. When the labeled data is scarce, models tend to struggle to achieve satisfactory performance.…

Computation and Language · Computer Science 2020-04-07 Dianbo Sui , Yubo Chen , Binjie Mao , Delai Qiu , Kang Liu , Jun Zhao

Reinforcement learning and planning methods require an objective or reward function that encodes the desired behavior. Yet, in practice, there is a wide range of scenarios where an objective is difficult to provide programmatically, such as…

Machine Learning · Computer Science 2018-10-02 Annie Xie , Avi Singh , Sergey Levine , Chelsea Finn

In order for a robot to be a generalist that can perform a wide range of jobs, it must be able to acquire a wide variety of skills quickly and efficiently in complex unstructured environments. High-capacity models such as deep neural…

Machine Learning · Computer Science 2017-09-15 Chelsea Finn , Tianhe Yu , Tianhao Zhang , Pieter Abbeel , Sergey Levine

We study few-shot learning in natural language domains. Compared to many existing works that apply either metric-based or optimization-based meta-learning to image domain with low inter-task variance, we consider a more realistic setting,…

Computation and Language · Computer Science 2018-05-22 Mo Yu , Xiaoxiao Guo , Jinfeng Yi , Shiyu Chang , Saloni Potdar , Yu Cheng , Gerald Tesauro , Haoyu Wang , Bowen Zhou

Online meta-learning has recently emerged as a marriage between batch meta-learning and online learning, for achieving the capability of quick adaptation on new tasks in a lifelong manner. However, most existing approaches focus on the…

Machine Learning · Computer Science 2024-08-06 Daouda Sow , Sen Lin , Yingbin Liang , Junshan Zhang

Topic models have been successfully used for analyzing text documents. However, with existing topic models, many documents are required for training. In this paper, we propose a neural network-based few-shot learning method that can learn a…

Computation and Language · Computer Science 2021-04-20 Tomoharu Iwata

Data collected by IoT devices are often private and have a large diversity across users. Therefore, learning requires pre-training a model with available representative data samples, deploying the pre-trained model on IoT devices, and…

Machine Learning · Computer Science 2022-06-28 Zhongnan Qu , Zimu Zhou , Yongxin Tong , Lothar Thiele

In task-based few-shot learning paradigms, it is commonly assumed that different tasks are independently and identically distributed (i.i.d.). However, in real-world scenarios, the distribution encountered in few-shot learning can…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Jiajun Chen , Hongpeng Yin , Yifu Yang

Meta learning has attracted much attention recently in machine learning community. Contrary to conventional machine learning aiming to learn inherent prediction rules to predict labels for new query data, meta learning aims to learn the…

Machine Learning · Computer Science 2023-07-04 Jun Shu , Deyu Meng , Zongben Xu

Machine learning classifiers are often trained to recognize a set of pre-defined classes. However, in many applications, it is often desirable to have the flexibility of learning additional concepts, with limited data and without…

Machine Learning · Computer Science 2019-10-08 Mengye Ren , Renjie Liao , Ethan Fetaya , Richard S. Zemel

Few-shot learning is a type of classification through which predictions are made based on a limited number of samples for each class. This type of classification is sometimes referred to as a meta-learning problem, in which the model learns…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-02 Leah Chowenhill , Gaurav Satyanath , Shubhranshu Singh , Madhav Mahendra Wagh

Recent progress in deterministic prompt learning has become a promising alternative to various downstream vision tasks, enabling models to learn powerful visual representations with the help of pre-trained vision-language models. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Hyeongjun Kwon , Taeyong Song , Somi Jeong , Jin Kim , Jinhyun Jang , Kwanghoon Sohn

Meta-learning aims at learning quickly on novel tasks with limited data by transferring generic experience learned from previous tasks. Naturally, few-shot learning has been one of the most popular applications for meta-learning. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Yudong Chen , Chaoyu Guan , Zhikun Wei , Xin Wang , Wenwu Zhu

Metric-based meta-learning techniques have successfully been applied to few-shot classification problems. In this paper, we propose to leverage cross-modal information to enhance metric-based few-shot learning methods. Visual and semantic…

Machine Learning · Computer Science 2020-02-19 Chen Xing , Negar Rostamzadeh , Boris N. Oreshkin , Pedro O. Pinheiro

Many meta-learning algorithms can be formulated into an interleaved process, in the sense that task-specific predictors are learned during inner-task adaptation and meta-parameters are updated during meta-update. The normal meta-training…

Machine Learning · Computer Science 2021-08-25 Jiaxin Chen , Li-Ming Zhan , Xiao-Ming Wu , Fu-Lai Chung

Machine learning models have traditionally been developed under the assumption that the training and test distributions match exactly. However, recent success in few-shot learning and related problems are encouraging signs that these models…

Machine Learning · Statistics 2020-10-15 James Lucas , Mengye Ren , Irene Kameni , Toniann Pitassi , Richard Zemel

Deep neural networks (DNNs) have achieved state-of-the-art results on time series classification (TSC) tasks. In this work, we focus on leveraging DNNs in the often-encountered practical scenario where access to labeled training data is…

Machine Learning · Computer Science 2021-03-05 Jyoti Narwariya , Pankaj Malhotra , Lovekesh Vig , Gautam Shroff , Vishnu Tv

Meta-learning is a general approach to equip machine learning models with the ability to handle few-shot scenarios when dealing with many tasks. Most existing meta-learning methods work based on the assumption that all tasks are of equal…

Machine Learning · Computer Science 2024-10-25 Zhaofeng Si , Shu Hu , Kaiyi Ji , Siwei Lyu

In few-shot classification, we are interested in learning algorithms that train a classifier from only a handful of labeled examples. Recent progress in few-shot classification has featured meta-learning, in which a parameterized model for…

This article reviews meta-learning also known as learning-to-learn which seeks rapid and accurate model adaptation to unseen tasks with applications in highly automated AI, few-shot learning, natural language processing and robotics. Unlike…

Machine Learning · Computer Science 2020-10-27 Huimin Peng