中文
相关论文

相关论文: Gradient-Based Meta-Learning Using Uncertainty to …

200 篇论文

Model-agnostic meta-learning (MAML) is one of the most popular and widely adopted meta-learning algorithms, achieving remarkable success in various learning problems. Yet, with the unique design of nested inner-loop and outer-loop updates,…

机器学习 · 计算机科学 2022-03-15 Chia-Hsiang Kao , Wei-Chen Chiu , Pin-Yu Chen

Meta-learning is a powerful approach that exploits historical data to quickly solve new tasks from the same distribution. In the low-data regime, methods based on the closed-form posterior of Gaussian processes (GP) together with Bayesian…

Representation learning has been widely studied in the context of meta-learning, enabling rapid learning of new tasks through shared representations. Recent works such as MAML have explored using fine-tuning-based metrics, which measure the…

机器学习 · 计算机科学 2021-05-06 Kurtland Chua , Qi Lei , Jason D. Lee

Meta-learning for few-shot learning allows a machine to leverage previously acquired knowledge as a prior, thus improving the performance on novel tasks with only small amounts of data. However, most mainstream models suffer from…

机器学习 · 计算机科学 2019-11-13 Yadan Luo , Zi Huang , Zheng Zhang , Ziwei Wang , Mahsa Baktashmotlagh , Yang Yang

Although Gaussian processes (GPs) with deep kernels have been successfully used for meta-learning in regression tasks, its uncertainty estimation performance can be poor. We propose a meta-learning method for calibrating deep kernel GPs for…

机器学习 · 统计学 2023-12-14 Tomoharu Iwata , Atsutoshi Kumagai

Meta learning is a promising technique for solving few-shot fault prediction problems, which have attracted the attention of many researchers in recent years. Existing meta-learning methods for time series prediction, which predominantly…

机器学习 · 计算机科学 2023-11-07 Hai Su , Jiajun Hu , Songsen Yu

The performance of gradient-based optimization strategies depends heavily on the initial weights of the parametric model. Recent works show that there exist weight initializations from which optimization procedures can find the…

机器学习 · 计算机科学 2020-01-23 Rafael Rego Drumond , Lukas Brinkmeyer , Josif Grabocka , Lars Schmidt-Thieme

Few-shot classification has made great strides due to foundation models that, through priming and prompting, are highly effective few-shot learners. However, this approach has high variance both across different sets of few shots (data…

计算与语言 · 计算机科学 2023-11-21 Abdullatif Köksal , Timo Schick , Hinrich Schütze

Model-Agnostic Meta-Learning (MAML) and its variants have achieved success in meta-learning tasks on many datasets and settings. On the other hand, we have just started to understand and analyze how they are able to adapt fast to new tasks.…

机器学习 · 计算机科学 2021-01-26 Sébastien M. R. Arnold , Shariq Iqbal , Fei Sha

Building in silico models to predict chemical properties and activities is a crucial step in drug discovery. However, limited labeled data often hinders the application of deep learning in this setting. Meanwhile advances in meta-learning…

机器学习 · 计算机科学 2020-07-21 Cuong Q. Nguyen , Constantine Kreatsoulas , Kim M. Branson

We derive a novel information-theoretic analysis of the generalization property of meta-learning algorithms. Concretely, our analysis proposes a generic understanding of both the conventional learning-to-learn framework and the modern…

机器学习 · 计算机科学 2021-12-13 Qi Chen , Changjian Shui , Mario Marchand

Model Agnostic Meta-Learning (MAML) consists of two optimization loops: the outer loop learns a meta-initialization of model parameters that is shared across tasks, and the inner loop task-specific adaptation step. A variant of MAML,…

机器学习 · 计算机科学 2022-03-22 Tom Starshak

This paper discusses an Enhanced Model-Agnostic Meta-Learning (E-MAML) algorithm that generates fast convergence of the policy function from a small number of training examples when applied to new learning tasks. Built on top of…

机器学习 · 计算机科学 2020-12-14 Ibrahim Ahmed , Marcos Quinones-Grueiro , Gautam Biswas

Learning new tasks by drawing on prior experience gathered from other (related) tasks is a core property of any intelligent system. Gradient-based meta-learning, especially MAML and its variants, has emerged as a viable solution to…

机器学习 · 计算机科学 2024-09-06 El Mahdi Chayti , Martin Jaggi

We present a generic and flexible Reinforcement Learning (RL) based meta-learning framework for the problem of few-shot learning. During training, it learns the best optimization algorithm to produce a learner (ranker/classifier, etc) by…

机器学习 · 计算机科学 2020-05-05 Raviteja Anantha , Stephen Pulman , Srinivas Chappidi

Meta-learning has recently been an emerging data-efficient learning technique for various medical imaging operations and has helped advance contemporary deep learning models. Furthermore, meta-learning enhances the knowledge generalization…

图像与视频处理 · 电气工程与系统科学 2023-07-14 Sriprabha Ramanarayanan , Arun Palla , Keerthi Ram , Mohanasankar Sivaprakasam

Few-shot learning (FSL) is a challenging task in machine learning, demanding a model to render discriminative classification by using only a few labeled samples. In the literature of FSL, deep models are trained in a manner of metric…

计算机视觉与模式识别 · 计算机科学 2025-01-27 Tong Wu , Takumi Kobayashi

In this paper, we propose a novel approach for few-shot semantic segmentation with sparse labeled images. We investigate the effectiveness of our method, which is based on the Model-Agnostic Meta-Learning (MAML) algorithm, in the medical…

计算机视觉与模式识别 · 计算机科学 2021-08-24 Pedro H. T. Gama , Hugo Oliveira , Jefersson A. dos Santos

The continual learning problem involves training models with limited capacity to perform well on a set of an unknown number of sequentially arriving tasks. While meta-learning shows great potential for reducing interference between old and…

机器学习 · 计算机科学 2020-11-13 Gunshi Gupta , Karmesh Yadav , Liam Paull

To accelerate learning process with few samples, meta-learning resorts to prior knowledge from previous tasks. However, the inconsistent task distribution and heterogeneity is hard to be handled through a global sharing model…

机器学习 · 计算机科学 2022-06-22 Geng Li , Boyuan Ren , Hongzhi Wang