中文
相关论文

相关论文: Adversarial Meta-Learning of Gamma-Minimax Estimat…

200 篇论文

Meta-learning enables a model to learn from very limited data to undertake a new task. In this paper, we study the general meta-learning with adversarial samples. We present a meta-learning algorithm, ADML (ADversarial Meta-Learner), which…

机器学习 · 计算机科学 2020-06-23 Chengxiang Yin , Jian Tang , Zhiyuan Xu , Yanzhi Wang

Undirected graphical models are compact representations of joint probability distributions over random variables. To solve inference tasks of interest, graphical models of arbitrary topology can be trained using empirical risk minimization.…

机器学习 · 计算机科学 2020-10-23 Adarsh K. Jeewajee , Leslie P. Kaelbling

Meta-learning offers a principled framework leveraging \emph{task-invariant} priors from related tasks, with which \emph{task-specific} models can be fine-tuned on downstream tasks, even with limited data records. Gradient-based…

机器学习 · 计算机科学 2026-04-16 Yilang Zhang , Abraham Jaeger Mountain , Bingcong Li , Georgios B. Giannakis

Memory-based meta-learning is a technique for approximating Bayes-optimal predictors. Under fairly general conditions, minimizing sequential prediction error, measured by the log loss, leads to implicit meta-learning. The goal of this work…

The main purpose of this paper is to introduce and study the behavior of minimum {\phi}-divergence estimators as an alternative to the maximum likelihood estimator in latent class models for binary items. As it will become clear below,…

统计方法学 · 统计学 2014-06-03 Ángel Felipe , Pedro Miranda , Leandro Pardo

Meta-learning, or "learning to learn", refers to techniques that infer an inductive bias from data corresponding to multiple related tasks with the goal of improving the sample efficiency for new, previously unobserved, tasks. A key…

机器学习 · 计算机科学 2021-02-24 Sharu Theresa Jose , Osvaldo Simeone

In this paper we introduce five different algorithms based on method of moments, maximum likelihood and full Bayesian estimation for learning the parameters of the Inverse Gamma distribution. We also provide an expression for the KL…

统计方法学 · 统计学 2016-07-11 A. Llera , C. F. Beckmann

Meta-learning automatically infers an inductive bias by observing data from a number of related tasks. The inductive bias is encoded by hyperparameters that determine aspects of the model class or training algorithm, such as initialization…

机器学习 · 计算机科学 2020-11-10 Sharu Theresa Jose , Osvaldo Simeone , Giuseppe Durisi

Agents that interact with other agents often do not know a priori what the other agents' strategies are, but have to maximise their own online return while interacting with and learning about others. The optimal adaptive behaviour under…

机器学习 · 计算机科学 2022-04-19 Luisa Zintgraf , Sam Devlin , Kamil Ciosek , Shimon Whiteson , Katja Hofmann

In this paper, we consider the estimation of a mean vector of a multivariate normal population where the mean vector is suspected to be nearly equal to mean vectors of $k-1$ other populations. As an alternative to the preliminary test…

统计理论 · 数学 2018-09-10 Ryo Imai , Tatsuya Kubokawa , Malay Ghosh

In this paper, we propose a new framework to detect adversarial examples motivated by the observations that random components can improve the smoothness of predictors and make it easier to simulate the output distribution of a deep neural…

机器学习 · 统计学 2024-02-26 Yao Li , Tongyi Tang , Cho-Jui Hsieh , Thomas C. M. Lee

Variational Autoencoders (VAEs) are expressive latent variable models that can be used to learn complex probability distributions from training data. However, the quality of the resulting model crucially relies on the expressiveness of the…

机器学习 · 计算机科学 2018-06-12 Lars Mescheder , Sebastian Nowozin , Andreas Geiger

Learning to infer Bayesian posterior from a few-shot dataset is an important step towards robust meta-learning due to the model uncertainty inherent in the problem. In this paper, we propose a novel Bayesian model-agnostic meta-learning…

机器学习 · 计算机科学 2018-11-20 Taesup Kim , Jaesik Yoon , Ousmane Dia , Sungwoong Kim , Yoshua Bengio , Sungjin Ahn

We introduce a novel combination of Bayesian Models (BMs) and Neural Networks (NNs) for making predictions with a minimum expected risk. Our approach combines the best of both worlds, the data efficiency and interpretability of a BM with…

机器学习 · 计算机科学 2021-09-28 Mathias Löwe , Per Lunnemann Hansen , Sebastian Risi

We introduce the $\gamma$-model, a predictive model of environment dynamics with an infinite probabilistic horizon. Replacing standard single-step models with $\gamma$-models leads to generalizations of the procedures central to model-based…

机器学习 · 计算机科学 2021-11-30 Michael Janner , Igor Mordatch , Sergey Levine

We introduce a novel approach for training adversarial models by replacing the discriminator score with a bi-modal Gaussian distribution over the real/fake indicator variables. In order to do this, we train the Gaussian classifier to match…

机器学习 · 统计学 2018-08-21 Karan Grewal , R Devon Hjelm , Yoshua Bengio

The problem of Bayes minimax estimation for the mean of a multivariate normal distribution under quadratic loss has attracted significant attention recently. These estimators have the advantageous property of being admissible, similar to…

统计理论 · 数学 2025-05-13 Dominique Fourdrinier , William E. Strawderman , Martin T. Wells

The Median-of-Means (MoM) is a robust estimator widely used in machine learning that is known to be (minimax) optimal in scenarios where samples are i.i.d. In more grave scenarios, samples are contaminated by an adversary that can inspect…

机器学习 · 统计学 2025-10-10 Xabier de Juan , Santiago Mazuelas

Gradient-based meta-learners such as MAML are able to learn a meta-prior from similar tasks to adapt to novel tasks from the same distribution with few gradient updates. One important limitation of such frameworks is that they seek a common…

机器学习 · 计算机科学 2018-12-19 Risto Vuorio , Shao-Hua Sun , Hexiang Hu , Joseph J. Lim

Adversarial examples causing evasive predictions are widely used to evaluate and improve the robustness of machine learning models. However, current studies focus on supervised learning tasks, relying on the ground-truth data label, a…

机器学习 · 计算机科学 2021-12-09 Chia-Yi Hsu , Pin-Yu Chen , Songtao Lu , Sijia Liu , Chia-Mu Yu