中文
相关论文

相关论文: Bayesian Deconditional Kernel Mean Embeddings

200 篇论文

This paper is an attempt to bridge the conceptual gaps between researchers working on the two widely used approaches based on positive definite kernels: Bayesian learning or inference using Gaussian processes on the one side, and…

机器学习 · 统计学 2018-07-10 Motonobu Kanagawa , Philipp Hennig , Dino Sejdinovic , Bharath K Sriperumbudur

Bayesian model updating based on Gaussian Process (GP) models has received attention in recent years, which incorporates kernel-based GPs to provide enhanced fidelity response predictions. Although most kernel functions provide high fitting…

Gaussian processes are rich distributions over functions, which provide a Bayesian nonparametric approach to smoothing and interpolation. We introduce simple closed form kernels that can be used with Gaussian processes to discover patterns…

机器学习 · 统计学 2014-01-03 Andrew Gordon Wilson , Ryan Prescott Adams

In machine learning, a critical class of decision-related problems concerns preventing predicted undesirable outcomes, referred to as the \textit{avoiding undesired future} (AUF) problem. To address this, the \textit{rehearsal learning}…

机器学习 · 计算机科学 2026-05-12 Wen-Bo Du , Tian-Zuo Wang , Han-Jia Ye , Zhi-Hua Zhou

We develop a semiparametric Bayesian approach for estimating the mean response in a missing data model with binary outcomes and a nonparametrically modelled propensity score. Equivalently we estimate the causal effect of a treatment,…

统计理论 · 数学 2020-09-23 Kolyan Ray , Aad van der Vaart

Computing a consensus object from a set of given objects is a core problem in machine learning and pattern recognition. One popular approach is to formulate it as an optimization problem using the generalized median. Previous methods like…

计算机视觉与模式识别 · 计算机科学 2022-09-22 Andreas Nienkötter , Xiaoyi Jiang

Recent work has developed Bayesian methods for the automatic statistical analysis and description of single time series as well as of homogeneous sets of time series data. We extend prior work to create an interpretable kernel embedding for…

机器学习 · 计算机科学 2019-08-27 Andre T. Nguyen , Edward Raff

Structural kernels are a flexible learning paradigm that has been widely used in Natural Language Processing. However, the problem of model selection in kernel-based methods is usually overlooked. Previous approaches mostly rely on setting…

计算与语言 · 计算机科学 2015-08-11 Daniel Beck , Trevor Cohn , Christian Hardmeier , Lucia Specia

Large-scale Gaussian process inference has long faced practical challenges due to time and space complexity that is superlinear in dataset size. While sparse variational Gaussian process models are capable of learning from large-scale data,…

机器学习 · 统计学 2018-01-23 Ching-An Cheng , Byron Boots

Recent progress in variational inference has paid much attention to the flexibility of variational posteriors. One promising direction is to use implicit distributions, i.e., distributions without tractable densities as the variational…

机器学习 · 统计学 2018-02-26 Jiaxin Shi , Shengyang Sun , Jun Zhu

Current methods for regularization in machine learning require quite specific model assumptions (e.g. a kernel shape) that are not derived from prior knowledge about the application, but must be imposed merely to make the method work. We…

机器学习 · 统计学 2022-11-01 Matthias Wieler

In decision-making systems, it is important to have classifiers that have calibrated uncertainties, with an optimisation objective that can be used for automated model selection and training. Gaussian processes (GPs) provide uncertainty…

机器学习 · 统计学 2020-03-05 Vincent Dutordoir , Mark van der Wilk , Artem Artemev , James Hensman

Spurred on by recent successes in causal inference competitions, Bayesian nonparametric (and high-dimensional) methods have recently seen increased attention in the causal inference literature. In this paper, we present a comprehensive…

统计方法学 · 统计学 2022-01-11 Antonio R. Linero , Joseph L. Antonelli

Bayesian optimisation is a popular technique for hyperparameter learning but typically requires initial exploration even in cases where similar prior tasks have been solved. We propose to transfer information across tasks using learnt…

机器学习 · 统计学 2019-05-28 Ho Chung Leon Law , Peilin Zhao , Lucian Chan , Junzhou Huang , Dino Sejdinovic

Bayesian nonparametric models offer a flexible and powerful framework for statistical model selection, enabling the adaptation of model complexity to the intricacies of diverse datasets. This survey intends to delve into the significance of…

机器学习 · 计算机科学 2024-04-02 Bahman Moraffah

In this paper we suggest two statistical hypothesis tests for the regression function of binary classification based on conditional kernel mean embeddings. The regression function is a fundamental object in classification as it determines…

机器学习 · 统计学 2022-06-22 Ambrus Tamás , Balázs Csanád Csáji

Deep kernel learning (DKL) and related techniques aim to combine the representational power of neural networks with the reliable uncertainty estimates of Gaussian processes. One crucial aspect of these models is an expectation that, because…

机器学习 · 统计学 2021-07-08 Sebastian W. Ober , Carl E. Rasmussen , Mark van der Wilk

In this paper, we address the challenge of performing counterfactual inference with observational data via Bayesian nonparametric regression adjustment, with a focus on high-dimensional settings featuring multiple actions and multiple…

机器学习 · 计算机科学 2022-11-22 Alberto Caron , Gianluca Baio , Ioanna Manolopoulou

We study a nonparametric approach to Bayesian computation via feature means, where the expectation of prior features is updated to yield expected kernel posterior features, based on regression from learned neural net or kernel features of…

机器学习 · 统计学 2022-08-11 Liyuan Xu , Yutian Chen , Arnaud Doucet , Arthur Gretton

The analytic inference, e.g. predictive distribution being in closed form, may be an appealing benefit for machine learning practitioners when they treat wide neural networks as Gaussian process in Bayesian setting. The realistic widths,…

无序系统与神经网络 · 物理学 2023-08-01 Chi-Ken Lu