中文
相关论文

相关论文: Inference in Deep Gaussian Processes using Stochas…

200 篇论文

Missing values are common in many real-life datasets. However, most of the current machine learning methods can not handle missing values. This means that they should be imputed beforehand. Gaussian Processes (GPs) are non-parametric models…

Parameter retrieval and model inversion are key problems in remote sensing and Earth observation. Currently, different approximations exist: a direct, yet costly, inversion of radiative transfer models (RTMs); the statistical inversion with…

信号处理 · 电气工程与系统科学 2021-04-22 Daniel Heestermans Svendsen , Pablo Morales-Alvarez , Ana Belen Ruescas , Rafael Molina , Gustau Camps-Valls

Gaussian Processes (GPs) can be used as flexible, non-parametric function priors. Inspired by the growing body of work on Normalizing Flows, we enlarge this class of priors through a parametric invertible transformation that can be made…

机器学习 · 计算机科学 2021-02-26 Juan Maroñas , Oliver Hamelijnck , Jeremias Knoblauch , Theodoros Damoulas

It is desirable to combine the expressive power of deep learning with Gaussian Process (GP) in one expressive Bayesian learning model. Deep kernel learning showed success in adopting a deep network for feature extraction followed by a GP…

机器学习 · 计算机科学 2021-10-26 Chi-Ken Lu , Patrick Shafto

Deep learning has revolutionized the last decade, being at the forefront of extraordinary advances in a wide range of tasks including computer vision, natural language processing, and reinforcement learning, to name but a few. However, it…

机器学习 · 计算机科学 2024-01-24 Sebastian W. Ober

Markov chain Monte Carlo (MCMC) algorithms have become powerful tools for Bayesian inference. However, they do not scale well to large-data problems. Divide-and-conquer strategies, which split the data into batches and, for each batch, run…

统计计算 · 统计学 2017-07-18 Christopher Nemeth , Chris Sherlock

We propose a nested Gaussian process (nGP) as a locally adaptive prior for Bayesian nonparametric regression. Specified through a set of stochastic differential equations (SDEs), the nGP imposes a Gaussian process prior for the function's…

统计方法学 · 统计学 2012-01-24 Bin Zhu , David B. Dunson

Bayesian parameter inference for complex stochastic simulators is challenging due to intractable likelihood functions. Existing simulation-based inference methods often require large number of simulations and become costly to use in…

机器学习 · 计算机科学 2026-04-06 Vasilis Gkolemis , Christos Diou , Michael U. Gutmann

This paper is concerned with the approximation of probability distributions known up to normalization constants, with a focus on Bayesian inference for large-scale inverse problems in scientific computing. In this context, key challenges…

机器学习 · 计算机科学 2025-06-10 Baojun Che , Yifan Chen , Zhenghao Huan , Daniel Zhengyu Huang , Weijie Wang

Distributed Gaussian processes (DGPs) are prominent local approximation methods to scale Gaussian processes (GPs) to large datasets. Instead of a global estimation, they train local experts by dividing the training set into subsets, thus…

机器学习 · 计算机科学 2021-11-10 Hamed Jalali , Gjergji Kasneci

Bayesian inference for doubly intractable distributions is challenging because they include intractable terms, which are functions of parameters of interest. Although several alternatives have been developed for such models, they are…

机器学习 · 统计学 2025-08-08 Heesang Lee , Songhee Kim , Bokgyeong Kang , Jaewoo Park

Modern scientific problems are often multi-disciplinary and require integration of computer models from different disciplines, each with distinct functional complexities, programming environments, and computation times. Linked Gaussian…

机器学习 · 统计学 2023-06-05 Deyu Ming , Daniel Williamson

We cast motion planning under uncertainty as a stochastic optimal control problem, where the optimal posterior distribution has an explicit form. To approximate this posterior, this work frames an optimization problem in the space of…

机器人学 · 计算机科学 2026-01-06 Zinuo Chang , Hongzhe Yu , Patricio Vela , Yongxin Chen

Efficiently accessing the information contained in non-linear and high dimensional probability distributions remains a core challenge in modern statistics. Traditionally, estimators that go beyond point estimates are either categorized as…

统计方法学 · 统计学 2021-07-06 Philipp Frank , Reimar Leike , Torsten A. Enßlin

The successes of modern deep machine learning methods are founded on their ability to transform inputs across multiple layers to build good high-level representations. It is therefore critical to understand this process of representation…

机器学习 · 统计学 2023-05-26 Adam X. Yang , Maxime Robeyns , Edward Milsom , Ben Anson , Nandi Schoots , Laurence Aitchison

Variational inference is computationally challenging in models that contain both conjugate and non-conjugate terms. Methods specifically designed for conjugate models, even though computationally efficient, find it difficult to deal with…

机器学习 · 计算机科学 2017-04-14 Mohammad Emtiyaz Khan , Wu Lin

The Bayesian estimation of GARCH-family models has been typically addressed through Monte Carlo sampling. Variational Inference is gaining popularity and attention as a robust approach for Bayesian inference in complex machine learning…

机器学习 · 统计学 2023-10-06 Martin Magris , Alexandros Iosifidis

In decision-making systems, it is important to have classifiers that have calibrated uncertainties, with an optimisation objective that can be used for automated model selection and training. Gaussian processes (GPs) provide uncertainty…

机器学习 · 统计学 2020-03-05 Vincent Dutordoir , Mark van der Wilk , Artem Artemev , James Hensman

Monte Carlo (MC) integration is the de facto method for approximating the predictive distribution of Bayesian neural networks (BNNs). But, even with many MC samples, Gaussian-based BNNs could still yield bad predictive performance due to…

机器学习 · 计算机科学 2022-10-18 Agustinus Kristiadi , Runa Eschenhagen , Philipp Hennig

This research proposes a flexible Bayesian extension of the composite Gaussian process (CGP) model of Ba and Joseph (2012) for predicting (stationary or) non-stationary $y(\mathbf{x})$. The CGP generalizes the regression plus stationary…

统计方法学 · 统计学 2019-06-27 Casey B. Davis , Christopher M. Hans , Thomas J. Santner