中文
相关论文

相关论文: Implicit Posterior Variational Inference for Deep …

200 篇论文

Transformed Gaussian Processes (TGPs) are stochastic processes specified by transforming samples from the joint distribution from a prior process (typically a GP) using an invertible transformation; increasing the flexibility of the base…

机器学习 · 计算机科学 2023-11-03 Francisco Javier Sáez-Maldonado , Juan Maroñas , Daniel Hernández-Lobato

A conventional Bayesian approach to prediction uses the posterior distribution to integrate out parameters in a density for unobserved data conditional on the observed data and parameters. When the true posterior is intractable, it is…

统计方法学 · 统计学 2026-02-27 Lucas Kock , Scott A. Sisson , G. S. Rodrigues , David J. Nott

Variational inference techniques based on inducing variables provide an elegant framework for scalable posterior estimation in Gaussian process (GP) models. Besides enabling scalability, one of their main advantages over sparse…

机器学习 · 统计学 2021-02-24 Simone Rossi , Markus Heinonen , Edwin V. Bonilla , Zheyang Shen , Maurizio Filippone

We introduce the implicit processes (IPs), a stochastic process that places implicitly defined multivariate distributions over any finite collections of random variables. IPs are therefore highly flexible implicit priors over functions,…

机器学习 · 统计学 2019-05-29 Chao Ma , Yingzhen Li , José Miguel Hernández-Lobato

Deep Gaussian Processes (DGPs) compose GP layers to warp inputs, enabling improved emulation of computer models with nonstationary input-output behavior compared with ordinary GPs. In contrast to GPs, the predictive uncertainty for DGP…

统计计算 · 统计学 2026-05-12 Yiming Yang , Deyu Ming , Serge Guillas

The composition of multiple Gaussian Processes as a Deep Gaussian Process (DGP) enables a deep probabilistic nonparametric approach to flexibly tackle complex machine learning problems with sound quantification of uncertainty. Existing…

机器学习 · 统计学 2017-03-02 Kurt Cutajar , Edwin V. Bonilla , Pietro Michiardi , Maurizio Filippone

Deep Gaussian processes (DGPs) are popular surrogate models for complex nonstationary computer experiments. DGPs use one or more latent Gaussian processes (GPs) to warp the input space into a plausibly stationary regime, then use typical GP…

统计方法学 · 统计学 2025-12-23 Annie S. Booth

We introduce a novel stochastic variational inference method for Gaussian process ($\mathcal{GP}$) regression, by deriving a posterior over a learnable set of coresets: i.e., over pseudo-input/output, weighted pairs. Unlike former free-form…

机器学习 · 计算机科学 2025-03-06 Mert Ketenci , Adler Perotte , Noémie Elhadad , Iñigo Urteaga

Sparse variational approximations allow for principled and scalable inference in Gaussian Process (GP) models. In settings where several GPs are part of the generative model, theses GPs are a posteriori coupled. For many applications such…

机器学习 · 统计学 2017-11-30 Vincent Adam

Deep Gaussian Processes (DGPs) combine the expressiveness of Deep Neural Networks (DNNs) with quantified uncertainty of Gaussian Processes (GPs). Expressive power and intractable inference both result from the non-Gaussian distribution over…

机器学习 · 计算机科学 2020-02-26 Chi-Ken Lu , Scott Cheng-Hsin Yang , Xiaoran Hao , Patrick Shafto

Deep Gaussian processes (DGPs), a hierarchical composition of GP models, have successfully boosted the expressive power of their single-layer counterpart. However, it is impossible to perform exact inference in DGPs, which has motivated the…

机器学习 · 计算机科学 2021-05-27 Haibin Yu , Dapeng Liu , Yizhou Chen , Bryan Kian Hsiang Low , Patrick Jaillet

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

机器学习 · 计算机科学 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

Gaussian processes (GPs) have gained popularity as flexible machine learning models for regression and function approximation with an in-built method for uncertainty quantification. However, GPs suffer when the amount of training data is…

机器学习 · 统计学 2025-11-26 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk

Scalable Gaussian process (GP) inference is essential for sequential decision-making tasks, yet improving GP scalability remains a challenging problem with many open avenues of research. This paper focuses on iterative GPs, where iterative…

机器学习 · 计算机科学 2025-11-21 Alan Yufei Dong , Jihao Andreas Lin , José Miguel Hernández-Lobato

Gaussian Processes (GPs) provide a flexible and statistically principled foundation for modelling spatiotemporal phenomena, but their $O(N^3)$ scaling makes them intractable for large datasets. Approximate methods such as variational…

机器学习 · 统计学 2026-04-01 Jhonathan Navott , Daniel Jenson , Seth Flaxman , Elizaveta Semenova

Deep Gaussian Processes (DGPs) are multi-layer, flexible extensions of Gaussian processes but their training remains challenging. Sparse approximations simplify the training but often require optimization over a large number of inducing…

机器学习 · 统计学 2021-07-20 Ayush Jain , P. K. Srijith , Mohammad Emtiyaz Khan

Instrumental variable (IV) and proximal causal learning (Proxy) methods are central frameworks for causal inference in the presence of unobserved confounding. Despite substantial methodological advances, existing approaches rarely provide…

机器学习 · 统计学 2026-03-03 Yuqi Zhang , Krikamol Muandet , Dino Sejdinovic , Edwin Fong , Siu Lun Chau

Implicit Processes (IPs) represent a flexible framework that can be used to describe a wide variety of models, from Bayesian neural networks, neural samplers and data generators to many others. IPs also allow for approximate inference in…

机器学习 · 统计学 2022-07-25 Simón Rodríguez Santana , Bryan Zaldivar , Daniel Hernández-Lobato

Multifidelity models integrate data from multiple sources to produce a single approximator for the underlying process. Dense low-fidelity samples are used to reduce interpolation error, while sparse high-fidelity samples are used to…

机器学习 · 统计学 2024-02-27 Viv Bone , Chris van der Heide , Kieran Mackle , Ingo H. J. Jahn , Peter M. Dower , Chris Manzie

Deep Gaussian processes (DGP) have appealing Bayesian properties, can handle variable-sized data, and learn deep features. Their limitation is that they do not scale well with the size of the data. Existing approaches address this using a…

机器学习 · 计算机科学 2019-05-20 Issam H. Laradji , Mark Schmidt , Vladimir Pavlovic , Minyoung Kim