中文
相关论文

相关论文: Onsager-Machlup Posterior Transport for Deep Gauss…

200 篇论文

Gaussian process (GP) regression is a powerful probabilistic modeling technique with built-in uncertainty quantification. When one has access to multiple correlated simulations (tasks), it is common to fit a multitask GP (MTGP) surrogate…

统计计算 · 统计学 2026-03-18 Aleksei G. Sorokin , Pieterjan Robbe , Fred J. Hickernell

This paper proposes a new algorithm for Gaussian process classification based on posterior linearisation (PL). In PL, a Gaussian approximation to the posterior density is obtained iteratively using the best possible linearisation of the…

机器学习 · 计算机科学 2019-04-19 Ángel F. García-Fernández , Filip Tronarp , Simo Särkkä

We introduce a new interpretation of sparse variational approximations for Gaussian processes using inducing points, which can lead to more scalable algorithms than previous methods. It is based on decomposing a Gaussian process as a sum of…

机器学习 · 统计学 2024-02-27 Jiaxin Shi , Michalis K. Titsias , Andriy Mnih

Stochastic planning can be reduced to probabilistic inference in large discrete graphical models, but hardness of inference requires approximation schemes to be used. In this paper we argue that such applications can be disentangled along…

人工智能 · 计算机科学 2022-09-05 Zhennan Wu , Roni Khardon

This paper is concerned with a state-space approach to deep Gaussian process (DGP) regression. We construct the DGP by hierarchically putting transformed Gaussian process (GP) priors on the length scales and magnitudes of the next level of…

机器学习 · 统计学 2021-09-24 Zheng Zhao , Muhammad Emzir , Simo Särkkä

We introduce Deep Sigma Point Processes, a class of parametric models inspired by the compositional structure of Deep Gaussian Processes (DGPs). Deep Sigma Point Processes (DSPPs) retain many of the attractive features of (variational)…

机器学习 · 统计学 2020-12-29 Martin Jankowiak , Geoff Pleiss , Jacob R. Gardner

In stochastic systems, numerically sampling the relevant trajectories for the estimation of the large deviation statistics of time-extensive observables requires overcoming their exponential (in space and time) scarcity. The optimal way to…

统计力学 · 物理学 2021-01-14 Tom H. E. Oakes , Adam Moss , Juan P. Garrahan

Learning expressive kernels while retaining tractable inference remains a central challenge in scaling Gaussian processes (GPs) to large and complex datasets. We propose a scalable GP regressor based on deep basis kernels (DBKs). Our DBK is…

机器学习 · 统计学 2026-02-05 Yunqin Zhu , Henry Shaowu Yuchi , Yao Xie

We extend the existing framework of semi-implicit variational inference (SIVI) and introduce doubly semi-implicit variational inference (DSIVI), a way to perform variational inference and learning when both the approximate posterior and the…

机器学习 · 统计学 2019-03-19 Dmitry Molchanov , Valery Kharitonov , Artem Sobolev , Dmitry Vetrov

We propose a statistical benchmark for diffusion posterior sampling (DPS) algorithms for Bayesian linear inverse problems. The benchmark synthesizes signals from sparse L\'evy-process priors whose posteriors admit efficient Gibbs methods.…

信号处理 · 电气工程与系统科学 2025-09-17 Martin Zach , Youssef Haouchat , Michael Unser

Background: Timely, uncertainty-aware forecasting from irregular electronic health records (EHR) can support critical-care decisions, yet most approaches either impute to a grid or sacrifice interpretability. We introduce StructGP, a…

机器学习 · 计算机科学 2026-05-01 Ivan Lerner , Jean Feydy , Alexandre Kalimouttou , Anita Burgun , Francis Bach

We propose a novel neural algorithm for the fundamental problem of computing the entropic optimal transport (EOT) plan between continuous probability distributions which are accessible by samples. Our algorithm is based on the saddle point…

机器学习 · 计算机科学 2023-11-02 Nikita Gushchin , Alexander Kolesov , Alexander Korotin , Dmitry Vetrov , Evgeny Burnaev

Variational inference techniques based on inducing variables provide an elegant framework for scalable posterior estimation in Gaussian process (GP) models. Besides enabling scalability, one of their main advantages over sparse…

机器学习 · 统计学 2021-02-24 Simone Rossi , Markus Heinonen , Edwin V. Bonilla , Zheyang Shen , Maurizio Filippone

Prior parameter distributions provide an elegant way to represent prior expert and world knowledge for informed learning. Previous work has shown that using such informative priors to regularize probabilistic deep learning (DL) models…

机器学习 · 计算机科学 2024-11-06 Christian Schlauch , Christian Wirth , Nadja Klein

Variational approximations to Gaussian processes (GPs) typically use a small set of inducing points to form a low-rank approximation to the covariance matrix. In this work, we instead exploit a sparse approximation of the precision matrix.…

机器学习 · 计算机科学 2024-11-22 Luhuan Wu , Geoff Pleiss , John Cunningham

The composition of multiple Gaussian Processes as a Deep Gaussian Process (DGP) enables a deep probabilistic nonparametric approach to flexibly tackle complex machine learning problems with sound quantification of uncertainty. Existing…

机器学习 · 统计学 2017-03-02 Kurt Cutajar , Edwin V. Bonilla , Pietro Michiardi , Maurizio Filippone

Multi-Output Gaussian Processes (MOGPs) provide a principled probabilistic framework for modelling correlated outputs but face scalability bottlenecks when applied to datasets with high-dimensional output spaces. To maintain tractability,…

机器学习 · 计算机科学 2026-05-29 Xiaoyu Jiang , Xinxing Shi , Sokratia Georgaka , Magnus Rattray , Mauricio A Álvarez

We address the problem of continual learning in multi-task Gaussian process (GP) models for handling sequential input-output observations. Our approach extends the existing prior-posterior recursion of online Bayesian inference, i.e.\ past…

机器学习 · 统计学 2019-11-04 Pablo Moreno-Muñoz , Antonio Artés-Rodríguez , Mauricio A. Álvarez

Diffusion models have shown strong performances in solving inverse problems through posterior sampling while they suffer from errors during earlier steps. To mitigate this issue, several Decoupled Posterior Sampling methods have been…

机器学习 · 计算机科学 2025-04-15 Zhi Qi , Shihong Yuan , Yulin Yuan , Linling Kuang , Yoshiyuki Kabashima , Xiangming Meng

Gaussian Processes (GPs) are powerful non-parametric Bayesian regression models that allow exact posterior inference, but exhibit high computational and memory costs. In order to improve scalability of GPs, approximate posterior inference…

机器学习 · 计算机科学 2020-04-28 Martin Trapp , Robert Peharz , Franz Pernkopf , Carl E. Rasmussen