中文
相关论文

相关论文: Exactly Sparse Gaussian Variational Inference with…

200 篇论文

In this tutorial we explain the inference procedures developed for the sparse Gaussian process (GP) regression and Gaussian process latent variable model (GPLVM). Due to page limit the derivation given in Titsias (2009) and Titsias &…

机器学习 · 统计学 2014-10-01 Yarin Gal , Mark van der Wilk

We introduce TrustVI, a fast second-order algorithm for black-box variational inference based on trust-region optimization and the reparameterization trick. At each iteration, TrustVI proposes and assesses a step based on minibatches of…

机器学习 · 计算机科学 2017-11-07 Jeffrey Regier , Michael I. Jordan , Jon McAuliffe

Variational inference is a scalable technique for approximate Bayesian inference. Deriving variational inference algorithms requires tedious model-specific calculations; this makes it difficult to automate. We propose an automatic…

机器学习 · 统计学 2015-06-15 Alp Kucukelbir , Rajesh Ranganath , Andrew Gelman , David M. Blei

Rue and Held (2005) proposed a method for efficiently computing the Gaussian likelihood for stationary Markov random field models, when the data locations fall on a complete regular grid, and the model has no additive error term. The…

统计计算 · 统计学 2019-12-16 Joseph Guinness , Ilse C. F. Ipsen

Stochastic gradient descent (SGD) and its variants have established themselves as the go-to algorithms for large-scale machine learning problems with independent samples due to their generalization performance and intrinsic computational…

机器学习 · 统计学 2025-08-25 Hao Chen , Lili Zheng , Raed Al Kontar , Garvesh Raskutti

This paper presents a novel approach for approximate integration over the uncertainty of noise and signal variances in Gaussian process (GP) regression. Our efficient and straightforward approach can also be applied to integration over…

机器学习 · 统计学 2017-12-18 Ville Tolvanen , Pasi Jylänki , Aki Vehtari

We propose a new recursive estimator for linear dynamical systems under Gaussian process noise and non-Gaussian measurement noise. Specifically, we develop an approximate maximum a posteriori (MAP) estimator using dynamic programming and…

系统与控制 · 电气工程与系统科学 2025-09-09 Mohammad Hussein Yoosefian Nooshabadi , Laurent Lessard

Modern methods for Bayesian regression beyond the Gaussian response setting are often computationally impractical or inaccurate in high dimensions. In fact, as discussed in recent literature, bypassing such a trade-off is still an open…

统计方法学 · 统计学 2022-04-14 Augusto Fasano , Daniele Durante , Giacomo Zanella

Gaussian process regression is a powerful Bayesian nonlinear regression method. Recent research has enabled the capture of many types of observations using non-Gaussian likelihoods. To deal with various tasks in spatial modeling, we benefit…

机器学习 · 统计学 2025-08-26 Yuta Shikuri

Gaussian variational inference and the Laplace approximation are popular alternatives to Markov chain Monte Carlo that formulate Bayesian posterior inference as an optimization problem, enabling the use of simple and scalable stochastic…

统计计算 · 统计学 2023-07-07 Zuheng Xu , Trevor Campbell

We present a novel approach for enhancing the resolution and geometric fidelity of 3D Gaussian Splatting (3DGS) beyond native training resolution. Current 3DGS methods are fundamentally limited by their input resolution, producing…

图形学 · 计算机科学 2025-06-10 Shuja Khalid , Mohamed Ibrahim , Yang Liu

We propose Bayesian methods for Gaussian graphical models that lead to sparse and adaptively shrunk estimators of the precision (inverse covariance) matrix. Our methods are based on lasso-type regularization priors leading to parsimonious…

统计方法学 · 统计学 2013-10-07 Rajesh Talluri , Veerabhadran Baladandayuthapani , Bani K. Mallick

Bayesian inference has been broadly applied to statistical network analysis, but suffers from the expensive computational costs due to the nature of Markov chain Monte Carlo sampling algorithms. This paper proposes a novel and…

统计计算 · 统计学 2025-09-03 Dingbo Wu , Fangzheng Xie

Variational inference (VI) is a popular approach in Bayesian inference, that looks for the best approximation of the posterior distribution within a parametric family, minimizing a loss that is typically the (reverse) Kullback-Leibler (KL)…

机器学习 · 统计学 2024-06-11 Tom Huix , Anna Korba , Alain Durmus , Eric Moulines

We propose a novel approach to computationally efficient GP training based on the observation that square-exponential (SE) covariance matrices contain several off-diagonal entries extremely close to zero. We construct a principled procedure…

机器学习 · 计算机科学 2026-01-28 Emily C. Ehrhardt , Felipe Tobar

In this work, we initiate the study of Hamiltonian learning for positive temperature bosonic Gaussian states, the quantum generalization of the widely studied problem of learning Gaussian graphical models. We obtain efficient protocols,…

量子物理 · 物理学 2025-04-08 Marco Fanizza , Cambyse Rouzé , Daniel Stilck França

We present an iterative framework to improve the amortized approximations of posterior distributions in the context of Bayesian inverse problems, which is inspired by loop-unrolled gradient descent methods and is theoretically grounded in…

机器学习 · 计算机科学 2023-05-16 Rafael Orozco , Ali Siahkoohi , Mathias Louboutin , Felix J. Herrmann

We consider the problem of computing a Gaussian approximation to the posterior distribution of a parameter given a large number N of observations and a Gaussian prior, when the dimension of the parameter d is also large. To address this…

数据结构与算法 · 计算机科学 2023-03-28 Marc Lambert , Silvère Bonnabel , Francis Bach

A novel Gaussian mixture model (GMM) aided sparse Bayesian learning (SBL) framework is proposed for channel state information (CSI) estimation in orthogonal time-frequency space (OTFS) modulated systems. The key attribute of the proposed…

信号处理 · 电气工程与系统科学 2026-03-31 Surbhi Gehlot , Suraj Srivastava , Sandeep Kumar Yadav , Lajos Hanzo

Bayesian inference has many advantages for complex models, but standard Monte Carlo methods for summarizing the posterior can be computationally demanding, and it is attractive to consider optimization-based variational methods. Our work…

统计计算 · 统计学 2025-10-09 Aoxiang Chen , David J. Nott , Linda S. L. Tan