English
Related papers

Related papers: Adaptive Exponential Integration for Stable Gaussi…

200 papers

Variational inference is a powerful tool for approximate inference, and it has been recently applied for representation learning with deep generative models. We develop the variational Gaussian process (VGP), a Bayesian nonparametric…

Machine Learning · Statistics 2016-04-19 Dustin Tran , Rajesh Ranganath , David M. Blei

We consider Bayesian inference for large scale inverse problems, where computational challenges arise from the need for repeated evaluations of an expensive forward model. This renders most Markov chain Monte Carlo approaches infeasible,…

Numerical Analysis · Mathematics 2022-08-12 Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

Automatic Differentiation Variational Inference (ADVI) is efficient in learning probabilistic models. Classic ADVI relies on the parametric approach to approximate the posterior. In this paper, we develop a spline-based nonparametric…

Machine Learning · Statistics 2024-03-12 Yuda Shao , Shan Yu , Tianshu Feng

By formulating the inverse problem of partial differential equations (PDEs) as a statistical inference problem, the Bayesian approach provides a general framework for quantifying uncertainties. In the inverse problem of PDEs, parameters are…

Numerical Analysis · Mathematics 2026-02-10 Haoyu Lu , Junxiong Jia , Deyu Meng

We propose a Bayesian distributionally robust variational inequality (DRVI) framework that models the data-generating distribution through a finite mixture family, which allows us to study the DRVI on a tractable finite-dimensional…

Optimization and Control · Mathematics 2026-03-31 Wentao Ma , Zhiping Chen , Xiaojun Chen

We introduce a gradient-free framework for Bayesian Optimal Experimental Design (BOED) in sequential settings, aimed at complex systems where gradient information is unavailable. Our method combines Ensemble Kalman Inversion (EKI) for…

Machine Learning · Statistics 2025-09-22 Robert Gruhlke , Matei Hanu , Claudia Schillings , Philipp Wacker

Estimating the predictive uncertainty of a Bayesian learning model is critical in various decision-making problems, e.g., reinforcement learning, detecting adversarial attack, self-driving car. As the model posterior is almost always…

Machine Learning · Computer Science 2021-02-16 Yufei Cui , Wuguannan Yao , Qiao Li , Antoni B. Chan , Chun Jason Xue

We present a novel formulation for motion planning under uncertainties based on variational inference where the optimal motion plan is modeled as a posterior distribution. We propose a Gaussian variational inference-based framework, termed…

Robotics · Computer Science 2025-06-25 Hongzhe Yu , Yongxin Chen

Exponential integrators are a well-known class of time integration methods that have been the subject of many studies and developments in the past two decades. Surprisingly, there have been limited efforts to analyze their stability and…

Numerical Analysis · Mathematics 2021-08-03 Tommaso Buvoli , Michael L. Minion

We propose to use L\'evy {\alpha}-stable distributions for constructing priors for Bayesian inverse problems. The construction is based on Markov fields with stable-distributed increments. Special cases include the Cauchy and Gaussian…

Computation · Statistics 2023-06-26 Jarkko Suuronen , Tomás Soto , Neil K. Chada , Lassi Roininen

We develop a Coordinate Ascent Variational Inference (CAVI) algorithm for Bayesian Mixed Data Sampling (MIDAS) regression with linear weight parameterizations. The model separates impact coeffcients from weighting function parameters…

Machine Learning · Computer Science 2026-02-24 Luigi Simeone

Adaptive Bayesian quadrature (ABQ) is a powerful approach to numerical integration that empirically compares favorably with Monte Carlo integration on problems of medium dimensionality (where non-adaptive quadrature is not competitive). Its…

Machine Learning · Statistics 2019-10-29 Motonobu Kanagawa , Philipp Hennig

We extend the existing framework of semi-implicit variational inference (SIVI) and introduce doubly semi-implicit variational inference (DSIVI), a way to perform variational inference and learning when both the approximate posterior and the…

Machine Learning · Statistics 2019-03-19 Dmitry Molchanov , Valery Kharitonov , Artem Sobolev , Dmitry Vetrov

We introduce a class of generic spike-and-slab priors for high-dimensional linear regression with grouped variables and present a Coordinate-ascent Variational Inference (CAVI) algorithm for obtaining an optimal variational Bayes…

Methodology · Statistics 2023-10-02 Buyu Lin , Changhao Ge , Jun S. Liu

Ill-posed imaging inverse problems remain challenging due to the ambiguity in mapping degraded observations to clean images. Diffusion-based generative priors have recently shown promise, but typically rely on computationally intensive…

Image and Video Processing · Electrical Eng. & Systems 2026-02-13 Ayush Varshney , Katherine L. Bouman , Berthy T. Feng

We introduce a flexible empirical Bayes approach for fitting Bayesian generalized linear models. Specifically, we adopt a novel mean-field variational inference (VI) method and the prior is estimated within the VI algorithm, making the…

Machine Learning · Statistics 2026-01-30 Dongyue Xie , Wanrong Zhu , Matthew Stephens

Optimizing high-dimensional and complex black-box functions is crucial in numerous scientific applications. While Bayesian optimization (BO) is a powerful method for sample-efficient optimization, it struggles with the curse of…

Machine Learning · Computer Science 2025-07-08 Taeyoung Yun , Kiyoung Om , Jaewoo Lee , Sujin Yun , Jinkyoo Park

Non-Gaussian and multimodal distributions are an important part of many recent robust sensor fusion algorithms. In difference to robust cost functions, they are probabilistically founded and have good convergence properties. Since their…

Robotics · Computer Science 2020-01-14 Tim Pfeifer , Peter Protzel

Semi-implicit variational inference (SIVI) enriches the expressiveness of variational families by utilizing a kernel and a mixing distribution to hierarchically define the variational distribution. Existing SIVI methods parameterize the…

Machine Learning · Statistics 2025-01-16 Jen Ning Lim , Adam M. Johansen

Variational inference (VI) is a technique to approximate difficult to compute posteriors by optimization. In contrast to MCMC, VI scales to many observations. In the case of complex posteriors, however, state-of-the-art VI approaches often…

Machine Learning · Statistics 2024-02-26 Oliver Dürr , Stephan Hörling , Daniel Dold , Ivonne Kovylov , Beate Sick