English
Related papers

Related papers: Adaptive Exponential Integration for Stable Gaussi…

200 papers

Derivative-free optimization has become an important technique used in machine learning for optimizing black-box models. To conduct updates without explicitly computing gradient, most current approaches iteratively sample a random search…

Machine Learning · Statistics 2018-08-03 Liu Liu , Minhao Cheng , Cho-Jui Hsieh , Dacheng Tao

Recent advances in coreset methods have shown that a selection of representative datapoints can replace massive volumes of data for Bayesian inference, preserving the relevant statistical information and significantly accelerating…

Machine Learning · Statistics 2023-01-18 Dionysis Manousakas , Hippolyt Ritter , Theofanis Karaletsos

We develop unbiased implicit variational inference (UIVI), a method that expands the applicability of variational inference by defining an expressive variational family. UIVI considers an implicit variational distribution obtained in a…

Machine Learning · Statistics 2019-02-07 Michalis K. Titsias , Francisco J. R. Ruiz

Bayesian inference for complex models with an intractable likelihood can be tackled using algorithms performing many calls to computer simulators. These approaches are collectively known as "simulation-based inference" (SBI). Recent SBI…

Seismic full-waveform inversion (FWI) provides high resolution images of the subsurface by exploiting information in the recorded seismic waveforms. This is achieved by solving a highly nonnlinear and nonunique inverse problem. Bayesian…

Geophysics · Physics 2023-02-22 Xin Zhang , Angus Lomas , Muhong Zhou , York Zheng , Andrew Curtis

In order to predict future performance of subsurface fluid reservoirs under possible operating scenarios, a dynamic, porous-medium flow simulation model must be tuned to include representative properties of the reservoir. Estimating…

Geophysics · Physics 2026-02-04 Zhen Zhang , Xuebin Zhao , Andrew Curtis

We formalize an equivalence between two popular methods for Bayesian inference: Stein variational gradient descent (SVGD) and black-box variational inference (BBVI). In particular, we show that BBVI corresponds precisely to SVGD when the…

Machine Learning · Computer Science 2020-04-07 Casey Chu , Kentaro Minami , Kenji Fukumizu

Monte Carlo (MC) integration is the de facto method for approximating the predictive distribution of Bayesian neural networks (BNNs). But, even with many MC samples, Gaussian-based BNNs could still yield bad predictive performance due to…

Machine Learning · Computer Science 2022-10-18 Agustinus Kristiadi , Runa Eschenhagen , Philipp Hennig

Distributed inference/estimation in Bayesian framework in the context of sensor networks has recently received much attention due to its broad applicability. The variational Bayesian (VB) algorithm is a technique for approximating…

Machine Learning · Statistics 2020-11-30 Junhao Hua , Chunguang Li

Recently, particle-based variational inference (ParVI) methods have gained interest because they can avoid arbitrary parametric assumptions that are common in variational inference. However, many ParVI approaches do not allow arbitrary…

Machine Learning · Computer Science 2021-08-12 Neale Ratzlaff , Qinxun Bai , Li Fuxin , Wei Xu

Variational inference, as an alternative to Markov chain Monte Carlo sampling, has played a transformative role in enabling scalable computation for complex Bayesian models. Nevertheless, existing approaches often depend on either rigid…

Methodology · Statistics 2026-05-21 Somjit Roy , Pritam Dey , Debdeep Pati , Bani K. Mallick

In this paper, we introduce a novel Gaussian mixture based evidential learning solution for robust stereo matching. Diverging from previous evidential deep learning approaches that rely on a single Gaussian distribution, our framework…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Weide Liu , Xingxing Wang , Lu Wang , Jun Cheng , Fayao Liu , Xulei Yang

The specification of a covariance function is of paramount importance when employing Gaussian process models, but the requirement of positive definiteness severely limits those used in practice. Designing flexible stationary covariance…

Computation · Statistics 2024-05-01 Paul G. Beckman , Christopher J. Geoga

Mixture models with Gamma and or inverse-Gamma distributed mixture components are useful for medical image tissue segmentation or as post-hoc models for regression coefficients obtained from linear regression within a Generalised Linear…

Machine Learning · Statistics 2016-07-27 A. Llera , D. Vidaurre , R. H. R. Pruim , C. F. Beckmann

Efficiently accessing the information contained in non-linear and high dimensional probability distributions remains a core challenge in modern statistics. Traditionally, estimators that go beyond point estimates are either categorized as…

Methodology · Statistics 2021-07-06 Philipp Frank , Reimar Leike , Torsten A. Enßlin

Variational inference techniques based on inducing variables provide an elegant framework for scalable posterior estimation in Gaussian process (GP) models. Besides enabling scalability, one of their main advantages over sparse…

Machine Learning · Statistics 2021-02-24 Simone Rossi , Markus Heinonen , Edwin V. Bonilla , Zheyang Shen , Maurizio Filippone

The steady-state Bayesian vector autoregression (BVAR) makes it possible to incorporate prior information about the long-run mean of the process. This has been shown in many studies to substantially improve forecasting performance, and the…

Computation · Statistics 2025-06-12 Oskar Gustafsson , Mattias Villani

Balancing computational efficiency with robust predictive performance is crucial in supervised learning, especially for critical applications. Standard deep learning models, while accurate and scalable, often lack probabilistic features…

Machine Learning · Computer Science 2025-02-11 Conor Heins , Hao Wu , Dimitrije Markovic , Alexander Tschantz , Jeff Beck , Christopher Buckley

Stochastic planning can be reduced to probabilistic inference in large discrete graphical models, but hardness of inference requires approximation schemes to be used. In this paper we argue that such applications can be disentangled along…

Artificial Intelligence · Computer Science 2022-09-05 Zhennan Wu , Roni Khardon

We present a data-driven Bayesian nonparametric approach for global optimization (DaBNO) of stochastic black-box function. The function value depends on the distribution of a random vector. However, this distribution is usually complex and…

Optimization and Control · Mathematics 2024-02-28 Haowei Wang , Xun Zhang , Szu Hui Ng , Songhao Wang