English
Related papers

Related papers: Automated Scalable Bayesian Inference via Hilbert …

200 papers

Bayesian analysis plays a crucial role in estimating distribution of unknown parameters for given data and model. Due to the curse of dimensionality, it becomes difficult for high-dimensional problems, especially when multiple modes exist.…

Methodology · Statistics 2025-07-18 Zihan Liao , Binbin Li , Hua-Ping Wan

The goal of coreset selection in supervised learning is to produce a weighted subset of data, so that training only on the subset achieves similar performance as training on the entire dataset. Existing methods achieved promising results in…

Machine Learning · Computer Science 2023-01-25 Xiao Zhou , Renjie Pi , Weizhong Zhang , Yong Lin , Tong Zhang

We consider the problem of constructing Bayesian based confidence sets for linear functionals in the inverse Gaussian white noise model. We work with a scale of Gaussian priors indexed by a regularity hyper-parameter and apply the…

Statistics Theory · Mathematics 2015-04-21 Botond Szabó

Discrete state spaces represent a major computational challenge to statistical inference, since the computation of normalisation constants requires summation over large or possibly infinite sets, which can be impractical. This paper…

Methodology · Statistics 2023-09-04 Takuo Matsubara , Jeremias Knoblauch , François-Xavier Briol , Chris. J. Oates

Bayesian inference allows machine learning models to express uncertainty. Current machine learning models use only a single learnable parameter combination when making predictions, and as a result are highly overconfident when their…

Machine Learning · Computer Science 2022-02-23 Andrew Wood , Moshik Hershcovitch , Daniel Waddington , Sarel Cohen , Peter Chin

Approximate Bayesian computation allows for inference of complicated probabilistic models with intractable likelihoods using model simulations. The Markov chain Monte Carlo implementation of approximate Bayesian computation is often…

Computation · Statistics 2019-05-17 Matti Vihola , Jordan Franks

Variational inference is a popular technique to approximate a possibly intractable Bayesian posterior with a more tractable one. Recently, boosting variational inference has been proposed as a new paradigm to approximate the posterior by a…

Machine Learning · Computer Science 2018-03-08 Francesco Locatello , Rajiv Khanna , Joydeep Ghosh , Gunnar Rätsch

Likelihood-free methods, such as approximate Bayesian computation, are powerful tools for practical inference problems with intractable likelihood functions. Markov chain Monte Carlo and sequential Monte Carlo variants of approximate…

Computation · Statistics 2019-02-26 David J. Warne , Ruth E. Baker , Matthew J. Simpson

Motivated by parametric models for which the likelihood is analytically unavailable, numerically unstable, or prohibitively expensive to compute or optimize, we develop a prior- and likelihood-free framework for fully probabilistic…

Methodology · Statistics 2026-03-17 Leonardo Cella , Emily C. Hector

We target the problem of accuracy and robustness in causal inference from finite data sets. Some state-of-the-art algorithms produce clear output complete with solid theoretical guarantees but are susceptible to propagating erroneous…

Artificial Intelligence · Computer Science 2012-10-19 Tom Claassen , Tom Heskes

Modern approaches for simulation-based inference rely upon deep learning surrogates to enable approximate inference with computer simulators. In practice, the estimated posteriors' computational faithfulness is, however, rarely guaranteed.…

Machine Learning · Statistics 2022-08-30 Arnaud Delaunoy , Joeri Hermans , François Rozet , Antoine Wehenkel , Gilles Louppe

Sparse estimation of the precision matrix under high-dimensional scaling constitutes a canonical problem in statistics and machine learning. Numerous regression and likelihood based approaches, many frequentist and some Bayesian in nature…

Methodology · Statistics 2020-05-20 Peyman Jalali , Kshitij Khare , George Michailidis

Recent advances in coreset methods have shown that a selection of representative datapoints can replace massive volumes of data for Bayesian inference, preserving the relevant statistical information and significantly accelerating…

Machine Learning · Statistics 2023-01-18 Dionysis Manousakas , Hippolyt Ritter , Theofanis Karaletsos

Many statistical models can be simulated forwards but have intractable likelihoods. Approximate Bayesian Computation (ABC) methods are used to infer properties of these models from data. Traditionally these methods approximate the posterior…

Machine Learning · Statistics 2018-04-03 George Papamakarios , Iain Murray

Increasingly complex datasets pose a number of challenges for Bayesian inference. Conventional posterior sampling based on Markov chain Monte Carlo can be too computationally intensive, is serial in nature and mixes poorly between posterior…

Machine Learning · Statistics 2019-08-27 Edwin Fong , Simon Lyddon , Chris Holmes

The Bayesian approach to Inverse Problems relies predominantly on Markov Chain Monte Carlo methods for posterior inference. The typical nonlinear concentration of posterior measure observed in many such Inverse Problems presents severe…

Computation · Statistics 2016-02-17 Shiwei Lan , Tan Bui-Thanh , Mike Christie , Mark Girolami

Regression models for dichotomous data are ubiquitous in statistics. Besides being useful for inference on binary responses, these methods serve also as building blocks in more complex formulations, such as density regression, nonparametric…

Methodology · Statistics 2019-11-19 Daniele Durante

Many modern statistical applications involve inference for complicated stochastic models for which the likelihood function is difficult or even impossible to calculate, and hence conventional likelihood-based inferential echniques cannot be…

Computation · Statistics 2013-05-29 Simon R. White , Theodore Kypraios , Simon P. Preston

Bayesian statistical models allow us to formalise our knowledge about the world and reason about our uncertainty, but there is a need for better procedures to accurately encode its complexity. One way to do so is through compositional…

Computation · Statistics 2017-03-01 Maria Lomeli

Standard Bayesian inference is known to be sensitive to model misspecification, leading to unreliable uncertainty quantification and poor predictive performance. However, finding generally applicable and computationally feasible methods for…

Methodology · Statistics 2020-07-31 Jonathan H. Huggins , Jeffrey W. Miller