English
Related papers

Related papers: Bayesian Subset Simulation: a kriging-based subset…

200 papers

Bayesian posterior distributions arising in modern applications, including inverse problems in partial differential equation models in tomography and subsurface flow, are often computationally intractable due to the large computational cost…

Machine Learning · Statistics 2023-02-10 Tapio Helin , Andrew Stuart , Aretha Teckentrup , Konstantinos Zygalakis

Bayesian optimization is a powerful global optimization technique for expensive black-box functions. One of its shortcomings is that it requires auxiliary optimization of an acquisition function at each iteration. This auxiliary…

Machine Learning · Statistics 2014-02-28 Ziyu Wang , Babak Shakibi , Lin Jin , Nando de Freitas

A fundamental task in numerical computation is the solution of large linear systems. The conjugate gradient method is an iterative method which offers rapid convergence to the solution, particularly when an effective preconditioner is…

Methodology · Statistics 2018-12-18 Jon Cockayne , Chris Oates , Ilse Ipsen , Mark Girolami

Bayesian inference is a powerful paradigm for quantum state tomography, treating uncertainty in meaningful and informative ways. Yet the numerical challenges associated with sampling from complex probability distributions hampers Bayesian…

Quantum Physics · Physics 2020-05-04 Joseph M. Lukens , Kody J. H. Law , Ajay Jasra , Pavel Lougovski

Approximate Bayesian computation (ABC) methods perform inference on model-specific parameters of mechanistically motivated parametric statistical models when evaluating likelihoods is difficult. Central to the success of ABC methods is…

Computation · Statistics 2013-01-29 Erkan O. Buzbas , Noah A. Rosenberg

In many instances, the application of approximate Bayesian methods is hampered by two practical features: 1) the requirement to project the data down to low-dimensional summary, including the choice of this projection, which ultimately…

Methodology · Statistics 2020-06-26 David T. Frazier

Consider scene understanding problems such as predicting where a person is probably reaching, or inferring the pose of 3D objects from depth images, or inferring the probable street crossings of pedestrians at a busy intersection. This…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Javier Felip , Nilesh Ahuja , David Gómez-Gutiérrez , Omesh Tickoo , Vikash Mansinghka

Approximate Bayesian computation (ABC) has become an essential tool for the analysis of complex stochastic models when the likelihood function is numerically unavailable. However, the well-established statistical method of empirical…

Computation · Statistics 2015-06-05 K. L. Mengersen , P. Pudlo , C. P. Robert

We propose an efficient meta-algorithm for Bayesian estimation problems that is based on low-degree polynomials, semidefinite programming, and tensor decomposition. The algorithm is inspired by recent lower bound constructions for…

Data Structures and Algorithms · Computer Science 2017-10-04 Samuel B. Hopkins , David Steurer

In this article, we present data-subsetting algorithms that allow for the approximate and scalable implementation of the Bayesian bootstrap. They are analogous to two existing algorithms in the frequentist literature: the bag of little…

Computation · Statistics 2019-03-25 Andrés F. Barrientos , Víctor Peña

Bayesian inference is an effective approach for solving statistical learning problems especially with uncertainty and incompleteness. However, inference efficiencies are physically limited by the bottlenecks of conventional computing…

Emerging Technologies · Computer Science 2017-11-06 Xiaotao Jia , Jianlei Yang , Zhaohao Wang , Yiran Chen , Hai , Li , Weisheng Zhao

Hyperparameter tuning is a challenging problem especially when the system itself involves uncertainty. Due to noisy function evaluations, optimization under uncertainty can be computationally expensive. In this paper, we present a novel…

Machine Learning · Computer Science 2025-10-09 Akash Yadav , Ruda Zhang

A crucial task in system identification problems is the selection of the most appropriate model class, and is classically addressed resorting to cross-validation or using asymptotic arguments. As recently suggested in the literature, this…

Numerical Analysis · Mathematics 2015-06-09 Silvia Bonettini , Alessandro Chiuso , Marco Prato

Many modern statistical applications involve inference for complex stochastic models, where it is easy to simulate from the models, but impossible to calculate likelihoods. Approximate Bayesian computation (ABC) is a method of inference for…

Methodology · Statistics 2015-03-14 Paul Fearnhead , Dennis Prangle

Optimization of complex functions, such as the output of computer simulators, is a difficult task that has received much attention in the literature. A less studied problem is that of optimization under unknown constraints, i.e., when the…

Methodology · Statistics 2010-07-06 Robert B. Gramacy , Herbert K. H. Lee

The automation of posterior inference in Bayesian data analysis has enabled experts and nonexperts alike to use more sophisticated models, engage in faster exploratory modeling and analysis, and ensure experimental reproducibility. However,…

Machine Learning · Statistics 2019-03-01 Trevor Campbell , Tamara Broderick

Given a multivariate function taking deterministic and uncertain inputs, we consider the problem of estimating a quantile set: a set of deterministic inputs for which the probability that the output belongs to a specific region remains…

Applications · Statistics 2025-07-25 Romain Ait Abdelmalek-Lomenech , Julien Bect , Emmanuel Vazquez

Simulation-based inference methods have been shown to be inaccurate in the data-poor regime, when training simulations are limited or expensive. Under these circumstances, the inference network is particularly prone to overfitting, and…

Computer experiments are becoming increasingly important in scientific investigations. In the presence of uncertainty, analysts employ probabilistic sensitivity methods to identify the key-drivers of change in the quantities of interest.…

Methodology · Statistics 2024-07-02 Isadora Antoniano-Villalobos , Emanuele Borgonovo , Xuefei Lu

Bayesian optimization is a technique for optimizing black-box target functions. At the core of Bayesian optimization is a surrogate model that predicts the output of the target function at previously unseen inputs to facilitate the…

Machine Learning · Computer Science 2022-03-04 Felix Jimenez , Matthias Katzfuss