English
Related papers

Related papers: Enhancing evidence estimation through informed pro…

200 papers

This paper develops a multifidelity method that enables estimation of failure probabilities for expensive-to-evaluate models via information fusion and importance sampling. The presented general fusion method combines multiple probability…

Likelihood-free inference (LFI) methods, such as approximate Bayesian computation, have become commonplace for conducting inference in complex models. Many approaches are based on summary statistics or discrepancies derived from synthetic…

Methodology · Statistics 2025-06-06 David T. Frazier , Christopher Drovandi , Lucas Kock , David J. Nott

The motivation for this paper stems from the desire to develop an adaptive sampling method for solving constrained optimization problems in which the objective function is stochastic and the constraints are deterministic. The method…

Optimization and Control · Mathematics 2021-01-01 Yuchen Xie , Raghu Bollapragada , Richard Byrd , Jorge Nocedal

We develop rigorous estimates and provably convergent approximations for the memory integral in the Mori-Zwanzig (MZ) formulation. The new theory is built upon rigorous mathematical foundations and is presented for both state-space and…

Numerical Analysis · Mathematics 2018-10-17 Yuanran Zhu , Jason M. Dominy , Daniele Venturi

The Horvitz-Thompson (HT) estimator is widely used in survey sampling. However, the variance of the HT estimator becomes large when the inclusion probabilities are highly heterogeneous. To overcome this shortcoming, in this paper, a…

Methodology · Statistics 2018-04-13 Xianpeng Zong , Rong Zhu , Guohua Zou

The statistical evidence (or marginal likelihood) is a key quantity in Bayesian statistics, allowing one to assess the probability of the data given the model under investigation. This paper focuses on refining the power posterior approach…

Computation · Statistics 2013-06-14 Nial Friel , Merrilee Hurn , Jason Wyse

Sequential Monte Carlo has become a standard tool for Bayesian Inference of complex models. This approach can be computationally demanding, especially when initialized from the prior distribution. On the other hand, deter-ministic…

Methodology · Statistics 2017-07-26 Sophie Donnet , Stéphane Robin

We propose a novel approximate inference algorithm that approximates a target distribution by amortising the dynamics of a user-selected MCMC sampler. The idea is to initialise MCMC using samples from an approximation network, apply the…

Machine Learning · Statistics 2017-05-23 Yingzhen Li , Richard E. Turner , Qiang Liu

Optimization is widely used in statistics, and often efficiently delivers point estimates on useful spaces involving structural constraints or combinatorial structure. To quantify uncertainty, Gibbs posterior exponentiates the negative loss…

Methodology · Statistics 2025-07-23 Cheng Zeng , Eleni Dilma , Jason Xu , Leo L Duan

Information projections are the key building block of variational inference algorithms and are used to approximate a target probabilistic model by projecting it onto a family of tractable distributions. In general, there is no guarantee on…

Machine Learning · Computer Science 2015-10-06 Lun-Kai Hsu , Tudor Achim , Stefano Ermon

Variational inference approximates the posterior distribution of a probabilistic model with a parameterized density by maximizing a lower bound for the model evidence. Modern solutions fit a flexible approximation with stochastic gradient…

Machine Learning · Statistics 2017-07-13 Joseph Sakaya , Arto Klami

We consider the problem of sampling from a posterior distribution arising in Bayesian inverse problems in science, engineering, and imaging. Our method belongs to the family of independence Metropolis-Hastings (IMH) sampling algorithms,…

Machine Learning · Computer Science 2026-05-19 Youguang Chen , George Biros

We propose a randomized a posteriori error estimator for reduced order approximations of parametrized (partial) differential equations. The error estimator has several important properties: the effectivity is close to unity with prescribed…

Numerical Analysis · Mathematics 2019-04-02 Kathrin Smetana , Olivier Zahm , Anthony T Patera

Simulation-based inference enables learning the parameters of a model even when its likelihood cannot be computed in practice. One class of methods uses data simulated with different parameters to infer models of the likelihood-to-evidence…

Machine Learning · Computer Science 2022-06-08 Giulio Isacchini , Natanael Spisak , Armita Nourmohammad , Thierry Mora , Aleksandra M. Walczak

It has become increasingly easy nowadays to collect approximate posterior samples via fast algorithms such as variational Bayes, but concerns exist about the estimation accuracy. It is tempting to build solutions that exploit approximate…

Computation · Statistics 2024-06-17 Leo L. Duan , Anirban Bhattacharya

Estimating the marginal likelihoods is an essential feature of model selection in the Bayesian context. It is especially crucial to have good estimates when assessing the number of planets orbiting stars when the models explain the noisy…

Earth and Planetary Astrophysics · Physics 2015-06-03 Mikko Tuomi , Hugh R. A. Jones

Approximations by Trefftz functions are rapidly gaining popularity in the numerical solution of boundary value problems of mathematical physics. By definition, these functions satisfy locally, in weak form, the underlying differential…

Computational Physics · Physics 2018-08-24 Igor Tsukerman , Shampy Mansha , Y. D. Chong , Vadim A. Markel

Importance sampling is a popular technique in Bayesian inference: by reweighting samples drawn from a proposal distribution we are able to obtain samples and moment estimates from a Bayesian posterior over latent variables. Recent work,…

Computation · Statistics 2024-06-19 Sam Bowyer , Thomas Heap , Laurence Aitchison

Contrasting marginal counterfactual survival curves across treatment arms is an effective and popular approach for inferring the causal effect of an intervention on a right-censored time-to-event outcome. A key challenge to drawing such…

Methodology · Statistics 2022-04-29 Andrew Ying , Yifan Cui , Eric J. Tchetgen Tchetgen

We provide a general framework for learning diffusion bridges that transport prior to target distributions. It includes existing diffusion models for generative modeling, but also underdamped versions with degenerate diffusion matrices,…

Machine Learning · Computer Science 2025-08-14 Denis Blessing , Julius Berner , Lorenz Richter , Gerhard Neumann