English
Related papers

Related papers: Langevin Bi-fidelity Importance Sampling for Failu…

200 papers

The Integrated Nested Laplace Approximation (INLA) is a deterministic approach to Bayesian inference on latent Gaussian models (LGMs) and focuses on fast and accurate approximation of posterior marginals for the parameters in the models.…

Computation · Statistics 2021-03-05 Martin Outzen Berild , Sara Martino , Virgilio Gómez-Rubio , Håvard Rue

Likelihood-free inference involves inferring parameter values given observed data and a simulator model. The simulator is computer code which takes parameters, performs stochastic calculations, and outputs simulated data. In this work, we…

Computation · Statistics 2023-01-30 Dennis Prangle , Cecilia Viscardi

We present a multi-fidelity method for uncertainty quantification of parameter estimates in complex systems, leveraging generative models trained to sample the target conditional distribution. In the Bayesian inference setting, traditional…

Machine Learning · Computer Science 2025-04-03 Caroline Tatsuoka , Minglei Yang , Dongbin Xiu , Guannan Zhang

The basic idea of importance sampling is to use independent samples from a proposal measure in order to approximate expectations with respect to a target measure. It is key to understand how many samples are required in order to guarantee…

Computation · Statistics 2017-01-17 S. Agapiou , O. Papaspiliopoulos , D. Sanz-Alonso , A. M. Stuart

In this work, we develop a multi-fidelity Bayesian experimental design framework to efficiently quantify the extreme-event statistics of an input-to-response (ItR) system with given input probability and expensive function evaluations. The…

Fluid Dynamics · Physics 2022-01-04 Xianliang Gong , Yulin Pan

Precision achieved by stochastic sampling algorithms for Bayesian networks typically deteriorates in face of extremely unlikely evidence. To address this problem, we propose the Evidence Pre-propagation Importance Sampling algorithm…

Artificial Intelligence · Computer Science 2012-12-12 Changhe Yuan , Marek J. Druzdzel

For machine learning models trained with limited labeled training data, validation stands to become the main bottleneck to reducing overall annotation costs. We propose a statistical validation algorithm that accurately estimates the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Fait Poms , Vishnu Sarukkai , Ravi Teja Mullapudi , Nimit S. Sohoni , William R. Mark , Deva Ramanan , Kayvon Fatahalian

The quality and quantity of data used for training greatly influence the performance and effectiveness of deep learning models. In the context of error correction, it is essential to generate high-quality samples that are neither…

Information Theory · Computer Science 2026-03-23 Hassan Noghrei , Mohammad-Reza Sadeghi , Wai Ho Mow

In Bayesian inference, we seek to compute information about random variables such as moments or quantiles on the basis of {available data} and prior information. When the distribution of random variables is {intractable}, Monte Carlo (MC)…

Statistics Theory · Mathematics 2021-04-06 Alec Koppel , Amrit Singh Bedi , Brian M. Sadler , Victor Elvira

We explore efficient estimation of statistical quantities, particularly rare event probabilities, for stochastic reaction networks. Consequently, we propose an importance sampling (IS) approach to improve the Monte Carlo (MC) estimator…

Numerical Analysis · Mathematics 2024-03-12 Chiheb Ben Hammouda , Nadhir Ben Rached , Raúl Tempone , Sophia Wiechert

Laplace Neural Operators (LNOs) have recently emerged as a promising approach in scientific machine learning due to the ability to learn nonlinear maps between functional spaces. However, this framework often requires substantial amounts of…

Machine Learning · Computer Science 2025-02-04 Haoyang Zheng , Guang Lin

Inference for high-dimensional logistic regression models using penalized methods has been a challenging research problem. As an illustration, a major difficulty is the significant bias of the Lasso estimator, which limits its direct…

Methodology · Statistics 2024-10-29 Yuming Zhang , Stéphane Guerrier , Runze Li

Statistical models can involve implicitly defined quantities, such as solutions to nonlinear ordinary differential equations (ODEs), that unavoidably need to be numerically approximated in order to evaluate the model. The approximation…

Computation · Statistics 2024-09-16 Juho Timonen , Nikolas Siccha , Ben Bales , Harri Lähdesmäki , Aki Vehtari

Bayesian inference provides a principled framework for probabilistic reasoning. If inference is performed in two steps, uncertainty propagation plays a crucial role in accounting for all sources of uncertainty and variability. This becomes…

Methodology · Statistics 2026-02-16 Svenja Jedhoff , Hadi Kutabi , Anne Meyer , Paul-Christian Bürkner

A ubiquitous challenge in design space exploration or uncertainty quantification of complex engineering problems is the minimization of computational cost. A useful tool to ease the burden of solving such systems is model reduction. This…

Numerical Analysis · Mathematics 2021-04-16 Felix Newberry , Jerrad Hampton , Kenneth Jansen , Alireza Doostan

In this paper we study simulation-based methods for estimating gradients in stochastic networks. We derive a new method of calculating weak derivative estimator using importance sampling transform, and our method has less computational cost…

Methodology · Statistics 2023-03-28 Cheng Jie , Michael C Fu

We develop a theoretical framework for studying numerical estimation of lower previsions, generally applicable to two-level Monte Carlo methods, importance sampling methods, and a wide range of other sampling methods one might devise. We…

Computation · Statistics 2018-07-12 Matthias C. M. Troffaes

Bayesian inverse problems use data to update a prior probability distribution on uncertain parameter values to a posterior distribution. Such problems arise in many structural engineering applications, but computational solution of Bayesian…

Numerical Analysis · Mathematics 2026-05-26 Jakob Scheffels , Elizabeth Qian , Iason Papaioannou , Elisabeth Ullmann

Running a reliability analysis on engineering problems involving complex numerical models can be computationally very expensive, requiring advanced simulation methods to reduce the overall numerical cost. Gaussian process based active…

Machine Learning · Statistics 2020-12-01 Morgane Menz , Sylvain Dubreuil , Jérôme Morio , Christian Gogu , Nathalie Bartoli , Marie Chiron

Error bounds are derived for sampling and estimation using a discretization of an intrinsically defined Langevin diffusion with invariant measure $\text{d}\mu_\phi \propto e^{-\phi} \mathrm{dvol}_g $ on a compact Riemannian manifold. Two…

Statistics Theory · Mathematics 2025-12-10 Karthik Bharath , Alexander Lewis , Akash Sharma , Michael V Tretyakov