English
Related papers

Related papers: Black-box Importance Sampling

200 papers

Estimating the probability of failure is a critical step in developing safety-critical autonomous systems. Direct estimation methods such as Monte Carlo sampling are often impractical due to the rarity of failures in these systems. Existing…

Robotics · Computer Science 2024-12-04 Harrison Delecki , Sydney M. Katz , Mykel J. Kochenderfer

Importance sampling is a Monte Carlo method which designs estimators of expectations under a target distribution using weighted samples from a proposal distribution. When the target distribution is complex, such as multimodal distributions…

Methodology · Statistics 2026-02-04 Anas Cherradi , Yazid Janati , Alain Durmus , Sylvain Le Corff , Yohan Petetin , Julien Stoehr

Importance sampling is a rare event simulation technique used in Monte Carlo simulations to bias the sampling distribution towards the rare event of interest. By assigning appropriate weights to sampled points, importance sampling allows…

We show that for any multiple-try Metropolis algorithm, one can always accept the proposal and evaluate the importance weight that is needed to correct for the bias without extra computational cost. This results in a general, convenient,…

Computation · Statistics 2024-10-03 Guanxun Li , Aaron Smith , Quan Zhou

Driven by applications in telecommunication networks, we explore the simulation task of estimating rare event probabilities for tandem queues in their steady state. Existing literature has recognized that importance sampling methods can be…

Machine Learning · Computer Science 2025-04-22 Ruoning Zhao , Xinyun Chen

Recent work used importance sampling ideas for better variational bounds on likelihoods. We clarify the applicability of these ideas to pure probabilistic inference, by showing the resulting Importance Weighted Variational Inference (IWVI)…

Machine Learning · Computer Science 2018-10-30 Justin Domke , Daniel Sheldon

The marginal likelihood is a central tool for drawing Bayesian inference about the number of components in mixture models. It is often approximated since the exact form is unavailable. A bias in the approximation may be due to an incomplete…

Computation · Statistics 2014-11-14 Jeong Eun Lee , Christian P. Robert

Probabilistic numerics casts numerical tasks, such the numerical solution of differential equations, as inference problems to be solved. One approach is to model the unknown quantity of interest as a random variable, and to constrain this…

Numerical Analysis · Mathematics 2021-10-29 Onur Teymur , Christopher N. Foley , Philip G. Breen , Toni Karvonen , Chris. J. Oates

Importance sampling is a Monte Carlo technique for efficiently estimating the likelihood of rare events by biasing the sampling distribution towards the rare event of interest. By drawing weighted samples from a learned proposal…

Machine Learning · Statistics 2025-05-20 Liam A. Kruse , Marc R. Schlichting , Mykel J. Kochenderfer

Importance sampling is a technique that is commonly used to speed up Monte Carlo simulation of rare events. However, little is known regarding the design of efficient importance sampling algorithms in the context of queueing networks. The…

Probability · Mathematics 2009-09-29 Paul Dupuis , Ali Devin Sezer , Hui Wang

We present a practical and statistically consistent scheme for actively learning binary classifiers under general loss functions. Our algorithm uses importance weighting to correct sampling bias, and by controlling the variance, we are able…

Machine Learning · Computer Science 2009-05-20 Alina Beygelzimer , Sanjoy Dasgupta , John Langford

Computing the exact likelihood of data in large Bayesian networks consisting of thousands of vertices is often a difficult task. When these models contain many deterministic conditional probability tables and when the observed values are…

Computation · Statistics 2012-06-26 Ydo Wexler , Dan Geiger

This paper considers importance sampling for estimation of rare-event probabilities in a specific collection of Markovian jump processes used for e.g. modelling of credit risk. Previous attempts at designing importance sampling algorithms…

Probability · Mathematics 2021-12-02 Boualem Djehiche , Henrik Hult , Pierre Nyquist

Feature importance scores are ubiquitous tools for understanding the predictions of machine learning models. However, many popular attribution methods suffer from high instability due to random sampling. Leveraging novel ideas from…

Machine Learning · Statistics 2025-07-08 Jeremy Goldwasser , Giles Hooker

We introduce a class of acquisition functions for sample selection that leads to faster convergence in applications related to Bayesian experimental design and uncertainty quantification. The approach follows the paradigm of active…

Machine Learning · Statistics 2021-04-12 Antoine Blanchard , Themistoklis Sapsis

Distortion risk measures play a critical role in quantifying risks associated with uncertain outcomes. Accurately estimating these risk measures in the context of computationally expensive simulation models that lack analytical tractability…

Risk Management · Quantitative Finance 2025-08-29 Sören Bettels , Stefan Weber

A common approach for feature selection is to examine the variable importance scores for a machine learning model, as a way to understand which features are the most relevant for making predictions. Given the significance of feature…

Machine Learning · Computer Science 2021-05-13 Jack Dunn , Luca Mingardi , Ying Daisy Zhuo

Importance sampling is a popular variance reduction method for Monte Carlo estimation, where a notorious question is how to design good proposal distributions. While in most cases optimal (zero-variance) estimators are theoretically…

Statistics Theory · Mathematics 2021-02-22 Carsten Hartmann , Lorenz Richter

We present a subset selection algorithm designed to work with arbitrary model families in a practical batch setting. In such a setting, an algorithm can sample examples one at a time but, in order to limit overhead costs, is only able to…

Machine Learning · Computer Science 2023-01-31 Gui Citovsky , Giulia DeSalvo , Sanjiv Kumar , Srikumar Ramalingam , Afshin Rostamizadeh , Yunjuan Wang

Importance sampling is a widely used technique to reduce the variance of a Monte Carlo estimator by an appropriate change of measure. In this work, we study importance sam- pling in the framework of diffusion process and consider the change…

Probability · Mathematics 2018-03-28 Carsten Hartmann , Christof Schütte , Marcus Weber , Wei Zhang