English
Related papers

Related papers: Implicitly Adaptive Importance Sampling

200 papers

We consider Monte Carlo approximations to the maximum likelihood estimator in models with intractable norming constants. This paper deals with adaptive Monte Carlo algorithms, which adjust control parameters in the course of simulation. We…

Methodology · Statistics 2016-12-08 Blazej Miasojedow , Wojciech Niemiro , Jan Palczewski , Wojciech Rejchel

We describe an adaptive importance sampling algorithm for rare events that is based on a dual stochastic control formulation of a path sampling problem. Specifically, we focus on path functionals that have the form of cumulate generating…

Dynamical Systems · Mathematics 2019-01-30 Omar Kebiri , Lara Neureither , Carsten Hartmann

Importance sampling is a Monte Carlo technique for efficiently estimating the likelihood of rare events by biasing the sampling distribution towards the rare event of interest. By drawing weighted samples from a learned proposal…

Machine Learning · Statistics 2025-05-20 Liam A. Kruse , Marc R. Schlichting , Mykel J. Kochenderfer

Importance sampling is a widely used technique to estimate properties of a distribution. This paper investigates trading-off some bias for variance by adaptively winsorizing the importance sampling estimator. The novel winsorizing…

Computation · Statistics 2021-02-10 Paulo Orenstein

Importance sampling (IS) is a Monte Carlo methodology that allows for approximation of a target distribution using weighted samples generated from another proposal distribution. Adaptive importance sampling (AIS) implements an iterative…

Computation · Statistics 2018-06-04 Yousef El-Laham , Victor Elvira , Monica F. Bugallo

Adaptive Monte Carlo methods are recent variance reduction techniques. In this work, we propose a mathematical setting which greatly relaxes the assumptions needed by for the adaptive importance sampling techniques presented by Vazquez-Abad…

Computational Finance · Quantitative Finance 2011-04-28 Bernard Lapeyre , Jérôme Lelong

This paper is concerned with Bayesian inference when the likelihood is analytically intractable but can be unbiasedly estimated. We propose an annealed importance sampling procedure for estimating expectations with respect to the posterior.…

Methodology · Statistics 2014-02-26 M. -N. Tran , C. Strickland , M. K. Pitt , R. Kohn

Importance sampling has been known as a powerful tool to reduce the variance of Monte Carlo estimator for rare event simulation. Based on the criterion of minimizing the variance of Monte Carlo estimator within a parametric family, we…

Methodology · Statistics 2013-02-11 Cheng-Der Fuh , Huei-Wen Teng , Ren-Her Wang

Increased access to computing resources has led to the development of algorithms that can run efficiently on multi-core processing units or in distributed computing environments. In the context of Bayesian inference, many parallel computing…

Methodology · Statistics 2025-09-11 Daniel Würzler Barreto , Mevin B. Hooten

Importance sampling is a well developed method in statistics. Given a random variable $X$, the problem of estimating its expected value $\mu$ is addressed. The standard approach is to use the sample mean as an estimator $\bar x$. In…

Applications · Statistics 2014-05-09 Georg Hofmann

We develop a theoretical framework for studying numerical estimation of lower previsions, generally applicable to two-level Monte Carlo methods, importance sampling methods, and a wide range of other sampling methods one might devise. We…

Computation · Statistics 2018-07-12 Matthias C. M. Troffaes

Importance weighting is a general way to adjust Monte Carlo integration to account for draws from the wrong distribution, but the resulting estimate can be highly variable when the importance ratios have a heavy right tail. This routinely…

Computation · Statistics 2024-04-12 Aki Vehtari , Daniel Simpson , Andrew Gelman , Yuling Yao , Jonah Gabry

Importance sampling is a technique that is commonly used to speed up Monte Carlo simulation of rare events. However, little is known regarding the design of efficient importance sampling algorithms in the context of queueing networks. The…

Probability · Mathematics 2009-09-29 Paul Dupuis , Ali Devin Sezer , Hui Wang

Bayesian inference under a set of priors, called robust Bayesian analysis, allows for estimation of parameters within a model and quantification of epistemic uncertainty in quantities of interest by bounded (or imprecise) probability.…

Computation · Statistics 2022-07-15 Ivette Raices Cruz , Johan Lindström , Matthias C. M. Troffaes , Ullrika Sahlin

Importance sampling is a widely used technique to reduce the variance of a Monte Carlo estimator by an appropriate change of measure. In this work, we study importance sam- pling in the framework of diffusion process and consider the change…

Probability · Mathematics 2018-03-28 Carsten Hartmann , Christof Schütte , Marcus Weber , Wei Zhang

In parameter estimation problems one computes a posterior distribution over uncertain parameters defined jointly by a prior distribution, a model, and noisy data. Markov Chain Monte Carlo (MCMC) is often used for the numerical solution of…

Numerical Analysis · Mathematics 2017-11-15 Matthias Morzfeld , Marcus S. Day , Ray W. Grout , George Shu Heng Pau , Stefan A. Finsterle , John B. Bell

Computing the exact likelihood of data in large Bayesian networks consisting of thousands of vertices is often a difficult task. When these models contain many deterministic conditional probability tables and when the observed values are…

Computation · Statistics 2012-06-26 Ydo Wexler , Dan Geiger

The basic idea of importance sampling is to use independent samples from a proposal measure in order to approximate expectations with respect to a target measure. It is key to understand how many samples are required in order to guarantee…

Computation · Statistics 2017-01-17 S. Agapiou , O. Papaspiliopoulos , D. Sanz-Alonso , A. M. Stuart

Importance Sampling methods are broadly used to approximate posterior distributions or some of their moments. In its standard approach, samples are drawn from a single proposal distribution and weighted properly. However, since the…

Computation · Statistics 2019-11-05 Víctor Elvira , Luca Martino , David Luengo , Mónica F. Bugallo

Large deviation theory has provided important clues for the choice of importance sampling measures for Monte Carlo evaluation of exceedance probabilities. However, Glasserman and Wang [Ann. Appl. Probab. 7 (1997) 731--746] have given…

Probability · Mathematics 2007-05-23 Hock Peng Chan , Tze Leung Lai