English
Related papers

Related papers: Importance sampling with transformed weights

200 papers

The sampling importance resampling method is widely utilized in various fields, such as numerical integration and statistical simulation. In this paper, two modified methods are presented by incorporating two variance reduction techniques…

Computation · Statistics 2024-08-28 Yao Xiao , Kang Fu , Kun Li

More than twenty years after its introduction, Annealed Importance Sampling (AIS) remains one of the most effective methods for marginal likelihood estimation. It relies on a sequence of distributions interpolating between a tractable…

Machine Learning · Statistics 2022-10-25 Arnaud Doucet , Will Grathwohl , Alexander G. D. G. Matthews , Heiko Strathmann

Adaptive importance sampling (AIS) algorithms are widely used to approximate expectations with respect to complicated target probability distributions. When the target has heavy tails, existing AIS algorithms can provide inconsistent…

Computation · Statistics 2023-10-26 Thomas Guilmeau , Nicola Branchini , Emilie Chouzenoux , Víctor Elvira

A recently introduced Importance Sampling strategy based on a least squares optimization is applied to the Monte Carlo simulation of Libor Market Models. Such Least Squares Importance Sampling (LSIS) allows the automatic optimization of the…

Pricing of Securities · Quantitative Finance 2008-12-02 Luca Capriotti

Inverse Probability Weighting (IPW) is widely used in empirical work in economics and other disciplines. As Gaussian approximations perform poorly in the presence of "small denominators," trimming is routinely employed as a regularization…

Econometrics · Economics 2019-05-28 Xinwei Ma , Jingshen Wang

Informed Markov chain Monte Carlo (MCMC) methods have been proposed as scalable solutions to Bayesian posterior computation on high-dimensional discrete state spaces, but theoretical results about their convergence behavior in general…

Computation · Statistics 2022-02-01 Quan Zhou , Aaron Smith

Bayesian neural networks (BNNs) have received an increased interest in the last years. In BNNs, a complete posterior distribution of the unknown weight and bias parameters of the network is produced during the training stage. This…

Machine Learning · Computer Science 2023-04-14 Yunshi Huang , Emilie Chouzenoux , Victor Elvira , Jean-Christophe Pesquet

Importance sampling is a promising variance reduction technique for Monte Carlo simulation based derivative pricing. Existing importance sampling methods are based on a parametric choice of the proposal. This article proposes an algorithm…

Applications · Statistics 2009-04-14 Jan C. Neddermeyer

Acceptance-rejection (AR), Independent Metropolis Hastings (IMH) or importance sampling (IS) Monte Carlo (MC) simulation algorithms all involve computing ratios of probability density functions (pdfs). On the other hand, classifiers…

Methodology · Statistics 2023-09-11 Elouan Argouarc'h , François Desbouvries

In parameter estimation problems one computes a posterior distribution over uncertain parameters defined jointly by a prior distribution, a model, and noisy data. Markov Chain Monte Carlo (MCMC) is often used for the numerical solution of…

Numerical Analysis · Mathematics 2017-11-15 Matthias Morzfeld , Marcus S. Day , Ray W. Grout , George Shu Heng Pau , Stefan A. Finsterle , John B. Bell

We present a new method for conducting Monte Carlo inference in graphical models which combines explicit search with generalized importance sampling. The idea is to reduce the variance of importance sampling by searching for significant…

Machine Learning · Computer Science 2013-01-18 Dale Schuurmans , Finnegan Southey

Biasing or importance sampling is a powerful technique in Monte Carlo radiative transfer, and can be applied in different forms to increase the accuracy and efficiency of simulations. One of the drawbacks of the use of biasing is the…

Instrumentation and Methods for Astrophysics · Physics 2016-05-11 Maarten Baes , Karl D. Gordon , Tuomas Lunttila , Simone Bianchi , Peter Camps , Mika Juvela , Rolf Kuiper

Importance sampling is a central idea underlying off-policy prediction in reinforcement learning. It provides a strategy for re-weighting samples from a distribution to obtain unbiased estimates under another distribution. However,…

Machine Learning · Computer Science 2023-06-28 Kristopher De Asis , Eric Graves , Richard S. Sutton

Importance sampling Monte-Carlo methods are widely used for the approximation of expectations with respect to partially known probability measures. In this paper we study a deterministic version of such an estimator based on quasi-Monte…

Computation · Statistics 2024-12-20 Josef Dick , Daniel Rudolf , Houying Zhu

We investigate the stability of a Sequential Monte Carlo (SMC) method applied to the problem of sampling from a target distribution on $\mathbb{R}^d$ for large $d$. It is well known that using a single importance sampling step one produces…

Computation · Statistics 2012-04-19 Alexandros Beskos , Dan Crisan , Ajay Jasra

To efficiently evaluate system reliability based on Monte Carlo simulation, importance sampling is used widely. The optimal importance sampling density was derived in 1950s for the deterministic simulation model, which maps an input to an…

Methodology · Statistics 2019-06-04 Quoc Dung Cao , Youngjun Choe

Driven by several successful applications such as in stochastic gradient descent or in Bayesian computation, control variates have become a major tool for Monte Carlo integration. However, standard methods do not allow the distribution of…

Machine Learning · Statistics 2022-10-06 Rémi Leluc , François Portier , Johan Segers , Aigerim Zhuman

We propose a method to efficiently integrate truncated probability densities. The method uses Markov chain Monte Carlo method to sample from a probability density matching the function being integrated. The required normalisation or…

Computation · Statistics 2013-12-10 A. John Arul , Kannan Iyer

In Part I (arXiv:1911.00619) of this article, we proposed an importance sampling algorithm to compute rare-event probabilities in forward uncertainty quantification problems. The algorithm, which we termed the "Bayesian Inverse Monte Carlo…

Computation · Statistics 2019-11-06 Siddhant Wahal , George Biros

Importance sampling has been successfully used to accelerate stochastic optimization in many convex problems. However, the lack of an efficient way to calculate the importance still hinders its application to Deep Learning. In this paper,…

Machine Learning · Computer Science 2017-09-14 Angelos Katharopoulos , François Fleuret