English
Related papers

Related papers: Langevin Incremental Mixture Importance Sampling

200 papers

Importance sampling is a Monte Carlo method that introduces a proposal distribution to sample the space according to the target distribution. Yet calibration of the proposal distribution is essential to achieving efficiency, thus the resort…

Computation · Statistics 2022-06-17 Grégoire Aufort , Pierre Pudlo , Denis Burgarella

Importance sampling (IS) and numerical integration methods are usually employed for approximating moments of complicated target distributions. In its basic procedure, the IS methodology randomly draws samples from a proposal distribution…

Computation · Statistics 2022-04-12 Víctor Elvira , Luca Martino , Pau Closas

Importance sampling (IS) is a powerful Monte Carlo (MC) methodology for approximating integrals, for instance in the context of Bayesian inference. In IS, the samples are simulated from the so-called proposal distribution, and the choice of…

Machine Learning · Computer Science 2022-09-29 Ali Mousavi , Reza Monsefi , Víctor Elvira

We present the Liouville Flow Importance Sampler (LFIS), an innovative flow-based model for generating samples from unnormalized density functions. LFIS learns a time-dependent velocity field that deterministically transports samples from a…

Machine Learning · Statistics 2024-06-11 Yifeng Tian , Nishant Panda , Yen Ting Lin

Importance sampling is a rare event simulation technique used in Monte Carlo simulations to bias the sampling distribution towards the rare event of interest. By assigning appropriate weights to sampled points, importance sampling allows…

More than twenty years after its introduction, Annealed Importance Sampling (AIS) remains one of the most effective methods for marginal likelihood estimation. It relies on a sequence of distributions interpolating between a tractable…

Machine Learning · Statistics 2022-10-25 Arnaud Doucet , Will Grathwohl , Alexander G. D. G. Matthews , Heiko Strathmann

Importance Sampling (IS) is a widely used variance reduction technique for enhancing the efficiency of Monte Carlo methods, particularly in rare-event simulation and related applications. Despite its effectiveness, the performance of IS is…

Optimization and Control · Mathematics 2026-02-11 Liviu Aolaritei , Bart P. G. Van Parys , Henry Lam , Michael I. Jordan

Importance sampling is a powerful tool for correcting the distributional mismatch in many statistical and machine learning problems, but in practice its performance is limited by the usage of simple proposals whose importance weights can be…

Methodology · Statistics 2024-01-02 Chaofan Huang , V. Roshan Joseph

Importance sampling is a Monte Carlo method which designs estimators of expectations under a target distribution using weighted samples from a proposal distribution. When the target distribution is complex, such as multimodal distributions…

Methodology · Statistics 2026-02-04 Anas Cherradi , Yazid Janati , Alain Durmus , Sylvain Le Corff , Yohan Petetin , Julien Stoehr

Importance Sampling (IS) is a method for approximating expectations under a target distribution using independent samples from a proposal distribution and the associated importance weights. In many applications, the target distribution is…

Machine Learning · Statistics 2022-09-14 Gabriel Cardoso , Sergey Samsonov , Achille Thin , Eric Moulines , Jimmy Olsson

We proposed a new technique to accelerate sampling methods for solving difficult optimization problems. Our method investigates the intrinsic connection between posterior distribution sampling and optimization with Langevin dynamics, and…

Machine Learning · Computer Science 2023-01-31 Junlong Lyu , Zhitang Chen , Wenlong Lyu , Jianye Hao

This paper proposes a general optimization strategy, which combines results from different optimization or parameter estimation methods to overcome shortcomings of a single method. Shotgun optimization is developed as a framework which…

Computation · Statistics 2017-11-15 Biljana Jonoska Stojkova , David A. Campbell

Importance sampling (IS) is a Monte Carlo methodology that allows for approximation of a target distribution using weighted samples generated from another proposal distribution. Adaptive importance sampling (AIS) implements an iterative…

Computation · Statistics 2018-06-04 Yousef El-Laham , Victor Elvira , Monica F. Bugallo

Importance sampling (IS) is a widely used simulation method for estimating rare event probabilities. In IS, the relative variance of an estimator is the most common measure of estimator accuracy, and the focus of existing literature is on…

Statistics Theory · Mathematics 2026-01-05 Julie Choi , Peter Glynn

We study sampling from posterior distributions in Bayesian linear inverse problems where $A$, the parameters to observables operator, is computationally expensive. In many applications, $A$ can be factored in a manner that facilitates the…

Machine Learning · Statistics 2026-05-19 Youguang Chen , George Biros

This paper introduces a sequential multiple importance sampling (SeMIS) algorithm for high-dimensional Bayesian inference. The method estimates Bayesian evidence using all generated samples from each proposal distribution while obtaining…

Methodology · Statistics 2025-07-08 Li Binbin , He Xiao , Liao Zihan

We propose a new method called the Metropolis-adjusted Mirror Langevin algorithm for approximate sampling from distributions whose support is a compact and convex set. This algorithm adds an accept-reject filter to the Markov chain induced…

Computation · Statistics 2024-06-24 Vishwak Srinivasan , Andre Wibisono , Ashia Wilson

Multiple Importance Sampling (MIS) methods approximate moments of complicated distributions by drawing samples from a set of proposal distributions. Several ways to compute the importance weights assigned to each sample have been recently…

Computation · Statistics 2016-09-16 Víctor Elvira , Luca Martino , David Luengo , Mónica F. Bugallo

The naive importance sampling (IS) estimator generally does not work well in examples involving simultaneous inference on several targets, as the importance weights can take arbitrarily large values, making the estimator highly unstable. In…

Methodology · Statistics 2022-04-20 Vivekananda Roy , Evangelos Evangelou

Recent advances in Markov chain Monte Carlo (MCMC) extend the scope of Bayesian inference to models for which the likelihood function is intractable. Although these developments allow us to estimate model parameters, other basic problems…

Computation · Statistics 2019-12-12 Minh-Ngoc Tran , Marcel Scharth , David Gunawan , Robert Kohn , Scott D. Brown , Guy E. Hawkins