English
Related papers

Related papers: Gradient-based Adaptive Importance Samplers

200 papers

In this work, we analyze the noisy importance sampling (IS), i.e., IS working with noisy evaluations of the target density. We present the general framework and derive optimal proposal densities for noisy IS estimators. The optimal…

Machine Learning · Statistics 2022-01-24 Fernando Llorente , Luca Martino , Jesse Read , David Delgado-Gómez

Adaptive sampling algorithms are modern and efficient methods that dynamically adjust the sample size throughout the optimization process. However, they may encounter difficulties in risk-averse settings, particularly due to the challenge…

Optimization and Control · Mathematics 2025-02-17 Sandra Pieraccini , Tommaso Vanzan

The popularity of Adaptive MCMC has been fueled on the one hand by its success in applications, and on the other hand, by mathematically appealing and computationally straightforward optimisation criteria for the Metropolis algorithm…

Computation · Statistics 2018-01-30 Cyril Chimisov , Krzysztof Latuszynski , Gareth Roberts

Reducing the variance of the gradient estimator is known to improve the convergence rate of stochastic gradient-based optimization and sampling algorithms. One way of achieving variance reduction is to design importance sampling strategies.…

Machine Learning · Computer Science 2021-03-24 Ayoub El Hanchi , David A. Stephens

Importance sampling is a popular method for efficient computation of various properties of a distribution such as probabilities, expectations, quantiles etc. The output of an importance sampling algorithm can be represented as a weighted…

Probability · Mathematics 2016-04-18 Henrik Hult , Pierre Nyquist

We develop an efficient posterior sampling scheme for the Poisson INGARCH models. The proposed method is based on the approximation of the posterior density that exploits the Poisson limit of the negative binomial distribution. It allows us…

Methodology · Statistics 2026-03-10 Yixuan Fan , Zhengwei Liu , Fukang Zhu

This paper derives two new optimization-driven Monte Carlo algorithms inspired from variable splitting and data augmentation. In particular, the formulation of one of the proposed approaches is closely related to the alternating direction…

Methodology · Statistics 2019-03-27 Maxime Vono , Nicolas Dobigeon , Pierre Chainais

Piecewise deterministic Markov processes (PDMPs) can be used to model complex dynamical industrial systems. The counterpart of this modeling capability is their simulation cost, which makes reliability assessment untractable with standard…

Computation · Statistics 2023-06-08 Guillaume Chennetier , Hassane Chraibi , Anne Dutfoy , Josselin Garnier

In modern data analysis, random sampling is an efficient and widely-used strategy to overcome the computational difficulties brought by large sample size. In previous studies, researchers conducted random sampling which is according to the…

Machine Learning · Statistics 2018-03-05 Rong Zhu

This study presents an importance sampling formulation based on adaptively relaxing parameters from the indicator function and/or the probability density function. The formulation embodies the prevalent mathematical concept of relaxing a…

Applications · Statistics 2024-04-11 Jianhua Xian , Ziqi Wang

We develop a theoretical framework for studying numerical estimation of lower previsions, generally applicable to two-level Monte Carlo methods, importance sampling methods, and a wide range of other sampling methods one might devise. We…

Computation · Statistics 2018-07-12 Matthias C. M. Troffaes

Path integral (PI) control problems are a restricted class of non-linear control problems that can be solved formally as a Feyman-Kac path integral and can be estimated using Monte Carlo sampling. In this contribution we review path…

Systems and Control · Computer Science 2016-03-23 Hilbert Johan Kappen , Hans Christian Ruiz

Importance sampling is a technique that is commonly used to speed up Monte Carlo simulation of rare events. However, little is known regarding the design of efficient importance sampling algorithms in the context of queueing networks. The…

Probability · Mathematics 2009-09-29 Paul Dupuis , Ali Devin Sezer , Hui Wang

Bayesian inference for doubly-intractable pairwise exponential graphical models typically involves variations of the exchange algorithm or approximate Markov chain Monte Carlo (MCMC) samplers. However, existing methods for both classes of…

Computation · Statistics 2026-03-30 Yujie Chen , Antik Chakraborty , Anindya Bhadra

Importance sampling and independent Metropolis-Hastings (IMH) are among the fundamental building blocks of Monte Carlo methods. Both require a proposal distribution that globally approximates the target distribution. The Radon-Nikodym…

Statistics Theory · Mathematics 2025-06-17 George Deligiannidis , Pierre E. Jacob , El Mahdi Khribch , Guanyang Wang

We present a new method for conducting Monte Carlo inference in graphical models which combines explicit search with generalized importance sampling. The idea is to reduce the variance of importance sampling by searching for significant…

Machine Learning · Computer Science 2013-01-18 Dale Schuurmans , Finnegan Southey

We describe an adaptive importance sampling algorithm for rare events that is based on a dual stochastic control formulation of a path sampling problem. Specifically, we focus on path functionals that have the form of cumulate generating…

Dynamical Systems · Mathematics 2019-01-30 Omar Kebiri , Lara Neureither , Carsten Hartmann

Estimating the parameters of compact binaries which coalesce and produce gravitational waves is a challenging Bayesian inverse problem. Gravitational-wave parameter estimation lies within the class of multifidelity problems, where a variety…

General Relativity and Quantum Cosmology · Physics 2024-05-31 Bassel Saleh , Aaron Zimmerman , Peng Chen , Omar Ghattas

In this paper, we propose an adaptive algorithm that iteratively updates both the weights and component parameters of a mixture importance sampling density so as to optimise the importance sampling performances, as measured by an entropy…

Computation · Statistics 2009-08-18 Olivier Cappé , Randal Douc , Arnaud Guillin , Jean-Michel Marin , Christian P. Robert

This paper deals with the estimation of rare event probabilities using importance sampling (IS), where an optimal proposal distribution is computed with the cross-entropy (CE) method. Although, IS optimized with the CE method leads to an…

Computation · Statistics 2020-02-05 Patrick Héas