English
Related papers

Related papers: Learning-Based Importance Sampling via Stochastic …

200 papers

Sampling rare events in metastable dynamical systems is often a computationally expensive task and one needs to resort to enhanced sampling methods such as importance sampling. Since we can formulate the problem of finding optimal…

Optimization and Control · Mathematics 2023-10-05 Enric Ribera Borrell , Jannes Quer , Lorenz Richter , Christof Schütte

The self-normalized importance sampling (SNIS) estimator is a Monte Carlo estimator widely used to approximate expectations in statistical signal processing and machine learning. The efficiency of SNIS depends on the choice of proposal, but…

Computation · Statistics 2025-05-06 Nicola Branchini , Víctor Elvira

The assessment of the probability of a rare event with a naive Monte-Carlo method is computationally intensive, so faster estimation or variance reduction methods are needed. We focus on one of these methods which is the interacting…

Statistics Theory · Mathematics 2020-11-06 H. Chraibi , A. Dutfoy , T. Galtier , J. Garnier

Importance sampling is a rare event simulation technique used in Monte Carlo simulations to bias the sampling distribution towards the rare event of interest. By assigning appropriate weights to sampled points, importance sampling allows…

Importance sampling (IS) is a powerful Monte Carlo methodology for the approximation of intractable integrals, very often involving a target probability density function. The performance of IS heavily depends on the appropriate selection of…

Computation · Statistics 2023-06-22 Víctor Elvira , Emilie Chouzenoux , Ömer Deniz Akyildiz , Luca Martino

Machine learning optimization often depends on stochastic gradient descent, where the precision of gradient estimation is vital for model performance. Gradients are calculated from mini-batches formed by uniformly selecting data samples…

Machine Learning · Computer Science 2025-01-29 Corentin Salaün , Xingchang Huang , Iliyan Georgiev , Niloy J. Mitra , Gurprit Singh

This paper considers Importance Sampling (IS) for the estimation of tail risks of a loss defined in terms of a sophisticated object such as a machine learning feature map or a mixed integer linear optimisation formulation. Assuming only…

Risk Management · Quantitative Finance 2021-06-21 Anand Deo , Karthyek Murthy

Importance sampling (IS) is a variance reduction method for simulating rare events. A recent paper by Dupuis, Wang and Sezer (Ann. App. Probab. 17(4):1306- 1346, 2007) exploits connections between IS and stochastic games and optimal control…

Probability · Mathematics 2008-12-24 Ali Devin Sezer

We consider the efficient use of an approximation within Markov chain Monte Carlo (MCMC), with subsequent importance sampling (IS) correction of the Markov chain inexact output, leading to asymptotically exact inference. We detail…

Computation · Statistics 2019-04-15 Jordan Franks

In this paper the choice of the Bernoulli distribution as biased distribution for importance sampling (IS) Monte-Carlo (MC) simulation of linear block codes over binary symmetric channels (BSCs) is studied. Based on the analytical…

Information Theory · Computer Science 2013-11-07 Gianmarco Romano , Domenico Ciuonzo

Statistical signal processing applications usually require the estimation of some parameters of interest given a set of observed data. These estimates are typically obtained either by solving a multi-variate optimization problem, as in the…

Computation · Statistics 2021-07-27 D. Luengo , L. Martino , M. Bugallo , V. Elvira , S. Särkkä

We present a neural network approach for approximating the value function of high-dimensional stochastic control problems. Our training process simultaneously updates our value function estimate and identifies the part of the state space…

Optimization and Control · Mathematics 2024-05-08 Xingjian Li , Deepanshu Verma , Lars Ruthotto

Many contemporary machine learning models require extensive tuning of hyperparameters to perform well. A variety of methods, such as Bayesian optimization, have been developed to automate and expedite this process. However, tuning remains…

Machine Learning · Computer Science 2020-02-25 Setareh Ariafar , Zelda Mariet , Ehsan Elhamifar , Dana Brooks , Jennifer Dy , Jasper Snoek

Importance Sampling (IS) is a method for approximating expectations under a target distribution using independent samples from a proposal distribution and the associated importance weights. In many applications, the target distribution is…

Machine Learning · Statistics 2022-09-14 Gabriel Cardoso , Sergey Samsonov , Achille Thin , Eric Moulines , Jimmy Olsson

This work addresses the estimation of rare-event quantities expressed as expectations of smooth observables of solutions to a broad class of McKean--Vlasov stochastic differential equations (MV-SDEs). Building on the double loop Monte Carlo…

Numerical Analysis · Mathematics 2026-01-08 Nadhir Ben Rached , Abdul-Lateef Haji-Ali , Shyam Mohan Subbiah Pillai , Raúl Tempone

Importance sampling is a technique that is commonly used to speed up Monte Carlo simulation of rare events. However, little is known regarding the design of efficient importance sampling algorithms in the context of queueing networks. The…

Probability · Mathematics 2009-09-29 Paul Dupuis , Ali Devin Sezer , Hui Wang

In rare-event simulation, an importance sampling (IS) estimator is regarded as efficient if its relative error, namely the ratio between its standard deviation and mean, is sufficiently controlled. It is widely known that when a rare-event…

Statistics Theory · Mathematics 2022-10-31 Yuanlu Bai , Zhiyuan Huang , Henry Lam , Ding Zhao

In solving simulation-based stochastic root-finding or optimization problems that involve rare events, such as in extreme quantile estimation, running crude Monte Carlo can be prohibitively inefficient. To address this issue, importance…

Methodology · Statistics 2021-02-23 Shengyi He , Guangxin Jiang , Henry Lam , Michael C. Fu

This paper presents a stochastic model predictive control approach for nonlinear systems subject to time-invariant probabilistic uncertainties in model parameters and initial conditions. The stochastic optimal control problem entails a cost…

Optimization and Control · Mathematics 2014-10-17 Stefan Streif , Matthias Karl , Ali Mesbah

Stochastic simulation is a widely used method for estimating quantities in models of chemical reaction networks where uncertainty plays a crucial role. However, reducing the statistical uncertainty of the corresponding estimators requires…

Quantitative Methods · Quantitative Biology 2019-06-13 Michael Backenköhler , Luca Bortolussi , Verena Wolf