English
Related papers

Related papers: Adaptive Importance Sampling for Efficient Stochas…

200 papers

Optimization algorithms and Monte Carlo sampling algorithms have provided the computational foundations for the rapid growth in applications of statistical machine learning in recent years. There is, however, limited theoretical…

Machine Learning · Statistics 2022-06-08 Yi-An Ma , Yuansi Chen , Chi Jin , Nicolas Flammarion , Michael I. Jordan

In this paper we develop the large deviations principle and a rigorous mathematical framework for asymptotically efficient importance sampling schemes for general, fully dependent systems of stochastic differential equations of slow and…

Probability · Mathematics 2013-01-29 Konstantinos Spiliopoulos

When dealing with difficult inverse problems such as inverse rendering, using Monte Carlo estimated gradients to optimise parameters can slow down convergence due to variance. Averaging many gradient samples in each iteration reduces this…

Graphics · Computer Science 2023-09-28 Martin Balint , Karol Myszkowski , Hans-Peter Seidel , Gurprit Singh

The task of estimating a matrix given a sample of observed entries is known as the \emph{matrix completion problem}. Most works on matrix completion have focused on recovering an unknown real-valued low-rank matrix from a random sample of…

Statistics Theory · Mathematics 2014-08-27 Olga Klopp , Jean Lafond , Eric Moulines , Joseph Salmon

Adaptive importance sampling is a powerful tool to sample from complicated target densities, but its success depends sensitively on the initial proposal density. An algorithm is presented to automatically perform the initialization using…

Computation · Statistics 2013-05-01 Frederik Beaujean , Allen Caldwell

We consider the problem of estimating rare event probabilities, focusing on systems whose evolution is governed by differential equations with uncertain input parameters. If the system dynamics is expensive to compute, standard sampling…

Computation · Statistics 2019-11-05 Siddhant Wahal , George Biros

We introduce an adaptive sampling method for the Deep Ritz method aimed at solving partial differential equations (PDEs). Two deep neural networks are used. One network is employed to approximate the solution of PDEs, while the other one is…

Machine Learning · Computer Science 2023-10-31 Xiaoliang Wan , Tao Zhou , Yuancheng Zhou

Naive approaches to amortized inference in probabilistic programs with unbounded loops can produce estimators with infinite variance. This is particularly true of importance sampling inference in programs that explicitly include rejection…

Reducing the variance of the gradient estimator is known to improve the convergence rate of stochastic gradient-based optimization and sampling algorithms. One way of achieving variance reduction is to design importance sampling strategies.…

Machine Learning · Computer Science 2021-03-24 Ayoub El Hanchi , David A. Stephens

Random sampling is an essential tool in the processing and transmission of data. It is used to summarize data too large to store or manipulate and meet resource constraints on bandwidth or battery power. Estimators that are applied to the…

Databases · Computer Science 2015-03-19 Edith Cohen , Haim Kaplan

We present a Bayesian sampling algorithm called adaptive importance sampling or Population Monte Carlo (PMC), whose computational workload is easily parallelizable and thus has the potential to considerably reduce the wall-clock time…

Cosmology and Nongalactic Astrophysics · Physics 2009-09-02 Darren Wraith , Martin Kilbinger , Karim Benabed , Olivier Cappé , Jean-François Cardoso , Gersende Fort , Simon Prunet , Christian P. Robert

Importance sampling (IS) is a Monte Carlo technique that relies on weighted samples, simulated from a proposal distribution, to estimate intractable integrals. The quality of the estimators improves with the number of samples. However, for…

Computation · Statistics 2022-07-18 Medha Agarwal , Dootika Vats , Víctor Elvira

In this paper, we propose a sampling-based planning and optimal control method of nonlinear systems under non-differentiable constraints. Motivated by developing scalable planning algorithms, we consider the optimal motion plan to be a…

Systems and Control · Computer Science 2016-12-19 Jie Fu

The era of huge data necessitates highly efficient machine learning algorithms. Many common machine learning algorithms, however, rely on computationally intensive subroutines that are prohibitively expensive on large datasets. Oftentimes,…

Machine Learning · Computer Science 2023-09-26 Mo Tiwari

Equality-constrained models naturally arise in problems in which measurements are taken at different levels of resolution. The challenge in this setting is that the models usually induce a joint distribution which is intractable. Resorting…

Computation · Statistics 2025-04-28 Shenggang Hu , Hongsheng Dai , Fanlin Meng , Louis Aslett , Murray Pollock , Gareth O. Roberts

The celebrated Monte Carlo method estimates an expensive-to-compute quantity by random sampling. Bandit-based Monte Carlo optimization is a general technique for computing the minimum of many such expensive-to-compute quantities by adaptive…

Machine Learning · Computer Science 2021-04-30 Vivek Bagaria , Tavor Z. Baharav , Govinda M. Kamath , David N. Tse

Importance sampling is used to approximate Bayes' rule in many computational approaches to Bayesian inverse problems, data assimilation and machine learning. This paper reviews and further investigates the required sample size for…

Computation · Statistics 2021-02-03 Daniel Sanz-Alonso , Zijian Wang

This paper proposes niching importance sampling, a framework that combines concepts from reliability analysis, e.g. Markov chains, importance sampling, and relative cross entropy minimisation, with niching techniques from evolutionary…

Computation · Statistics 2026-04-09 Hugh J. Kinnear , F. A. DiazDelaO

We construct a new framework for accelerating Markov chain Monte Carlo in posterior sampling problems where standard methods are limited by the computational cost of the likelihood, or of numerical models embedded therein. Our approach…

Methodology · Statistics 2017-01-06 Patrick R. Conrad , Youssef M. Marzouk , Natesh S. Pillai , Aaron Smith

Importance sampling (IS) is valuable in reducing the variance of Monte Carlo sampling for many areas, including finance, rare event simulation, and Bayesian inference. It is natural and obvious to combine quasi-Monte Carlo (QMC) methods…

Numerical Analysis · Mathematics 2022-07-21 Zhijian He , Zhan Zheng , Xiaoqun Wang