English
Related papers

Related papers: Density estimation by Randomized Quasi-Monte Carlo

200 papers

Estimating the density of a continuous random variable X has been studied extensively in statistics, in the setting where n independent observations of X are given a priori and one wishes to estimate the density from that. Popular methods…

Computation · Statistics 2021-09-09 Pierre L'Ecuyer , Florian Puchhammer

Many machine learning problems involve Monte Carlo gradient estimators. As a prominent example, we focus on Monte Carlo variational inference (MCVI) in this paper. The performance of MCVI crucially depends on the variance of its stochastic…

Machine Learning · Statistics 2018-07-05 Alexander Buchholz , Florian Wenzel , Stephan Mandt

We design and implement a novel algorithm for computing a multilevel Monte Carlo (MLMC) estimator of the cumulative distribution function of a quantity of interest in problems with random input parameters or initial conditions. Our approach…

Numerical Analysis · Mathematics 2020-08-26 Søren Taverniers , Daniel M. Tartakovsky

In statistical analysis, Monte Carlo (MC) stands as a classical numerical integration method. When encountering challenging sample problem, Markov chain Monte Carlo (MCMC) is a commonly employed method. However, the MCMC estimator is biased…

Numerical Analysis · Mathematics 2024-11-05 Jiarui Du , Zhijian He

We consider the problem of computing an approximation to the integral $I=\int_{[0,1]^d}f(x) dx$. Monte Carlo (MC) sampling typically attains a root mean squared error (RMSE) of $O(n^{-1/2})$ from $n$ independent random function evaluations.…

Computation · Statistics 2008-11-05 Art B. Owen

Many machine learning problems optimize an objective that must be measured with noise. The primary method is a first order stochastic gradient descent using one or more Monte Carlo (MC) samples at each step. There are settings where…

Machine Learning · Computer Science 2021-04-22 Sifan Liu , Art B. Owen

Nested integration problems arise in various scientific and engineering applications, including Bayesian experimental design, financial risk assessment, and uncertainty quantification. These nested integrals take the form $\int f\left(\int…

Numerical Analysis · Mathematics 2025-06-17 Arved Bartuska , André Gustavo Carlon , Luis Espath , Sebastian Krumscheid , Raúl Tempone

Estimating the unknown density from which a given independent sample originates is more difficult than estimating the mean, in the sense that for the best popular non-parametric density estimators, the mean integrated square error converges…

Statistics Theory · Mathematics 2021-09-08 Pierre L'Ecuyer , Florian Puchhammer , Amal Ben Abdellah

We investigate the application of randomized quasi-Monte Carlo (RQMC) methods in random feature approximations for kernel-based learning. Compared to the classical Monte Carlo (MC) approach \citep{rahimi2007random}, RQMC improves the…

Methodology · Statistics 2025-09-09 Yian Huang , Zhen Huang

Quantiles and expected shortfalls are usually used to measure risks of stochastic systems, which are often estimated by Monte Carlo methods. This paper focuses on the use of quasi-Monte Carlo (QMC) method, whose convergence rate is…

Numerical Analysis · Mathematics 2020-05-07 Zhijian He , Xiaoqun Wang

We study randomized quasi-Monte Carlo (RQMC) estimation of a multivariate integral where one of the variables takes only a finite number of values. This problem arises when the variable of integration is drawn from a mixture distribution as…

Computation · Statistics 2026-01-19 Valerie N. P. Ho , Art B. Owen , Zexin Pan

Importance sampling (IS) is valuable in reducing the variance of Monte Carlo sampling for many areas, including finance, rare event simulation, and Bayesian inference. It is natural and obvious to combine quasi-Monte Carlo (QMC) methods…

Numerical Analysis · Mathematics 2022-07-21 Zhijian He , Zhan Zheng , Xiaoqun Wang

Markov chain Monte Carlo samplers produce dependent streams of variates drawn from the limiting distribution of the Markov chain. With this as motivation, we introduce novel univariate kernel density estimators which are appropriate for the…

Methodology · Statistics 2016-07-29 Hang J. Kim , Steven N. MacEachern , Yoonsuh Jung

We establish epigraphical and uniform laws of large numbers for sample-based approximations of law invariant risk functionals. These sample-based approximation schemes include Monte Carlo (MC) and certain randomized quasi-Monte Carlo…

Optimization and Control · Mathematics 2025-07-01 Olena Melnikov , Johannes Milz

Quasi-Monte Carlo (QMC) methods for estimating integrals are attractive since the resulting estimators typically converge at a faster rate than pseudo-random Monte Carlo. However, they can be difficult to set up on arbitrary posterior…

Statistics Theory · Mathematics 2018-10-03 Tobias Schwedes , Ben Calderhead

In this paper, we analyse a method for approximating the distribution function and density of a random variable that depends in a non-trivial way on a possibly high number of independent random variables, each with support on the whole real…

Numerical Analysis · Mathematics 2022-10-07 Alexander D. Gilbert , Frances Y. Kuo , Ian H. Sloan

Quasi-Monte Carlo (QMC) is a powerful method for evaluating high-dimensional integrals. However, its use is typically limited to distributions where direct sampling is straightforward, such as the uniform distribution on the unit hypercube…

Numerical Analysis · Mathematics 2024-12-24 Sifan Liu

Importance Sampling (IS), an effective variance reduction strategy in Monte Carlo (MC) simulation, is frequently utilized for Bayesian inference and other statistical challenges. Quasi-Monte Carlo (QMC) replaces the random samples in MC…

Numerical Analysis · Mathematics 2024-03-19 Zhijian He , Hejin Wang , Xiaoqun Wang

We consider the problem of estimating expectations with respect to a target distribution with an unknown normalizing constant, and where even the unnormalized target needs to be approximated at finite resolution. Under such an assumption,…

Numerical Analysis · Mathematics 2023-06-29 Xinzhu Liang , Shangda Yang , Simon L. Cotter , Kody J. H. Law

Nested integration of the form $\int f\left(\int g(\bs{y},\bs{x})\di{}\bs{x}\right)\di{}\bs{y}$, characterized by an outer integral connected to an inner integral through a nonlinear function $f$, is a challenging problem in various fields,…

Numerical Analysis · Mathematics 2026-05-19 Arved Bartuska , André Gustavo Carlon , Luis Espath , Sebastian Krumscheid , Raúl Tempone
‹ Prev 1 2 3 10 Next ›