English
Related papers

Related papers: Approximate and integrate: Variance reduction in M…

200 papers

We present an unbiased numerical integration algorithm that handles both low-frequency regions and high frequency details of multidimensional integrals. It combines quadrature and Monte Carlo integration, by using a quadrature-base…

Graphics · Computer Science 2020-08-18 Miguel Crespo , Felix Bernal , Adrian Jarabo , Adolfo Muñoz

Solving partial differential equations in high dimensions by deep neural network has brought significant attentions in recent years. In many scenarios, the loss function is defined as an integral over a high-dimensional domain. Monte-Carlo…

Numerical Analysis · Mathematics 2019-11-06 Jingrun Chen , Rui Du , Panchi Li , Liyao Lyu

Quasi-Monte Carlo (QMC) methods are being adopted in statistical applications due to the increasingly challenging nature of numerical integrals that are now routinely encountered. For integrands with $d$-dimensions and derivatives of order…

Computation · Statistics 2016-04-04 Chris. J. Oates , Mark Girolami

In numerical integration, cubature methods are effective, especially when the integrands can be well-approximated by known test functions, such as polynomials. However, the construction of cubature formulas has not generally been known, and…

Numerical Analysis · Mathematics 2023-05-31 Satoshi Hayakawa

It is well known that Monte Carlo integration with variance reduction by means of control variates can be implemented by the ordinary least squares estimator for the intercept in a multiple linear regression model. A central limit theorem…

Statistics Theory · Mathematics 2019-10-10 François Portier , Johan Segers

The efficient evaluation of high-dimensional integrals is of importance in both theoretical and practical fields of science, such as data science, statistical physics, and machine learning. However, exact computation methods suffer from the…

Statistics Theory · Mathematics 2017-12-15 Radislav Vaisman , Robert Salomone , Dirk P. Kroese

We describe and analyze a variance reduction approach for Monte Carlo (MC) sampling that accelerates the estimation of statistics of computationally expensive simulation models using an ensemble of models with lower cost. These lower cost…

Computation · Statistics 2021-05-04 Alex A. Gorodetsky , Gianluca Geraci , Mike Eldred , John D. Jakeman

Nested Monte Carlo is widely used for risk estimation, but its efficiency is limited by the discontinuity of the indicator function and high computational cost. This paper proposes a nested Multilevel Monte Carlo (MLMC) method combined with…

Numerical Analysis · Mathematics 2026-04-06 Yu Xu , Xiaoqun Wang

Markov Chain Monte Carlo (MCMC) methods are employed to sample from a given distribution of interest, whenever either the distribution does not exist in closed form, or, if it does, no efficient method to simulate an independent sample from…

Computation · Statistics 2008-07-22 Ioana A. Cosma , Masoud Asgharian

Monte Carlo integration is typically interpreted as an estimator of the expected value using stochastic samples. There exists an alternative interpretation in calculus where Monte Carlo integration can be seen as estimating a…

Graphics · Computer Science 2022-11-15 Corentin Salaün , Adrien Gruson , Binh-Son Hua , Toshiya Hachisuka , Gurprit Singh

The standard Kernel Quadrature method for numerical integration with random point sets (also called Bayesian Monte Carlo) is known to converge in root mean square error at a rate determined by the ratio $s/d$, where $s$ and $d$ encode the…

Machine Learning · Statistics 2017-08-01 Francois-Xavier Briol , Chris J. Oates , Jon Cockayne , Wilson Ye Chen , Mark Girolami

We consider the problem of computing an approximation to the integral $I=\int_{[0,1]^d}f(x) dx$. Monte Carlo (MC) sampling typically attains a root mean squared error (RMSE) of $O(n^{-1/2})$ from $n$ independent random function evaluations.…

Computation · Statistics 2008-11-05 Art B. Owen

Monte Carlo integration with variance reduction by means of control variates can be implemented by the ordinary least squares estimator for the intercept in a multiple linear regression model with the integrand as response and the control…

Statistics Theory · Mathematics 2021-04-02 Rémi Leluc , François Portier , Johan Segers

Monte Carlo (MC) integration is the de facto method for approximating the predictive distribution of Bayesian neural networks (BNNs). But, even with many MC samples, Gaussian-based BNNs could still yield bad predictive performance due to…

Machine Learning · Computer Science 2022-10-18 Agustinus Kristiadi , Runa Eschenhagen , Philipp Hennig

In statistical analysis, Monte Carlo (MC) stands as a classical numerical integration method. When encountering challenging sample problem, Markov chain Monte Carlo (MCMC) is a commonly employed method. However, the MCMC estimator is biased…

Numerical Analysis · Mathematics 2024-11-05 Jiarui Du , Zhijian He

Monte Carlo methods approximate integrals by sample averages of integrand values. The error of Monte Carlo methods may be expressed as a trio identity: the product of the variation of the integrand, the discrepancy of the sampling measure,…

Numerical Analysis · Mathematics 2017-08-18 Fred J. Hickernell

In this paper, we aim to compute numerical approximation integral by using an adaptive Monte Carlo algorithm. We propose a stratified sampling algorithm based on an iterative method which splits the strata following some quantities called…

Numerical Analysis · Mathematics 2015-07-22 Toni Sayah

We propose a method to efficiently integrate truncated probability densities. The method uses Markov chain Monte Carlo method to sample from a probability density matching the function being integrated. The required normalisation or…

Computation · Statistics 2013-12-10 A. John Arul , Kannan Iyer

Traditionally, the field of computational Bayesian statistics has been divided into two main subfields: variational methods and Markov chain Monte Carlo (MCMC). In recent years, however, several methods have been proposed based on combining…

Computation · Statistics 2017-04-19 Cheng Zhang , Babak Shahbaba , Hongkai Zhao

Simulation studies are used to evaluate and compare the properties of statistical methods in controlled experimental settings. In most cases, performing a simulation study requires knowledge of the true value of the parameter, or estimand,…

Methodology · Statistics 2025-03-04 Ashley I. Naimi , David Benkeser , Jacqueline E. Rudolph