English
Related papers

Related papers: Regression-based variance reduction approach for s…

200 papers

We provide an improved analysis of standard differentially private gradient descent for linear regression under the squared error loss. Under modest assumptions on the input, we characterize the distribution of the iterate at each time…

Machine Learning · Computer Science 2024-02-22 Gavin Brown , Krishnamurthy Dvijotham , Georgina Evans , Daogao Liu , Adam Smith , Abhradeep Thakurta

In predictive modeling with simulation or machine learning, it is critical to accurately assess the quality of estimated values through output analysis. In recent decades output analysis has become enriched with methods that quantify the…

Methodology · Statistics 2023-10-27 Kimia Vahdat , Sara Shashaani

An implicit Euler finite-volume scheme for general cross-diffusion systems with volume-filling constraints is proposed and analyzed. The diffusion matrix may be nonsymmetric and not positive semidefinite, but the diffusion system is assumed…

Numerical Analysis · Mathematics 2021-05-13 Ansgar Jüngel , Antoine Zurek

We present a general approach to greatly increase at little cost the efficiency of Monte Carlo algorithms. To each observable to be computed we associate a renormalized observable (improved estimator) having the same average but a different…

Statistical Mechanics · Physics 2009-10-31 Roland Assaraf , Michel Caffarel

Multifidelity Monte Carlo methods often rely on a preprocessing phase consisting of standard Monte Carlo sampling to estimate correlation coefficients between models of different fidelity to determine the weights and number of samples for…

Data Analysis, Statistics and Probability · Physics 2021-06-29 Todd A. Oliver , Christopher S. Simmons , Robert D. Moser

A new class of explicit Euler schemes, which approximate stochastic differential equations (SDEs) with superlinearly growing drift and diffusion coefficients, is proposed in this article. It is shown, under very mild conditions, that these…

Probability · Mathematics 2016-09-05 Sotirios Sabanis

Algorithms based on discretizing Langevin diffusion are popular tools for sampling from high-dimensional distributions. We develop novel connections between such Monte Carlo algorithms, the theory of Wasserstein gradient flow, and the…

Computation · Statistics 2019-05-13 Espen Bernton

A discretization scheme for variable coefficient elliptic PDEs in the plane is presented. The scheme is based on high-order Gaussian quadratures and is designed for problems with smooth solutions, such as scattering problems involving soft…

Numerical Analysis · Mathematics 2015-03-17 Per-Gunnar Martinsson

In this paper, we aim to compute numerical approximation integral by using an adaptive Monte Carlo algorithm. We propose a stratified sampling algorithm based on an iterative method which splits the strata following some quantities called…

Numerical Analysis · Mathematics 2015-07-22 Toni Sayah

Control variates are variance reduction tools for Monte Carlo estimators. They can provide significant variance reduction, but usually require a large number of samples, which can be prohibitive when sampling or evaluating the integrand is…

Methodology · Statistics 2023-06-08 Zhuo Sun , Alessandro Barp , François-Xavier Briol

This paper studies the use of a machine learning-based estimator as a control variate for mitigating the variance of Monte Carlo sampling. Specifically, we seek to uncover the key factors that influence the efficiency of control variates in…

Statistics Theory · Mathematics 2023-05-29 Jose Blanchet , Haoxuan Chen , Yiping Lu , Lexing Ying

Anomalous diffusion is a phenomenon that cannot be modeled accurately by second-order diffusion equations, but is better described by fractional diffusion models. The nonlocal nature of the fractional diffusion operators makes substantially…

Numerical Analysis · Mathematics 2018-03-08 K. Mustapha , K. Furati , O. M. Knio , O. Le Maitre

Variational inference has become a widely used method to approximate posteriors in complex latent variables models. However, deriving a variational inference algorithm generally requires significant model-specific analysis, and these…

Machine Learning · Statistics 2014-01-03 Rajesh Ranganath , Sean Gerrish , David M. Blei

Control variates are a well-established tool to reduce the variance of Monte Carlo estimators. However, for large-scale problems including high-dimensional and large-sample settings, their advantages can be outweighed by a substantial…

Machine Learning · Statistics 2021-07-22 Shijing Si , Chris. J. Oates , Andrew B. Duncan , Lawrence Carin , François-Xavier Briol

For a class of stochastic models with Gaussian and rough mean-reverting volatility that embeds the genuine rough Stein-Stein model, we study the weak approximation rate when using a Euler type scheme with integrated kernels. Our first…

Probability · Mathematics 2026-02-23 Aurélien Alfonsi , Ahmed Kebaier

In this paper we propose a Monte Carlo maximum likelihood estimation strategy for discretely observed Wright-Fisher diffusions. Our approach provides an unbiased estimator of the likelihood function and is based on exact simulation…

Statistics Theory · Mathematics 2024-06-11 Celia García-Pareja , Fabio Nobile

Most Markov chain Monte Carlo methods operate in discrete time and are reversible with respect to the target probability. Nevertheless, it is now understood that the use of non-reversible Markov chains can be beneficial in many contexts. In…

Methodology · Statistics 2021-02-23 Chris Sherlock , Alexandre H. Thiery

In this article we consider static Bayesian parameter estimation for partially observed diffusions that are discretely observed. We work under the assumption that one must resort to discretizing the underlying diffusion process, for…

Computation · Statistics 2017-01-23 Ajay Jasra , Kengo Kamatani , Kody J. H. Law , Yan Zhou

The theme of the present paper is numerical integration of $C^r$ functions using randomized methods. We consider variance reduction methods that consist in two steps. First the initial interval is partitioned into subintervals and the…

Numerical Analysis · Mathematics 2023-06-21 Leszek Plaskota , Paweł Przybyłowicz , Łukasz Stępień

We propose a new algorithm for sampling the $N$-body density $|\Psi({\bf R})|^2/\int_{\mathbb{R}^{3N}} |\Psi|^2$ in the Variational Monte Carlo (VMC) framework. This algorithm is based upon a modified Ricci-Ciccotti discretization of the…

Other Condensed Matter · Physics 2016-07-25 Anthony Scemama , Tony Lelièvre , Gabriel Stoltz , Eric Cancès , Michel Caffarel