English
Related papers

Related papers: Joint control variate for faster black-box variati…

200 papers

We describe a simple multivariate technique of likelihood ratios for improved discrimination of signal and background in multi-dimensional quantum target detection. The technique combines two independent variables, time difference and…

A novel linear integration rule called $\textit{control neighbors}$ is proposed in which nearest neighbor estimates act as control variates to speed up the convergence rate of the Monte Carlo procedure on metric spaces. The main result is…

Numerical Analysis · Mathematics 2024-04-05 Rémi Leluc , François Portier , Johan Segers , Aigerim Zhuman

A new methodology is presented for the construction of control variates to reduce the variance of additive functionals of Markov Chain Monte Carlo (MCMC) samplers. Our control variates are definedthrough the minimization of the asymptotic…

Methodology · Statistics 2019-07-09 Nicolas Brosse , Alain Durmus , Sean Meyn , Eric Moulines , Anand Radhakrishnan

Besides the well-known effect of autocorrelations in time series of Monte Carlo simulation data resulting from the underlying Markov process, using the same data pool for computing various estimates entails additional cross correlations.…

Statistical Mechanics · Physics 2014-11-20 Martin Weigel , Wolfhard Janke

Variance reduction techniques are designed to decrease the sampling variance, thereby accelerating convergence rates of first-order (FO) and zeroth-order (ZO) optimization methods. However, in composite optimization problems, ZO methods…

Machine Learning · Computer Science 2024-05-29 Hao Di , Haishan Ye , Yueling Zhang , Xiangyu Chang , Guang Dai , Ivor W. Tsang

Multi-fidelity Monte Carlo (MFMC) is a variance reduction method that leverages a multi-fidelity ensemble of models of varying cost and accuracy levels. Constructing an MFMC estimator with optimal variance requires knowledge of the…

Methodology · Statistics 2026-05-25 Michael Stanley , Thomas Coons , Geoffrey Bomarito , Patrick Leser , Joshua Pribe , James Warner

We propose a gradient-free deep reinforcement learning algorithm to solve high-dimensional, finite-horizon stochastic control problems. Although the recently developed deep reinforcement learning framework has achieved great success in…

Optimization and Control · Mathematics 2025-02-03 Liyao Lyu , Jingrun Chen

Estimating the density of a continuous random variable X has been studied extensively in statistics, in the setting where n independent observations of X are given a priori and one wishes to estimate the density from that. Popular methods…

Computation · Statistics 2021-09-09 Pierre L'Ecuyer , Florian Puchhammer

Distortion risk measures play a critical role in quantifying risks associated with uncertain outcomes. Accurately estimating these risk measures in the context of computationally expensive simulation models that lack analytical tractability…

Risk Management · Quantitative Finance 2025-08-29 Sören Bettels , Stefan Weber

Variational inference is a powerful tool for approximate inference. However, it mainly focuses on the evidence lower bound as variational objective and the development of other measures for variational inference is a promising area of…

Machine Learning · Computer Science 2016-12-06 Michael Figurnov , Kirill Struminsky , Dmitry Vetrov

In practice, observations are often contaminated by noise, making the resulting sample covariance matrix to be an information-plus-noise-type covariance matrix. Aiming to make inferences about the spectra of the underlying true covariance…

Statistics Theory · Mathematics 2015-08-25 Ningning Xia , Xinghua Zheng

Fermionic Monte Carlo calculations with continuous auxiliary fields often encounter infinite variance problem from fermionic observables. This issue renders the estimation of observables unreliable, even with an infinite number of samples.…

High Energy Physics - Lattice · Physics 2023-11-28 Hyunwoo Oh , Andrei Alexandru , Paulo F. Bedaque , Andrea Carosso

The classical Langevin Monte Carlo method looks for samples from a target distribution by descending the samples along the gradient of the target distribution. The method enjoys a fast convergence rate. However, the numerical cost is…

Machine Learning · Statistics 2025-03-07 Zhiyan Ding , Qin Li

In mixture experiments with noise variables or process variables that can not be controlled, investigate and try to control the variability of the response variable is very important for quality improvement in industrial processes. Thus,…

We investigate the feasibility of integrating quantum algorithms as subroutines of simulation-based optimisation problems with relevance to and potential applications in mathematical finance. To this end, we conduct a thorough analysis of…

Current differentiable renderers provide light transport gradients with respect to arbitrary scene parameters. However, the mere existence of these gradients does not guarantee useful update steps in an optimization. Instead, inverse…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Michael Fischer , Tobias Ritschel

Variance reduction (VR) techniques have contributed significantly to accelerating learning with massive datasets in the smooth and strongly convex setting (Schmidt et al., 2017; Johnson & Zhang, 2013; Roux et al., 2012). However, such…

Machine Learning · Computer Science 2021-11-24 Lionel Tondji , Sergii Kashubin , Moustapha Cisse

Many probabilistic models of interest in scientific computing and machine learning have expensive, black-box likelihoods that prevent the application of standard techniques for Bayesian inference, such as MCMC, which would require access to…

Machine Learning · Statistics 2018-11-30 Luigi Acerbi

We consider a multi-view learning problem known as group independent component analysis (group ICA), where the goal is to recover shared independent sources from many views. The statistical modeling of this problem requires to take noise…

Machine Learning · Statistics 2021-02-23 Hugo Richard , Pierre Ablin , Aapo Hyvärinen , Alexandre Gramfort , Bertrand Thirion

We propose a Multi-level Monte Carlo technique to accelerate Monte Carlo sampling for approximation of properties of materials with random defects. The computational efficiency is investigated on test problems given by tight-binding models…

Numerical Analysis · Mathematics 2016-11-30 Petr Plecháč , Erik von Schwerin