English
Related papers

Related papers: Explicit Mean-Square Error Bounds for Monte-Carlo …

200 papers

Stochastic gradient Markov Chain Monte Carlo algorithms are popular samplers for approximate inference, but they are generally biased. We show that many recent versions of these methods (e.g. Chen et al. (2014)) cannot be corrected using…

Machine Learning · Statistics 2021-02-03 Adrià Garriga-Alonso , Vincent Fortuin

In parameter estimation, assumptions about the model are typically considered which allow us to build optimal estimation methods under many statistical senses. However, it is usually the case where such models are inaccurately known or not…

Statistics Theory · Mathematics 2015-12-14 Adrià Gusi-Amigó , Pau Closas , Luc Vandendorpe

We prove a bound on the finite sample error of sequential Monte Carlo (SMC) on static spaces using the $L_2$ distance between interpolating distributions and the mixing times of Markov kernels. This result is unique in that it is the first…

Computation · Statistics 2025-08-26 Joe Marion , Joseph Mathews , Scott C. Schmidler

Markov chains can be used to generate samples whose distribution approximates a given target distribution. The quality of the samples of such Markov chains can be measured by the discrepancy between the empirical distribution of the samples…

Computation · Statistics 2016-01-18 Josef Dick , Daniel Rudolf , Houying Zhu

We consider a class of finite time horizon nonlinear stochastic optimal control problem, where the control acts additively on the dynamics and the control cost is quadratic. This framework is flexible and has found applications in many…

Optimization and Control · Mathematics 2023-04-26 Ajay Jasra , Jeremy Heng , Yaxian Xu , Adrian N. Bishop

We study the Markov chain Monte Carlo (MCMC) estimator for numerical integration for functions that do not need to be square integrable w.r.t. the invariant distribution. For chains with a spectral gap we show that the absolute mean error…

Numerical Analysis · Mathematics 2025-08-13 Julian Hofstadler

Markov chain Monte Carlo algorithms are invaluable tools for exploring stationary properties of physical systems, especially in situations where direct sampling is unfeasible. Common implementations of Monte Carlo algorithms employ…

Statistical Mechanics · Physics 2016-04-27 Marija Vucelja

It is commonly admitted that non-reversible Markov chain Monte Carlo (MCMC) algorithms usually yield more accurate MCMC estimators than their reversible counterparts. In this note, we show that in addition to their variance reduction…

Computation · Statistics 2019-08-27 Marie Vialaret , Florian Maire

Minimum-weight perfect matching (MWPM) has been been the primary classical algorithm for error correction in the surface code, since it is of low runtime complexity and achieves relatively low logical error rates [Phys. Rev. Lett. 108,…

Quantum Physics · Physics 2014-02-20 Adrian Hutter , James R. Wootton , Daniel Loss

The Markov Chain Monte Carlo method is the dominant paradigm for posterior computation in Bayesian analysis. It is common to control computation time by making approximations to the Markov transition kernel. Comparatively little attention…

Computation · Statistics 2017-08-30 James E. Johndrow , Jonathan C. Mattingly , Sayan Mukherjee , David Dunson

Stochastic PDE eigenvalue problems are useful models for quantifying the uncertainty in several applications from the physical sciences and engineering, e.g., structural vibration analysis, the criticality of a nuclear reactor or photonic…

Numerical Analysis · Mathematics 2022-10-07 Alexander D. Gilbert , Robert Scheichl

We study the approximation of a Markov chain on a reduced state space, for both discrete- and continuous-time Markov chains. In this context, we extend the existing theory of formal error bounds for the approximated transient distributions.…

Probability · Mathematics 2025-02-12 Fabian Michel , Markus Siegle

We extend the Longstaff-Schwartz algorithm for approximately solving optimal stopping problems on high-dimensional state spaces. We reformulate the optimal stopping problem for Markov processes in discrete time as a generalized statistical…

Probability · Mathematics 2007-05-23 Daniel Egloff

Quantiles and expected shortfalls are usually used to measure risks of stochastic systems, which are often estimated by Monte Carlo methods. This paper focuses on the use of quasi-Monte Carlo (QMC) method, whose convergence rate is…

Numerical Analysis · Mathematics 2020-05-07 Zhijian He , Xiaoqun Wang

For numerical approximations to stochastic differential equations using the Euler-Maruyama scheme, we propose incorporating approximate random variables computed using low precisions, such as single and half precision. We propose and…

Numerical Analysis · Mathematics 2024-07-17 Oliver Sheridan-Methven , Michael Giles

Markov chain Monte Carlo is a method of producing a correlated sample in order to estimate features of a target distribution via ergodic averages. A fundamental question is when should sampling stop? That is, when are the ergodic averages…

Statistics Theory · Mathematics 2007-06-13 Galin Jones , Murali Haran , Brian Caffo , Ronald Neath

Monte Carlo planners can often return sub-optimal actions, even if they are guaranteed to converge in the limit of infinite samples. Known asymptotic regret bounds do not provide any way to measure confidence of a recommended action at the…

Artificial Intelligence · Computer Science 2021-11-04 John Mern , Mykel J. Kochenderfer

This article considers the sequential Monte Carlo (SMC) approximation of ratios of normalizing constants associated to posterior distributions which in principle rely on continuum models. Therefore, the Monte Carlo estimation error and the…

Computation · Statistics 2016-03-04 Pierre Del Moral , Ajay Jasra , Kody Law , Yan Zhou

The widespread use of Markov Chain Monte Carlo (MCMC) methods for high-dimensional applications has motivated research into the scalability of these algorithms with respect to the dimension of the problem. Despite this, numerous problems…

Computation · Statistics 2024-10-21 Ardjen Pengel , Jun Yang , Zhou Zhou

We prove finite sample complexities for sequential Monte Carlo (SMC) algorithms which require only local mixing times of the associated Markov kernels. Our bounds are particularly useful when the target distribution is multimodal and global…

Computation · Statistics 2022-08-16 Joseph Mathews , Scott C. Schmidler