English
Related papers

Related papers: Nonasymptotic bounds on the estimation error of MC…

200 papers

This paper analyzes the performance of Tyler's M-estimator of the scatter matrix in elliptical populations. We focus on the non-asymptotic setting and derive the estimation error bounds depending on the number of samples n and the dimension…

Statistics Theory · Mathematics 2015-06-18 Ilya Soloveychik , Ami Wiesel

The logistic regression model is the most popular model for analyzing binary data. In the absence of any prior information, an improper flat prior is often used for the regression coefficients in Bayesian logistic regression models. The…

Statistics Theory · Mathematics 2018-07-03 Xin Wang , Vivekananda Roy

We give a general statement of the convolution method so that one can provide explicit asymptotic estimations for all averages of square-free supported arithmetic functions that have a sufficiently regular order on the prime numbers and…

Number Theory · Mathematics 2023-01-23 Sebastian Zuniga Alterman

Constant gain least-mean-squares (LMS) algorithms have a wide range of applications in trajectory tracking problems, but the formal convergence of LMS in mean square is not yet fully established. This work provides an upper bound on the…

Signal Processing · Electrical Eng. & Systems 2024-01-23 Chang Liu , Antwan D. Clark

We consider periodic Markov chains with absorption. Applying to iterates of this periodic Markov chain criteria for the exponential convergence of conditional distributions of aperiodic absorbed Markov chains, we obtain exponential…

Probability · Mathematics 2022-11-08 Nicolas Champagnat , Denis Villemonais

Cross validation is a central tool in evaluating the performance of machine learning and statistical models. However, despite its ubiquitous role, its theoretical properties are still not well understood. We study the asymptotic properties…

Statistics Theory · Mathematics 2020-06-30 Morgane Austern , Wenda Zhou

The main objective of this article is to establish a central limit theorem for additive three-variable functionals of bifurcating Markov chains. We thus extend the central limit theorem under point-wise ergodic conditions studied in…

Probability · Mathematics 2022-07-04 S. Valère Bitseki Penda

Markov chains can be used to generate samples whose distribution approximates a given target distribution. The quality of the samples of such Markov chains can be measured by the discrepancy between the empirical distribution of the samples…

Computation · Statistics 2016-01-18 Josef Dick , Daniel Rudolf , Houying Zhu

The use of MCMC algorithms in high dimensional Bayesian problems has become routine. This has spurred so-called convergence complexity analysis, the goal of which is to ascertain how the convergence rate of a Monte Carlo Markov chain scales…

Statistics Theory · Mathematics 2018-04-24 Qian Qin , James P. Hobert

When working with multimodal Bayesian posterior distributions, Markov chain Monte Carlo (MCMC) algorithms have difficulty moving between modes, and default variational or mode-based approximate inferences will understate posterior…

Methodology · Statistics 2021-11-19 Yuling Yao , Aki Vehtari , Andrew Gelman

The Bayesian Cram\'er-Rao bound (CRB) provides a lower bound on the mean square error of any Bayesian estimator under mild regularity conditions. It can be used to benchmark the performance of statistical estimators, and provides a…

Machine Learning · Statistics 2024-09-09 Evan Scope Crafts , Xianyang Zhang , Bo Zhao

In this paper, we introduce the $\sigma$-antithetic multilevel Monte Carlo (MLMC) estimator for a multi-dimensional diffusion which is an extended version of the original antithetic MLMC one introduced by Giles and Szpruch \cite{a}. Our aim…

Probability · Mathematics 2024-01-26 Mohamed Ben Alaya , Ahmed Kebaier , Thi Bao Tram Ngo

Non-reversible Markov chain Monte Carlo schemes based on piecewise deterministic Markov processes have been recently introduced in applied probability, automatic control, physics and statistics. Although these algorithms demonstrate…

Computation · Statistics 2017-08-29 George Deligiannidis , Alexandre Bouchard-Côté , Arnaud Doucet

We study a high-dimensional generalized linear model and penalized empirical risk minimization with $\ell_1$ penalty. Our aim is to provide a non-trivial illustration that non-asymptotic bounds for the estimator can be obtained without…

Statistics Theory · Mathematics 2007-09-12 Sara A. van de Geer

In this paper we derive non-asymptotic Berry-Esseen bounds for Polyak-Ruppert averaged iterates of the Linear Stochastic Approximation (LSA) algorithm driven by the Markovian noise. Our analysis yields $\mathcal{O}(n^{-1/4})$ convergence…

Machine Learning · Statistics 2025-05-27 Sergey Samsonov , Marina Sheshukova , Eric Moulines , Alexey Naumov

We derive sufficient conditions for asymptotic and monotone exponential decay in mean square of solutions of the geometric Brownian motion with delay. The conditions are written in terms of the parameters and are explicit for the case of…

Probability · Mathematics 2021-03-23 Jan Haskovec

We give computable bounds on the rate of convergence of the transition probabilities to the stationary distribution for a certain class of geometrically ergodic Markov chains. Our results are different from earlier estimates of Meyn and…

Probability · Mathematics 2007-05-23 Peter H. Baxendale

We consider the problem of least squares parameter estimation from single-trajectory data for discrete-time, unstable, closed-loop nonlinear stochastic systems, with linearly parameterised uncertainty. Assuming a region of the state space…

Systems and Control · Electrical Eng. & Systems 2024-12-06 Seth Siriya , Jingge Zhu , Dragan Nešić , Ye Pu

In this note we prove two existence theorems for the Einstein constraint equations on asymptotically Euclidean manifolds. The first is for arbitrary mean curvature functions with restrictions on the size of the transverse-traceless data and…

General Relativity and Quantum Cosmology · Physics 2014-03-05 James Dilts , James Isenberg , Rafe Mazzeo , Caleb Meier

Let $\{X_n\}_{n\ge0}$ be a $V$-geometrically ergodic Markov chain. Given some real-valued functional $F$, define $M_n(\alpha):=n^{-1}\sum_{k=1}^nF(\alpha,X_{k-1},X_k)$, $\alpha\in\mathcal{A}\subset \mathbb {R}$. Consider an $M$ estimator…

Statistics Theory · Mathematics 2012-05-15 Loïc Hervé , James Ledoux , Valentin Patilea