English
Related papers

Related papers: Central Limit Theorems for Sample Average Approxim…

200 papers

We study invariance principles and convergence to a Gaussian limit for stochastic series of the form $S(c,Z)=\sum_{m=1}^{\infty }\sum_{\alpha _{1}<...<\alpha _{m}}c(\alpha _{1},...,\alpha _{m})\prod_{i=1}^{m}Z_{\alpha _{i}}$ where $Z_{k}$,…

Probability · Mathematics 2015-10-14 Vlad Bally , Lucia Caramellino

We analyse the asymptotic properties of a continuous-time, two-timescale stochastic approximation algorithm designed for stochastic bilevel optimisation problems in continuous-time models. We obtain the weak convergence rate of this…

Optimization and Control · Mathematics 2022-07-08 Louis Sharrock

This paper develops asymptotic theory for quantile estimation via stochastic gradient descent (SGD) with a constant learning rate. The quantile loss function is neither smooth nor strongly convex. Beyond conventional perspectives and…

Machine Learning · Statistics 2026-04-06 Ziyang Wei , Jiaqi Li , Likai Chen , Wei Biao Wu

We consider stochastic model predictive control of a multi-agent systems with constraints on the probabilities of inter-agent collisions. We first study a sample-based approximation of the collision probabilities and use this approximation…

Systems and Control · Computer Science 2011-08-17 Daniel Lyons , Jan-P. Calliess , Uwe D. Hanebeck

We undertake a precise study of the asymptotic and non-asymptotic properties of stochastic approximation procedures with Polyak-Ruppert averaging for solving a linear system $\bar{A} \theta = \bar{b}$. When the matrix $\bar{A}$ is Hurwitz,…

Machine Learning · Statistics 2020-04-10 Wenlong Mou , Chris Junchi Li , Martin J. Wainwright , Peter L. Bartlett , Michael I. Jordan

In this paper, we refine the Berry-Esseen bounds for the multivariate normal approximation of Polyak-Ruppert averaged iterates arising from the linear stochastic approximation (LSA) algorithm with decreasing step size. We consider the…

Machine Learning · Statistics 2025-10-15 Bogdan Butyrin , Eric Moulines , Alexey Naumov , Sergey Samsonov , Qi-Man Shao , Zhuo-Song Zhang

The problem of sequential anomaly detection and identification is considered, where multiple data sources are simultaneously monitored and the goal is to identify in real time those, if any, that exhibit ``anomalous" statistical behavior.…

Statistics Theory · Mathematics 2024-12-09 Aristomenis Tsopelakos , Georgios Fellouris

The martingale posterior framework is a generalization of Bayesian inference where one elicits a sequence of one-step ahead predictive densities instead of the likelihood and prior. Posterior sampling then involves the imputation of unseen…

Statistics Theory · Mathematics 2026-03-02 Edwin Fong , Andrew Yiu

We derive theorems which outline explicit mechanisms by which anomalous scaling for the probability density function of the sum of many correlated random variables asymptotically prevails. The results characterize general anomalous scaling…

Statistical Mechanics · Physics 2015-05-14 Attilio L. Stella , Fulvio Baldovin

We study the convergence rate of randomly truncated stochastic algorithms, which consist in the truncation of the standard Robbins-Monro procedure on an increasing sequence of compact sets. Such a truncation is often required in practice to…

Probability · Mathematics 2010-04-08 Jérôme Lelong

We study the convergence rate of randomly truncated stochastic algorithms, which consist in the truncation of the standard Robbins-Monro procedure on an increasing sequence of compact sets. Such a truncation is often required in practice to…

Probability · Mathematics 2010-03-23 Jérôme Lelong

Motivated by the Central Limit Theorem, in this paper, we study both universal and non-universal simulations of random variables with an arbitrary target distribution $Q_{Y}$ by general mappings, not limited to linear ones (as in the…

Probability · Mathematics 2018-12-05 Lei Yu

We study the asymptotic behavior of stochastic hyperbolic parabolic equations with slow and fast time scales. Both the strong and weak convergence in the averaging principe are established, which can be viewed as a functional law of large…

Probability · Mathematics 2020-11-12 Michael Röckner , Longjie Xie , Li Yang

We study uncertainty quantification for contextual stochastic optimization, focusing on weighted sample average approximation (wSAA), which uses machine-learned relevance weights based on covariates. Although wSAA is widely used for…

Optimization and Control · Mathematics 2025-10-14 Yanyuan Wang , Xiaowei Zhang

In applied probability, the normal approximation is often used for the distribution of data with assumed additive structure. This tradition is based on the central limit theorem for sums of (independent) random variables. However, it is…

Probability · Mathematics 2020-10-27 Alexandra Dorofeeva , Victor Korolev , Alexander Zeifman

In this paper, we present a generalization of the certainty equivalence principle of stochastic control. One interpretation of the classical certainty equivalence principle for linear systems with output feedback and quadratic costs is as…

Optimization and Control · Mathematics 2026-02-04 Berk Bozkurt , Aditya Mahajan , Ashutosh Nayyar , Yi Ouyang

This paper provides central limit theorems for the wavelet packet decomposition of stationary band-limited random processes. The asymptotic analysis is performed for the sequences of the wavelet packet coefficients returned at the nodes of…

Information Theory · Computer Science 2009-10-26 Abdourrahmane Atto , Dominique Pastor

We present a stochastic constrained output-feedback data-driven predictive control scheme for linear time-invariant systems subject to bounded additive disturbances. The approach uses data-driven predictors based on an extension of Willems'…

Systems and Control · Electrical Eng. & Systems 2025-10-07 Johannes Teutsch , Sebastian Kerz , Dirk Wollherr , Marion Leibold

For a general entropy-regularized stochastic control problem on an infinite horizon, we prove that a policy iteration algorithm (PIA) converges to an optimal relaxed control. Contrary to the standard stochastic control literature, classical…

Optimization and Control · Mathematics 2026-05-14 Yu-Jui Huang , Zhenhua Wang , Zhou Zhou

This paper investigates the stability and convergence properties of asynchronous stochastic approximation (SA) algorithms, with a focus on extensions relevant to average-reward reinforcement learning. We first extend a stability proof…

Machine Learning · Computer Science 2025-12-10 Huizhen Yu , Yi Wan , Richard S. Sutton