English
Related papers

Related papers: Limit theorems for stochastic approximation algori…

200 papers

We establish a central limit theorem for the unnormalized linear statistic of the Gaussian Unitary Ensemble under optimal conditions: the linear statistics converges if and only if the expression for the limiting variance is finite.

Probability · Mathematics 2015-10-14 Phil Kopel

The question of whether the central limit theorem (CLT) holds for the total number of edges in exponential random graph models (ERGMs) in the subcritical region of parameters has remained an open problem. In this paper, we establish the…

Probability · Mathematics 2025-04-09 Xiao Fang , Song-Hao Liu , Qi-Man Shao , Yi-Kun Zhao

In this work, we study the generalization capability of algorithms from an information-theoretic perspective. It has been shown that the expected generalization error of an algorithm is bounded from above by a function of the relative…

Information Theory · Computer Science 2021-10-27 Borja Rodríguez-Gálvez , Germán Bassi , Mikael Skoglund

We study random compositions of transformations having certain uniform fiberwise properties and prove bounds which in combination with other results yield a quenched central limit theorem equipped with a convergence rate, also in the…

Dynamical Systems · Mathematics 2020-01-08 Olli Hella , Mikko Stenlund

Let $f:[0,1)^d \to {\mathbb R}$ be an integrable function. An objective of many computer experiments is to estimate $\int_{[0,1)^d} f(x) dx$ by evaluating f at a finite number of points in [0,1)^d. There is a design issue in the choice of…

Statistics Theory · Mathematics 2007-08-07 Wei-Liem Loh

We introduce a general mathematical framework for distributed algorithms, and a monotonicity property frequently satisfied in application. These properties are leveraged to provide finite-time guarantees for converging algorithms, suited…

Systems and Control · Electrical Eng. & Systems 2020-07-31 James Melbourne , Govind Saraswat , Vivek Khatana , Sourav Patel , Murti V. Salapaka

Hierarchical Clustering is a popular unsupervised machine learning method with decades of history and numerous applications. We initiate the study of differentially private approximation algorithms for hierarchical clustering under the…

Machine Learning · Computer Science 2023-05-25 Jacob Imola , Alessandro Epasto , Mohammad Mahdian , Vincent Cohen-Addad , Vahab Mirrokni

We give a new characterization for the convergence in distribution to a standard normal law of a sequence of multiple stochastic integrals of a fixed order with variance one, in terms of the Malliavin derivatives of the sequence. We extend…

Probability · Mathematics 2007-05-23 David Nualart , Salvador Ortiz

For random combinatorial optimization problems, there has been much progress in establishing laws of large numbers and computing limiting constants for the optimal value of various problems. However, there has not been as much success in…

Probability · Mathematics 2020-08-24 Sky Cao

Stochastic approximation is a foundation for many algorithms found in machine learning and optimization. It is in general slow to converge: the mean square error vanishes as $O(n^{-1})$. A deterministic counterpart known as quasi-stochastic…

Optimization and Control · Mathematics 2024-03-26 Caio Kalil Lauand , Sean Meyn

In this paper, we study the convergence for solutions to a sequence of (possibly degenerate) stochastic differential equations with jumps, when the coefficients converge in some appropriate sense. Our main tools are the superposition…

Probability · Mathematics 2025-06-18 Huijie Qiao

A major impediment towards the industrial adoption of decentralized distributed systems comes from the difficulty to theoretically prove that these systems exhibit the required behavior. In this paper, we use probability theory to analyze a…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-02-15 Bogdan Alexandru Caprarescu , Eva Kaslik , Dana Petcu

Evolutions of the trading landscape lead to the capability to exchange the same financial instrument on different venues. Because of liquidity issues, the trading firms split large orders across several trading destinations to optimize…

Trading and Market Microstructure · Quantitative Finance 2010-07-28 Sophie Laruelle , Charles-Albert Lehalle , Gilles Pagès

The tools of zero biasing are adapted to yield a general result suitable for analyzing the behavior of certain growth processes. The main theorem is applied to prove central limit theorems, with explicit error terms in the L^1 metric, for…

Combinatorics · Mathematics 2011-05-17 Jason Fulman , Larry Goldstein

Linear optimization problems are investigated whose parameters are uncertain. We apply coherent distortion risk measures to capture the possible violation of a restriction. Each risk constraint induces an uncertainty set of coefficients,…

Methodology · Statistics 2017-12-18 Karl Mosler , Pavel Bazovkin

In this paper, we develop necessary and sufficient conditions for the validity of a martingale approximation for the partial sums of a stationary process in terms of the maximum of consecutive errors. Such an approximation is useful for…

Probability · Mathematics 2011-02-11 Mikhail Gordin , Magda Peligrad

We define and prove limit results for a class of dominant P\'olya sequences, which are randomly reinforced urn processes with color-specific random weights and unbounded number of possible colors. Under fairly mild assumptions on the…

Probability · Mathematics 2023-12-12 Hristo Sariev , Sandra Fortini , Sonia Petrone

Machine learning has become a premier tool in physics and other fields of science. It has been shown that the quantum mechanical scattering problem can not only be solved with such techniques, but it was argued that the underlying neural…

Computational Physics · Physics 2021-02-08 Bastian Kaspschak , Ulf-G. Meißner

Particle smoothers are widely used algorithms allowing to approximate the smoothing distribution in hidden Markov models. Existing algorithms often suffer from slow computational time or degeneracy. We propose in this paper a way to improve…

Methodology · Statistics 2011-07-28 Cyrille Dubarry , Randal Douc

Stochastic dynamical systems consisting of non-invertible continuous maps on an interval are studied. It is proved that if they satisfy the recently introduced so-called $\mu$-injectivity and some mild assumptions, then proximality,…

Dynamical Systems · Mathematics 2025-12-11 Sander C. Hille , Katarzyna Horbacz , Hanna Oppelmayer , Tomasz Szarek