English
Related papers

Related papers: Nonasymptotic CLT and Error Bounds for Two-Time-Sc…

200 papers

Quantitative convergence in Wasserstein distance is often easier to establish than that in total variation distance. We show that such bounds allowing subgeometric rates yield central limit theorems (CLTs) for additive functionals of Markov…

Statistics Theory · Mathematics 2025-11-25 Rui Jin , Aixin Tan

We generalise the martingale-coboundary representation of discrete time stochastic processes to the non-stationary case and to random variables in Orlicz spaces. Related limit theorems (CLT, invariance principle, log log law, probabilities…

Probability · Mathematics 2023-11-07 Dalibor Volny

Given 2D point correspondences between an image pair, inferring the camera motion is a fundamental issue in the computer vision community. The existing works generally set out from the epipolar constraint and estimate the essential matrix,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Guangyang Zeng , Qingcheng Zeng , Xinghan Li , Biqiang Mu , Jiming Chen , Ling Shi , Junfeng Wu

This paper considers a novel multi-agent linear stochastic approximation algorithm driven by Markovian noise and general consensus-type interaction, in which each agent evolves according to its local stochastic approximation process which…

Machine Learning · Computer Science 2023-10-02 Yixuan Lin , Vijay Gupta , Ji Liu

Spectral estimation is an important tool in time series analysis, with applications including economics, astronomy, and climatology. The asymptotic theory for non-parametric estimation is well-known but the development of non-asymptotic…

Statistics Theory · Mathematics 2025-04-02 Yuping Zheng , Andrew Lamperski

In this paper, we establish the almost sure convergence of two-timescale stochastic gradient descent algorithms in continuous time under general noise and stability conditions, extending well known results in discrete time. We analyse…

Optimization and Control · Mathematics 2021-10-01 Louis Sharrock , Nikolas Kantas

The aim of this paper is to study the asymptotic expansion in total variation in the Central Limit Theorem when the law of the basic random variable is locally lower-bounded by the Lebesgue measure (or equivalently, has an absolutely…

Probability · Mathematics 2016-07-18 Vlad Bally , Lucia Caramellino

We establish inequalities for assessing the distance between the distribution of a (possibly multidimensional) functional of a Poisson random measure and that of a Gaussian element. Our bounds only involve add-one cost operators at the…

Probability · Mathematics 2020-10-27 Raphaël Lachièze-Rey , Giovanni Peccati , Xiaochuan Yang

Stochastic gradient descent (SGD) has emerged as the quintessential method in a data scientist's toolbox. Using SGD for high-stakes applications requires, however, careful quantification of the associated uncertainty. Towards that end, in…

Statistics Theory · Mathematics 2025-10-24 Bhavya Agrawalla , Krishnakumar Balasubramanian , Promit Ghosal

An important problem in space-time adaptive detection is the estimation of the large p-by-p interference covariance matrix from training signals. When the number of training signals n is greater than 2p, existing estimators are generally…

Signal Processing · Electrical Eng. & Systems 2021-07-26 Benjamin D. Robinson , Robert Malinas , Alfred O. Hero

Double machine learning provides $\sqrt{n}$-consistent estimates of parameters of interest even when high-dimensional or nonparametric nuisance parameters are estimated at an $n^{-1/4}$ rate. The key is to employ Neyman-orthogonal moment…

Machine Learning · Computer Science 2018-08-03 Lester Mackey , Vasilis Syrgkanis , Ilias Zadik

Temporal-difference learning with gradient correction (TDC) is a two time-scale algorithm for policy evaluation in reinforcement learning. This algorithm was initially proposed with linear function approximation, and was later extended to…

Machine Learning · Computer Science 2021-10-29 Yue Wang , Shaofeng Zou , Yi Zhou

We show the convergence of the zero relaxation limit in systems of $2 \times 2$ hyperbolic conservation laws with stochastic initial data. Precisely, solutions converge to a solution of the local equilibrium approximation as the relaxation…

Analysis of PDEs · Mathematics 2018-11-01 James M. Scott , M. Paul Laiu , Cory D. Hauck

Strict stationarity is a common assumption used in the time series literature in order to derive asymptotic distributional results for second-order statistics, like sample autocovariances and sample autocorrelations. Focusing on weak…

Statistics Theory · Mathematics 2023-02-28 Yunyi Zhang , Efstathios Paparoditis , Dimitris N. Politis

In this article, we fill a gap in the literature on Hawkes processes. In particular, we derive a CLT for a non linear compound marked Hawkes process. We also provide an upper bound on the convergence rate using the functional 1-Wasserstein…

Probability · Mathematics 2026-01-27 Benjamin Massat

Stochastic non-smooth convex optimization constitutes a class of problems in machine learning and operations research. This paper considers minimization of a non-smooth function based on stochastic subgradients. When the function has a…

Optimization and Control · Mathematics 2016-07-12 Sucha Supittayapornpong , Michael J. Neely

We provide new bounds for the rate of convergence of the multivariate Central Limit Theorem in Wasserstein distances of order $p \geq 2$. In particular, we obtain what we conjecture to be the asymptotically optimal rate whenever the density…

Probability · Mathematics 2024-04-30 Thomas Bonis

For large scale learning problems, it is desirable if we can obtain the optimal model parameters by going through the data in only one pass. Polyak and Juditsky (1992) showed that asymptotically the test performance of the simple average of…

Machine Learning · Computer Science 2011-12-23 Wei Xu

We propose new continuous-time formulations for first-order stochastic optimization algorithms such as mini-batch gradient descent and variance-reduced methods. We exploit these continuous-time models, together with simple Lyapunov analysis…

Optimization and Control · Mathematics 2020-03-12 Antonio Orvieto , Aurelien Lucchi

It is well known that central order statistics exhibit a central limit behavior and converge to a Gaussian distribution as the sample size grows. This paper strengthens this known result by establishing an entropic version of the CLT that…

Information Theory · Computer Science 2022-05-11 Martina Cardone , Alex Dytso , Cynthia Rush