English
Related papers

Related papers: Quantitative Weak Convergence for Discrete Stochas…

200 papers

We establish a convergence theorem for a certain type of stochastic gradient descent, which leads to a convergent variant of the back-propagation algorithm

Optimization and Control · Mathematics 2021-04-02 Hao Wu

We develop a martingale approximation approach to studying the limiting behavior of quadratic forms of Markov chains. We use the technique to examine the asymptotic behavior of lag-window estimators in time series and we apply the results…

Probability · Mathematics 2011-08-16 Yves F. Atchade , Matias D. Cattaneo

A general method is proposed which allows one to estimate drift and diffusion coefficients of a stochastic process governed by a Langevin equation. It extends a previously devised approach [R. Friedrich et al., Physics Letters A 271, 217…

Data Analysis, Statistics and Probability · Physics 2009-11-11 D. Kleinhans , R. Friedrich , A. Nawroth , J. Peinke

The convergence rate in Wasserstein distance is estimated for empirical measures of ergodic Markov processes, and the estimate can be sharp in some specific situations. The main result is applied to subordinations of typical models excluded…

Probability · Mathematics 2024-08-14 Feng-Yu Wang

We establish the pointwise convergence of the iterative Lloyd algorithm, also known as $k$-means algorithm, when the quadratic quantization error of the starting grid (with size $N\ge 2$) is lower than the minimal quantization error with…

Probability · Mathematics 2014-01-03 Gilles Pagès , Jun Yu

Stochastic optimization naturally appear in many application areas, including machine learning. Our goal is to go further in the analysis of the Stochastic Average Gradient Accelerated (SAGA) algorithm. To achieve this, we introduce a new…

Optimization and Control · Mathematics 2024-10-08 Luis Fredes , Bernard Bercu , Eméric Gbaguidi

We consider the task of sampling with respect to a log concave probability distribution. The potential of the target distribution is assumed to be composite, \textit{i.e.}, written as the sum of a smooth convex term, and a nonsmooth convex…

Machine Learning · Statistics 2021-02-23 Adil Salim , Peter Richtárik

Various quantum analogues of the central limit theorem, which is one of the cornerstones of probability theory, are known in the literature. One such analogue, due to Cushen and Hudson, is of particular relevance for quantum optics. It…

Quantum Physics · Physics 2021-04-05 Simon Becker , Nilanjana Datta , Ludovico Lami , Cambyse Rouzé

The subject of this work is a new stochastic Galerkin method for second-order elliptic partial differential equations with random diffusion coefficients. It combines operator compression in the stochastic variables with tree-based spline…

Numerical Analysis · Mathematics 2022-06-02 Markus Bachmayr , Igor Voulis

We establish limit theorems involving weak convergence of multiple generations of critical and supercritical branching processes. These results arise naturally when dealing with the joint asymptotic behavior of functionals defined in terms…

Probability · Mathematics 2009-12-25 James Kuelbs , Anand N. Vidyashankar

We obtain the first results on convergence rates in the Prokhorov metric for the weak invariance principle (functional central limit theorem) for deterministic dynamical systems. Our results hold for uniformly expanding/hyperbolic (Axiom A)…

Dynamical Systems · Mathematics 2021-07-28 Marios Antoniou , Ian Melbourne

We review some recent results of quantitative long-time convergence for the law of a killed Markov process conditioned to survival toward a quasi-stationary distribution, and on the analogous question for the particle systems used in…

Probability · Mathematics 2023-05-26 Bertrand Cloez , Lucas Journel , Pierre Monmarché , Boris Nectoux , Mouad Ramil

This paper studies delayed stochastic algorithms for weakly convex optimization in a distributed network with workers connected to a master node. Recently, Xu et al. 2022 showed that an inertial stochastic subgradient method converges at a…

Optimization and Control · Mathematics 2023-11-02 Wenzhi Gao , Qi Deng

We consider weak convergence of the rescaled error processes arising from Riemann discretizations of certain stochastic integrals and relate the $L_p$-integrability of the weak limit to the fractional smoothness in the Malliavin sense of…

Probability · Mathematics 2010-01-25 Stefan Geiss , Anni Toivola

This paper develops a unified framework, based on iterated random operator theory, to analyze the convergence of constant stepsize recursive stochastic algorithms (RSAs). RSAs use randomization to efficiently compute expectations, and so…

Machine Learning · Computer Science 2021-01-06 Abhishek Gupta , William B. Haskell

We study the local convergence of diffusive mean-field systems, including Wasserstein gradient flows, min-max dynamics, and multi-species games. We establish exponential local convergence in $\chi^2$-divergence with sharp rates, under two…

Optimization and Control · Mathematics 2026-02-13 Guillaume Wang , Lénaïc Chizat

Stochastic Gradient Langevin Dynamics (SGLD) ensures strong guarantees with regards to convergence in measure for sampling log-concave posterior distributions by adding noise to stochastic gradient iterates. Given the size of many practical…

Machine Learning · Computer Science 2020-06-15 Vyacheslav Kungurtsev , Bapi Chatterjee , Dan Alistarh

We revisit the problem of sampling from a target distribution that has a smooth strongly log-concave density everywhere in $\mathbb R^p$. In this context, if no additional density information is available, the randomized midpoint…

Statistics Theory · Mathematics 2023-06-19 Lu Yu , Avetik Karagulyan , Arnak Dalalyan

Several issues in machine learning and inverse problems require to generate discrete data, as if sampled from a model probability distribution. A common way to do so relies on the construction of a uniform probability distribution over a…

Optimization and Control · Mathematics 2021-06-16 Quentin Merigot , Filippo Santambrogio , Clément Sarrazin

We derive quantitative bounds in the Wasserstein distance for the approximation of stochastic integrals with respect to Hawkes processes by a normally distributed random variable. In the case of deterministic and non-negative integrands,…

Probability · Mathematics 2022-09-09 Mahmoud Khabou , Nicolas Privault , Anthony Reveillac