English
Related papers

Related papers: Symmetric KL-divergence by Stein's Method

200 papers

We consider the minimization of composite objective functions composed of the expectation of quadratic functions and an arbitrary convex function. We study the stochastic dual averaging algorithm with a constant step-size, showing that it…

Optimization and Control · Mathematics 2017-02-22 Nicolas Flammarion , Francis Bach

We study the convergence rate of translation-invariant discrete-time quantum dynamics on a one-dimensional lattice. We prove that the cumulative distributions function of the ballistically scaled position $X(n)/{n}$ after $n$ steps…

Mathematical Physics · Physics 2026-01-27 Benjamin Hinrichs , Pascal Mittenbühler

We introduce higher-order Stein kernels relative to the standard Gaussian measure, which generalize the usual Stein kernels by involving higher-order derivatives of test functions. We relate the associated discrepancies to various metrics…

Probability · Mathematics 2018-12-07 Max Fathi

We study the Euler scheme for scalar non-autonomous stochastic differential equations, whose diffusion coefficient is not globally Lipschitz but a fractional power of a globally Lipschitz function. We analyse the strong error and establish…

Numerical Analysis · Mathematics 2024-01-17 Annalena Mickel , Andreas Neuenkirch

We derive quantitative bounds on the rate of convergence in $L^1$ Wasserstein distance of general M-estimators, with an almost sharp (up to a logarithmic term) behavior in the number of observations. We focus on situations where the…

Statistics Theory · Mathematics 2021-11-19 François Bachoc , Max Fathi

We develop a new formulation of Stein's method to obtain computable upper bounds on the total variation distance between the geometric distribution and a distribution of interest. Our framework reduces the problem to the construction of a…

Probability · Mathematics 2013-03-21 Erol A. Peköz , Adrian Röllin , Nathan Ross

Convergence rate to the stationary distribution for continuous-time Markov processes can be studied using Lyapunov functions. Recent work by the author provided explicit rates of convergence in special case of a reflected jump-diffusion on…

Probability · Mathematics 2020-03-25 Andrey Sarantsev

Estimating the Kullback-Leibler (KL) divergence between random variables is a fundamental problem in statistical analysis. For continuous random variables, traditional information-theoretic estimators scale poorly with dimension and/or…

Machine Learning · Computer Science 2025-10-08 Mikil Foss , Andrew Lamperski

With a weighting scheme proportional to t, a traditional stochastic gradient descent (SGD) algorithm achieves a high probability convergence rate of O({\kappa}/T) for strongly convex functions, instead of O({\kappa} ln(T)/T). We also prove…

Machine Learning · Computer Science 2013-05-13 Shenghuo Zhu

Let $A$ be an $n \times n$ random matrix with independent identically distributed non-constant subgaussian entries. Then for any $k \le c \sqrt{n}$, \[ \text{rank}(A) \ge n-k \] with probability at least $1-\exp(-c'kn)$.

Probability · Mathematics 2024-03-19 M. Rudelson

Consider a uniformly chosen random reduced decomposition of the longest element in the symmetric group. It is known that the location of the first transposition in this decomposition converges to the semicircle distribution. In this note we…

Probability · Mathematics 2014-05-07 Jason Fulman , Larry Goldstein

We study the so-called distributed two-time-scale gradient method for solving convex optimization problems over a network of agents when the communication bandwidth between the nodes is limited, and so information that is exchanged between…

Systems and Control · Electrical Eng. & Systems 2021-06-01 Marcos M. Vasconcelos , Thinh T. Doan , Urbashi Mitra

In this paper a finite difference/local discontinuous Galerkin method for the fractional diffusion-wave equation is presented and analyzed. We first propose a new finite difference method to approximate the time fractional derivatives, and…

Numerical Analysis · Mathematics 2015-07-29 Leilei Wei

The purpose of this paper is to analyze the distribution distance between random vectors derived from the magnitude of the analytic wavelet transform of the squared envelopes of Gaussian processes and their large-scale limits. When the…

Probability · Mathematics 2024-09-05 Gi-Ren Liu

The asymptotic behaviour of Linear Spectral Statistics (LSS) of the smoothed periodogram estimator of the spectral coherency matrix of a complex Gaussian high-dimensional time series $(\y_n)_{n \in \mathbb{Z}}$ with independent components…

Information Theory · Computer Science 2021-12-01 Philippe Loubaton , Alexis Rosuel

We introduce a new version of Stein's method that reduces a large class of normal approximation problems to variance bounding exercises, thus making a connection between central limit theorems and concentration of measure. Unlike Skorokhod…

Probability · Mathematics 2009-09-29 Sourav Chatterjee

We provide rates of convergence in the central limit theorem in terms of projective criteria for adapted stationary sequences of centered random variables taking values in Banach spaces, with finite moment of order $p \in ]2,3]$ as soon as…

Probability · Mathematics 2025-02-21 Aurélie Bigot

A local convergence rate is established for a Gauss orthogonal collocation method applied to optimal control problems with control constraints. If the Hamiltonian possesses a strong convexity property, then the theory yields convergence for…

Numerical Analysis · Mathematics 2018-09-17 William W. Hager , Jun Liu , Subhashree Mohapatra , Anil V. Rao , Xiang-Sheng Wang

For a large $n\times m$ Gaussian matrix, we compute the joint statistics, including large deviation tails, of generalized and total variance - the scaled log-determinant $H$ and trace $T$ of the corresponding $n\times n$ covariance matrix.…

Statistical Mechanics · Physics 2016-04-29 Fabio Deelan Cunden , Pierpaolo Vivo

We establish normal approximation in the Wasserstein metric for both non-degenerate and degenerate second-order U-statistics under cross-sectional dependence using Stein's method. For the non-degenerate case, our results extend recent…

Econometrics · Economics 2026-04-28 Weiguang Liu