中文
相关论文

相关论文: Symmetric KL-divergence by Stein's Method

200 篇论文

We establish inequalities for assessing the distance between the distribution of errors of partially observed high-frequency statistics of multidimensional L\'evy processes and that of a mixed Gaussian random variable. Furthermore, we…

概率论 · 数学 2025-04-14 Chiara Amorino , Arturo Jaramillo , Mark Podolskij

Consider the Klein-Gordon equation (KGE) in $\R^n$, $n\ge 2$, with constant or variable coefficients. We study the distribution $\mu_t$ of the random solution at time $t\in\R$. We assume that the initial probability measure $\mu_0$ has zero…

数学物理 · 物理学 2009-11-11 T. V. Dudnikova , A. I. Komech , E. A. Kopylova , Yu. M. Suhov

There has been recently a lot of interest in the analysis of the Stein gradient descent method, a deterministic sampling algorithm. It is based on a particle system moving along the gradient flow of the Kullback-Leibler divergence towards…

偏微分方程分析 · 数学 2023-12-29 José A. Carrillo , Jakub Skrzeczkowski

We study the central limit theorem for sums of independent tensor powers, $\frac{1}{\sqrt{d}}\sum\limits_{i=1}^d X_i^{\otimes p}$. We focus on the high-dimensional regime where $X_i \in \mathbb{R}^n$ and $n$ may scale with $d$. Our main…

概率论 · 数学 2020-11-05 Dan Mikulincer

We study the problem of characterizing the stability of Kullback-Leibler (KL) divergence under Gaussian perturbations beyond Gaussian families. Existing relaxed triangle inequalities for KL divergence critically rely on the assumption that…

机器学习 · 计算机科学 2026-04-17 Jialu Pan , Yufeng Zhang , Nan Hu , Zhenbang Chen , Ji Wang , Keqin Li

Estimating Kullback-Leibler divergence from identical and independently distributed samples is an important problem in various domains. One simple and effective estimator is based on the k nearest neighbor distances between these samples.…

信息论 · 计算机科学 2020-02-27 Puning Zhao , Lifeng Lai

We establish a sharp uniform-in-time error estimate for the Stochastic Gradient Langevin Dynamics (SGLD), which is a widely-used sampling algorithm. Under mild assumptions, we obtain a uniform-in-time $O(\eta^2)$ bound for the KL-divergence…

概率论 · 数学 2025-03-20 Lei Li , Yuliang Wang

Kernel methods underpin many of the most successful approaches in data science and statistics, and they allow representing probability measures as elements of a reproducing kernel Hilbert space without loss of information. Recently, the…

机器学习 · 统计学 2025-03-19 Florian Kalinke , Zoltan Szabo , Bharath K. Sriperumbudur

In this article, we consider Poisson and Poisson convoluted geometric approximation to the sums of $n$ independent random variables under moment conditions. We use Stein's method to derive the approximation results in total variation…

概率论 · 数学 2020-07-07 Pratima Eknath Kadu

In the seventies, Charles Stein revolutionized the way of proving the Central Limit Theorem by introducing a method that utilizes a characterization equation for Gaussian distribution. In the last 50 years, much research has been done to…

概率论 · 数学 2022-10-14 Partha S. Dey , Grigory Terlov

As an application of Stein's method for Poisson approximation, we prove rates of convergence for the tail probabilities of two scan statistics that have been suggested for detecting local signals in sequences of independent random variables…

概率论 · 数学 2015-05-29 Xiao Fang , David Siegmund

It is known that the fluctuations of suitable linear statistics of Haar distributed elements of the compact classical groups satisfy a central limit theorem. We show that if the corresponding test functions are sufficiently smooth, a rate…

概率论 · 数学 2012-09-25 Christian Döbler , Michael Stolz

The discrepancy between two independent samples \(X_1,\dots,X_n\) and \(Y_1,\dots,Y_n\) drawn from the same distribution on $\mathbb{R}^d$ typically has order \(O(\sqrt{n})\) even in one dimension. We give a simple online algorithm that…

概率论 · 数学 2026-01-23 Gleb Smirnov , Roman Vershynin

We use Stein's method to obtain bounds on the rate of convergence for a class of statistics in geometric probability obtained as a sum of contributions from Poisson points which are exponentially stabilizing, i.e. locally determined in a…

概率论 · 数学 2007-05-23 Mathew D. Penrose , J. E. Yukich

We present nonasymptotic concentration inequalities for sums of independent and identically distributed random variables that yield asymptotic strong Gaussian approximations of Koml\'os, Major, and Tusn\'ady (KMT) [1975,1976]. The constants…

概率论 · 数学 2025-10-01 Ian Waudby-Smith , Martin Larsson , Aaditya Ramdas

By the continuous mapping theorem, if a sequence of $d$-dimensional random vectors $(\mathbf{W}_n)_{n\geq1}$ converges in distribution to a multivariate normal random variable $\Sigma^{1/2}\mathbf{Z}$, then the sequence of random variables…

概率论 · 数学 2020-03-18 Robert E. Gaunt

New bounds for the $k$-th order derivatives of the solutions of the normal and multivariate normal Stein equations are obtained. Our general order bounds involve fewer derivatives of the test function than those in the existing literature.…

概率论 · 数学 2017-03-21 Robert E. Gaunt

We prove a large deviation result for a random symmetric n x n matrix with independent identically distributed entries to have a few eigenvalues of size n. If the spectrum S survives when the matrix is rescaled by a factor of n, it can only…

概率论 · 数学 2013-04-22 Sourav Chatterjee , S. R. S. Varadhan

The push-sum based subgradient is an important method for distributed convex optimization over unbalanced directed graphs, which is known to converge at a rate of $O(\ln t/\sqrt{t})$. This paper shows that the subgradient-push algorithm…

最优化与控制 · 数学 2023-08-03 Yixuan Lin , Ji Liu

We build on recent works on Stein's method for functions of multivariate normal random variables to derive bounds for the rate of convergence of some asymptotically chi-square distributed statistics. We obtain some general bounds and…

概率论 · 数学 2023-05-15 Robert E. Gaunt , Gesine Reinert