English
Related papers

Related papers: Sharp large deviation results for sums of independ…

200 papers

It is shown that functions defined on $\{0,1,...,r-1\}^n$ satisfying certain conditions of bounded differences that guarantee sub-Gaussian tail behavior also satisfy a much stronger ``local'' sub-Gaussian property. For self-bounding and…

Probability · Mathematics 2008-01-03 Luc Devroye , Gábor Lugosi

In the context of bounding probability of small deviation, there are limited general tools. However, such bounds have been widely applied in graph theory and inventory management. We introduce a common approach to substantially sharpen such…

Optimization and Control · Mathematics 2020-03-09 Jiayi Guo , Simai He , Zi Ling , Yicheng Liu

We study tail probabilities via some Gaussian approximations. Our results make refinements to large deviation theory. The proof builds on classical results by Bahadur and Rao. Binomial distributions and their tail probabilities are…

Statistics Theory · Mathematics 2012-05-07 Laszlo Gyorfi , Peter Harremoes , Gabor Tusnady

Motivated by metastability in the zero-range process, we consider i.i.d.\ random variables with values in $\N_0$ and Weibull-like (stretched exponential) law $\mathbb P(X_i =k) = c \exp( - k^\alpha)$, $\alpha \in (0,1)$. We condition on…

Probability · Mathematics 2024-05-28 Sabine Jansen

A refinement of Bennett's inequality is introduced which is strictly tighter than the classical bound. The new bound establishes the convergence of the average of independent random variables to its expected value. It also carefully…

Statistics Theory · Mathematics 2018-04-17 Tony Jebara

We develop a unified approach to bounding the largest and smallest singular values of an inhomogeneous random rectangular matrix, based on the non-backtracking operator and the Ihara-Bass formula for general random Hermitian matrices with a…

Probability · Mathematics 2024-12-13 Ioana Dumitriu , Yizhe Zhu

We refine the conditions for the lower bound in an abstract large deviation result with nonconvex rate function we had previously introduced. We apply the results to certain stochastic recursive schemes.

Probability · Mathematics 2007-05-23 A. de Acosta

We study the problem of distinguishing between two symmetric probability distributions over $n$ bits by observing $k$ bits of a sample, subject to the constraint that all $k-1$-wise marginal distributions of the two distributions are…

Computational Complexity · Computer Science 2021-03-16 Christopher Williamson

We present a new PAC-Bayesian generalization bound. Standard bounds contain a $\sqrt{L_n \cdot \KL/n}$ complexity term which dominates unless $L_n$, the empirical error of the learning algorithm's randomized predictions, vanishes. We manage…

Machine Learning · Computer Science 2021-12-16 Zakaria Mhammedi , Peter D. Grunwald , Benjamin Guedj

In this work, we derive sharp non-asymptotic deviation bounds for weighted sums of Dirichlet random variables. These bounds are based on a novel integral representation of the density of a weighted Dirichlet sum. This representation allows…

Probability · Mathematics 2023-04-07 Denis Belomestny , Pierre Menard , Alexey Naumov , Daniil Tiapkin , Michal Valko

We prove a deviation bound for the maximum of partial sums of functions of $\alpha$-dependent sequences as defined in Dedecker, Gou{\"e}zel and Merlev{\`e}de (2010). As a consequence, we extend the Rosenthal inequality of Rio (2000) for…

Probability · Mathematics 2016-01-22 J Dedecker , Florence Merlevède

Correcting for skewness can result in more accurate tail probability approximations in the central limit theorem for sums of independent random variables. In this paper, we extend the theory to sums of local statistics of independent random…

Probability · Mathematics 2019-04-05 Xiao Fang , Li Luo , Qi-Man Shao

We establish new sufficient conditions for the applicability of the strong law of large numbers (SLLN) for sequences of pairwise independent non-identically distributed random variables. These results generalize Etemadi's extension of…

Probability · Mathematics 2017-01-10 Valery Korchevsky

For a sequence $\{X_{n}, \, n \geqslant 1 \}$ of nonnegative random variables where $\max[\min(X_{n} - s,t),0]$, $t > s \geqslant 0$, satisfy a moment inequality, sufficient conditions are given under which $\sum_{k=1}^n (X_k - \mathbb{E}…

Probability · Mathematics 2020-11-23 João Lita da Silva

The sharpest known high probability generalization bounds for uniformly stable algorithms (Feldman, Vondr\'{a}k, 2018, 2019), (Bousquet, Klochkov, Zhivotovskiy, 2020) contain a generally inevitable sampling error term of order…

Machine Learning · Computer Science 2021-11-19 Yegor Klochkov , Nikita Zhivotovskiy

In this paper, we obtain some results on precise large deviations for non-random and random sums of widely dependent random variables with common dominatedly varying tail distribution or consistently varying tail distribution on…

Probability · Mathematics 2021-06-14 Zhaolei Cui , Yuebao Wang

We provide a bound on a natural distance between finitely and infinitely supported elements of the unit sphere of $\ell^2(\mathbb{N}^*)$, the space of real valued sequences with finite $\ell^2$ norm. We use this bound to estimate the…

Probability · Mathematics 2019-08-20 Benjamin Arras , Ehsan Azmoodeh , Guillaume Poly , Yvik Swan

This work concerns generalized backward stochastic differential equations, which are coupled with a family of reflecting diffusion processes. First of all, we establish the large deviation principle for forward stochastic differential…

Probability · Mathematics 2024-07-23 Yawen Liu , Huijie Qiao

While useful probability bounds for $n$ pairwise independent Bernoulli random variables adding up to at least an integer $k$ have been proposed in the literature, none of these bounds are tight in general. In this paper, we provide several…

Optimization and Control · Mathematics 2022-11-24 Arjun Ramachandra , Karthik Natarajan

We establish strong invariance principles for sums of stationary and ergodic processes with nearly optimal bounds. Applications to linear and some nonlinear processes are discussed. Strong laws of large numbers and laws of the iterated…

Probability · Mathematics 2011-11-10 Wei Biao Wu