English
Related papers

Related papers: Self-normalized deviation inequalities with applic…

200 papers

Sums of independent, bounded random variables concentrate around their expectation approximately as well a Gaussian of the same variance. Well known results of this form include the Bernstein, Hoeffding, and Chernoff inequalities and many…

Discrete Mathematics · Computer Science 2017-04-25 Thomas Steinke , Jonathan Ullman

Self-normalized processes are basic to many probabilistic and statistical studies. They arise naturally in the the study of stochastic integrals, martingale inequalities and limit theorems, likelihood-based methods in hypothesis testing and…

Probability · Mathematics 2009-09-29 Victor H. de la Peña , Michael J. Klass , Tze Leung Lai

We prove tail estimates for variables $\sum_i f(X_i)$, where $(X_i)_i$ is the trajectory of a random walk on an undirected graph (or, equivalently, a reversible Markov chain). The estimates are in terms of the maximum of the function $f$,…

Probability · Mathematics 2007-12-25 Roy Wagner

This paper presents new probability inequalities for sums of independent, random, self-adjoint matrices. These results place simple and easily verifiable hypotheses on the summands, and they deliver strong conclusions about the…

Probability · Mathematics 2014-04-29 Joel A. Tropp

We study the extent of independence needed to approximate the product of bounded random variables in expectation, a natural question that has applications in pseudorandomness and min-wise independent hashing. For random variables whose…

Computational Complexity · Computer Science 2015-08-12 Parikshit Gopalan , Amir Yehudayoff

An explicit upper bound on the tail probabilities for the normalized Rademacher sums is given. This bound, which is best possible in a certain sense, is asymptotically equivalent to the corresponding tail probability of the standard normal…

Probability · Mathematics 2017-01-17 Iosif Pinelis

We present a generalization of the maximal inequalities that upper bound the expectation of the maximum of $n$ jointly distributed random variables. We control the expectation of a randomly selected random variable from $n$ jointly…

Probability · Mathematics 2017-08-31 Jiantao Jiao , Yanjun Han , Tsachy Weissman

In this article we derive the best possible upper bound for $E[\max{X_i}-\min_i{X_i}]$ under given means and variances on $n$ random variables $X_i$. The random vector $(X_1,...,X_n)$ is allowed to have any dependence structure, provided $E…

Methodology · Statistics 2016-11-18 Nickos Papadatos

We derive upper bounds for probabilities of the form $P(g(\mathbf{X})\geq t)$ using the southwest boundary (recently introduced in our previous work) $\partial_{\mathrm{SW}} Q(g^{-1}[t,\infty))$, where $Q$ is a reflection to the first…

Probability · Mathematics 2026-04-27 Stephen Jordan Harrison

This manuscript studies the Gaussian approximation of the coordinate-wise maximum of self-normalized statistics in high-dimensional settings. We derive an explicit Berry-Esseen bound under weak assumptions on the absolute moments. When the…

Probability · Mathematics 2025-01-16 Woonyoung Chang , Kenta Takatsu , Konrad Urban , Arun Kumar Kuchibhotla

Exponential tail bounds for sums play an important role in statistics, but the example of the $t$-statistic shows that the exponential tail decay may be lost when population parameters need to be estimated from the data. However, it turns…

Statistics Theory · Mathematics 2022-03-22 Guenther Walther

Let $X_1,X_2,\ldots,X_n$ be independent random variables and $S_k=\sum_{i=1}^k X_i$. We show that for any constants $a_k$, \[ \Pr(\max_{1\leq k\leq n}||S_{k}|-a_{k}|>11t)\leq 30 \max_{1\leq k\leq n}\Pr(||S_{k}|-a_{k}|>t). \] We also discuss…

Probability · Mathematics 2015-01-06 Rafał Latała

For self-normalized martingales with conditionally symmetric differences, de la Pe\~{n}a [A general class of exponential inequalities for martingales and ratios. Ann. Probab. 27, No.1, 537-564] established the Gaussian type exponential…

Probability · Mathematics 2019-07-04 Xiequan Fan , Shen Wang

A well-known discovery of Feige's is the following: Let $X_1, \ldots, X_n$ be nonnegative independent random variables, with $\mathbb{E}[X_i] \leq 1 \;\forall i$, and let $X = \sum_{i=1}^n X_i$. Then for any $n$, \[\Pr[X < \mathbb{E}[X] +…

Probability · Mathematics 2018-04-06 Brian Garnett

For a fixed unit vector a=(a_1,a_2,...,a_n) in S^{n-1}, i.e. sum_{i=1}^n a_i^2=1, we consider the 2^n sign vectors epsilon=(epsilon_1,epsilon_2,...,epsilon_n) in {-1,1}^n and the corresponding scalar products a.epsilon=sum_{i=1}^n a_i…

Probability · Mathematics 2012-10-04 Harrie Hendriks , Martien C. A. van Zuijlen

We derive upper bounds on the tail conditional expectation of binomial and Poisson random variables. Those upper bounds are subsequently employed to the problem of obtaining non-asymptotic lower bounds on the probability that the…

Probability · Mathematics 2017-12-07 Christos Pelekis

We present deviation bounds for self-normalized averages and applications to estimation with a random number of observations. The results rely on a peeling argument in exponential martingale techniques that represents an alternative to the…

Statistics Theory · Mathematics 2016-11-17 Aurélien Garivier

Let $X$ be an $n\times n$ symmetric random matrix with independent but non-identically distributed entries. The deviation inequalities of the spectral norm of $X$ with Gaussian entries have been obtained by using the standard concentration…

Probability · Mathematics 2023-08-22 Guozheng Dai , Zhonggen Su , Hanchao Wang

In this paper, we prove a Berry--Esseen bound with optimal order for self-normalized sums of local dependent random variables under some mild dependence conditions. The proof is based on Stein's method and a randomized concentration…

Probability · Mathematics 2021-04-09 Zhuo-Song Zhang

The sharpest known high probability generalization bounds for uniformly stable algorithms (Feldman, Vondr\'{a}k, 2018, 2019), (Bousquet, Klochkov, Zhivotovskiy, 2020) contain a generally inevitable sampling error term of order…

Machine Learning · Computer Science 2021-11-19 Yegor Klochkov , Nikita Zhivotovskiy