English
Related papers

Related papers: Chernoff's bound forms

200 papers

We provide finite sample upper and lower bounds on the Binomial tail probability which are a direct application of Sanov's theorem. We then use these to obtain high probability upper and lower bounds on the minimum of i.i.d. Binomial random…

Probability · Mathematics 2025-02-27 Xiaohan Zhu , Mesrob I. Ohannessian , Nathan Srebro

We derive exponential tail inequalities for sums of random matrices with no dependence on the explicit matrix dimensions. These are similar to the matrix versions of the Chernoff bound and Bernstein inequality except with the explicit…

Probability · Mathematics 2011-05-16 Daniel Hsu , Sham M. Kakade , Tong Zhang

The Markov, Chebyshev, and Chernoff inequalities are some of the most widely used methods for bounding the tail probabilities of random variables. In all three cases, the bounds are tight in the sense that there exists easy examples where…

Probability · Mathematics 2018-03-20 Mark Huber

This paper is the Part II of a serious work about T product tensors focusing at establishing new probability bounds for sums of random, independent, T product tensors. These probability bounds characterize large deviation behavior of the…

Probability · Mathematics 2021-12-10 Shih Yu Chang , Yimin Wei

In this paper, we develop a general approach for probabilistic estimation and optimization. An explicit formula and a computational approach are established for controlling the reliability of probabilistic estimation based on a mixed…

Statistics Theory · Mathematics 2012-12-06 Xinjia Chen

We prove a Chernoff-type bound for sums of matrix-valued random variables sampled via a regular (aperiodic and irreducible) finite Markov chain. Specially, consider a random walk on a regular Markov chain and a Hermitian matrix-valued…

Machine Learning · Statistics 2020-10-30 Jiezhong Qiu , Chi Wang , Ben Liao , Richard Peng , Jie Tang

Let $\{W_t\}_{t=1}^{\infty}$ be a finite state stationary Markov chain, and suppose that $f$ is a real-valued function on the state space. If $f$ is bounded, then Gillman's expander Chernoff bound (1993) provides concentration estimates for…

Probability · Mathematics 2019-06-19 Assaf Naor , Shravas Rao , Oded Regev

The approach used by Kalashnikov and Tsitsiashvili for constructing upper bounds for the tail distribution of a geometric sum with subexponential summands is reconsidered. By expressing the problem in a more probabilistic light, several…

Probability · Mathematics 2009-03-18 Andrew Richards

We study binary hypothesis testing for i.i.d. observations under a multiplicative context weight. For the optimal weighted total loss, defined as the sum of weighted type-I and type-II losses, we prove the logarithmic asymptotic $$ L_n^* =…

Statistics Theory · Mathematics 2026-05-12 Mark Kelbert , El'mira Yu. Kalimulina

The well-known "Janson's inequality" gives Poisson-like upper bounds for the lower tail probability \Pr(X \le (1-\eps)\E X) when X is the sum of dependent indicator random variables of a special form. We show that, for large deviations,…

Probability · Mathematics 2017-12-12 Svante Janson , Lutz Warnke

We investigate the conjecture on the upper bound of the Lyapunov exponent for the chaotic motion of a charged particle around a Kerr-Newman black hole. The Lyapunov exponent is closely associated with the maximum of the effective potential…

General Relativity and Quantum Cosmology · Physics 2022-01-11 Naoto Kan , Bogeun Gwak

We derive in this article the {\it lower} bound for tail of distribution for the random variables (r.v.) through a lower estimate for its moment generating functions (MGF).

Probability · Mathematics 2017-11-21 E. Ostrovsky , L. Sirota

An upper bound for Zolotarev distances between probability measures on multidimensional Euclidean spaces is given in terms of similar distances between one dimensional projections.

Probability · Mathematics 2025-06-24 Sergey G. Bobkov , Friedrich Götze

Concentration inequalities, which have proved very useful in a variety of fields, provide fairly tight bounds on large deviation probabilities while central limit theorem (CLT) describes the asymptotic distribution around the mean (at the…

Probability · Mathematics 2026-02-02 Changqing Liu

Let $P$ be a polynomial of degree $d$ in independent Bernoulli random variables which has zero mean and unit variance. The Bonami hypercontractivity bound implies that the probability that $|P| > t$ decays exponentially in $t^{2/d}$.…

Probability · Mathematics 2022-02-21 Bo'az Klartag , Sasha Sodin

Let $\{\xi_1,\xi_2,\ldots\}$ be a sequence of independent but not necessarily identically distributed random variables. In this paper, the sufficient conditions are found under which the tail probability…

Probability · Mathematics 2018-06-12 Dominyka Kievinaitė , Jonas Šiaulys

A new upper bound on the relative entropy is derived as a function of the total variation distance for probability measures defined on a common finite alphabet. The bound improves a previously reported bound by Csisz\'ar and Talata. It is…

Information Theory · Computer Science 2015-10-20 Igal Sason , Sergio Verdu

Mixture distributions arise in many parametric and non-parametric settings -- for example, in Gaussian mixture models and in non-parametric estimation. It is often necessary to compute the entropy of a mixture, but, in most cases, this…

Information Theory · Computer Science 2022-11-22 Artemy Kolchinsky , Brendan D. Tracey

The Chernoff approximation method is a powerful and flexible tool of functional analysis, which allows in many cases to express exp(tL) in terms of variable coefficients of a linear differential operator L. In this paper, we prove a theorem…

Functional Analysis · Mathematics 2025-03-31 Ivan D. Remizov

We present a method for upper and lower bounding the right and the left tail probabilities of continuous random variables (RVs). For the right tail probability of RV $X$ with probability density function $f (x)$, this method requires first…

Probability · Mathematics 2026-01-07 Nikola Zlatanov