English
Related papers

Related papers: Optimal Chernoff and Hoeffding Bounds for Finite S…

200 papers

Many management decisions involve accumulated random realizations for which only the first and second moments of their distribution are available. The sharp Chebyshev-type bound for the tail probability and Scarf bound for the expected loss…

Econometrics · Economics 2025-05-15 Zhaolin Li , Artem Prokhorov

We utilize operational methods to generalize the Chernoff inequality and prove a new result that relates the moment bound to strictly absolute monotonic functions. We show that the Chernoff bound is part of a continuum of probability…

Probability · Mathematics 2019-11-12 Roy S. Freedman

We consider decision problems on finite sets of hypotheses represented by pairwise different shift-invariant states on a quantum spin chain. The decision in favor of one of the hypotheses is based on outputs of generalized measurements…

Quantum Physics · Physics 2015-05-18 Michael Nussbaum , Arleta Szkola

We give computable bounds on the rate of convergence of the transition probabilities to the stationary distribution for a certain class of geometrically ergodic Markov chains. Our results are different from earlier estimates of Meyn and…

Probability · Mathematics 2007-05-23 Peter H. Baxendale

The Chernoff bound is a well-known tool for obtaining a high probability bound on the expectation of a Bernoulli random variable in terms of its sample average. This bound is commonly used in statistical learning theory to upper bound the…

Machine Learning · Statistics 2022-05-18 Andrew Y. K. Foong , Wessel P. Bruinsma , David R. Burt

We provide a systematic approach to deal with the following problem. Let $X_1,\ldots,X_n$ be, possibly dependent, $[0,1]$-valued random variables. What is a sharp upper bound on the probability that their sum is significantly larger than…

Probability · Mathematics 2015-07-27 Christos Pelekis , Jan Ramon

This paper is a survey of various proofs of the so called {\em fundamental theorem of Markov chains}: every ergodic Markov chain has a unique positive stationary distribution and the chain attains this distribution in the limit independent…

Probability · Mathematics 2022-04-05 Somenath Biswas

We consider the problem of finding the optimal upper bound for the tail probability of a sum of $k$ nonnegative, independent and identically distributed random variables with given mean $x$. For $k=1$ the answer is given by Markov's…

Probability · Mathematics 2016-02-12 Tomasz Łuczak , Katarzyna Mieczkowska , Matas Šileikis

We prove a conditional theorem on the positivity of the Lyapunov exponent for a Schr\"odinger cocycle over a skew shift base with a cosine potential and the golden ratio as frequency. For coupling below 1, which is the threshold for…

Mathematical Physics · Physics 2018-03-12 Rui Han , Marius Lemm , Wilhelm Schlag

Let $\Xi_n \subset \mathbb R^d$, $n\ge 1$, be a sequence of finite sets and consider a $\Xi_n$-valued, irreducible, reversible, continuous-time Markov chain $(X^{(n)}_t:t\ge 0)$. Denote by $\mathscr P(\mathbb R^d) $ the set of probability…

Probability · Mathematics 2025-12-09 Claudio Landim , Ricardo Misturini , Federico Sau

In the paper, we study a new rate of convergence estimate for homogeneous discrete-time nonlinear Markov chains based on the Markov-Dobrushin condition. This result generalizes the convergence estimates for any positive number of transition…

Probability · Mathematics 2021-10-22 Aleksandr A. Shchegolev

We derive exponential tail inequalities for sums of random matrices with no dependence on the explicit matrix dimensions. These are similar to the matrix versions of the Chernoff bound and Bernstein inequality except with the explicit…

Probability · Mathematics 2011-05-16 Daniel Hsu , Sham M. Kakade , Tong Zhang

For Markov chains and Markov processes exhibiting a form of stochastic monotonicity (larger states shift up transition probabilities in terms of stochastic dominance), stability and ergodicity results can be obtained using order-theoretic…

Probability · Mathematics 2024-10-01 Takashi Kamihigashi , John Stachurski

We prove optimal concentration of measure for lifted functions on high dimensional expanders (HDX). Let $X$ be a $k$-dimensional HDX. We show for any $i\leq k$ and $f:X(i)\to [0,1]$: \[\Pr_{s\in X(k)}\left[\left|\underset{{t\subseteq…

Computational Complexity · Computer Science 2024-07-16 Yotam Dikstein , Max Hopkins

We study the limit behaviour of a generally non-linear ordinary differential equation whose solution is a superadditive generalisation of a stochastic matrix, and provide necessary and sufficient conditions for this solution to be ergodic,…

Probability · Mathematics 2016-09-21 Jasper De Bock

This work introduces the minimax Laplace transform method, a modification of the cumulant-based matrix Laplace transform method developed in "User-friendly tail bounds for sums of random matrices" (arXiv:1004.4389v6) that yields both upper…

Probability · Mathematics 2011-07-22 Alex Gittens , Joel A. Tropp

For a wide class of monotonic functions $f$, we develop a Chernoff-style concentration inequality for quadratic forms $Q_f \sim \sum\limits_{i=1}^n f(\eta_i) (Z_i + \delta_i)^2$, where $Z_i \sim N(0,1)$. The inequality is expressed in terms…

Statistics Theory · Mathematics 2019-11-14 Robert E. Gallagher , Louis J. M. Aslett , David Steinsaltz , Ryan R. Christ

The purpose of this letter is to improve Hoeffding's lemma and consequently Hoeffding's tail bounds. The improvement pertains to left skewed zero mean random variables $X\in[a,b]$, where $a<0$ and $-a>b$. The proof of Hoeffding's improved…

Probability · Mathematics 2020-12-08 David Hertz

We study the relative entropy of the empirical probability vector with respect to the true probability vector in multinomial sampling of $k$ categories, which, when multiplied by sample size $n$, is also the log-likelihood ratio statistic.…

Statistics Theory · Mathematics 2022-12-06 F. Richard Guo , Thomas S. Richardson

This work is devoted to explore fundamental aspects of the spectral properties of few-body general operators. We first consider the following question: when we know the probability distributions of a set of observables, what can we way on…

Quantum Physics · Physics 2016-12-21 Tomotaka Kuwahara