English
Related papers

Related papers: Chernoff Bounds for Tensor Expanders on Riemannian…

200 papers

The Chernoff bound is an important inequality relation in probability theory. The original version of the Chernoff bound is to give an exponential decreasing bound on the tail distribution of sums of independent random variables. Recent…

Probability · Mathematics 2021-05-18 Shih Yu Chang

Chernoff bounds are a powerful application of the Markov inequality to produce strong bounds on the tails of probability distributions. They are often used to bound the tail probabilities of sums of Poisson trials, or in regression to…

Statistics Theory · Mathematics 2022-05-24 D. K. L. Shiu

In probability theory, the Chernoff bound gives exponentially decreasing bounds on tail distributions for sums of independent random variables and such bound is applied at different fields in science and engineering. In this work, we…

Probability · Mathematics 2021-09-29 Shih Yu Chang

This work prepares new probability bounds for sums of random, independent, Hermitian tensors. These probability bounds characterize large-deviation behavior of the extreme eigenvalue of the sums of random tensors. We extend Lapalace…

Probability · Mathematics 2021-01-01 Shih Yu Chang

This paper presents significant advancements in tensor analysis and the study of random walks on manifolds. It introduces new tensor inequalities derived using the Mond-Pecaric method, which enriches the existing mathematical tools for…

Probability · Mathematics 2024-09-04 Shih-Yu Chang

Chebyshev's inequality provides an upper bound on the tail probability of a random variable based on its mean and variance. While tight, the inequality has been criticized for only being attained by pathological distributions that abuse the…

Optimization and Control · Mathematics 2020-10-16 Ernst Roos , Ruud Brekelmans , Wouter van Eekelen , Dick den Hertog , Johan van Leeuwaarden

We prove a Chernoff-type bound for sums of matrix-valued random variables sampled via a regular (aperiodic and irreducible) finite Markov chain. Specially, consider a random walk on a regular Markov chain and a Hermitian matrix-valued…

Machine Learning · Statistics 2020-10-30 Jiezhong Qiu , Chi Wang , Ben Liao , Richard Peng , Jie Tang

The non-asymptotic tail bounds of random variables play crucial roles in probability, statistics, and machine learning. Despite much success in developing upper bounds on tail probability in literature, the lower bounds on tail…

Probability · Mathematics 2020-09-08 Anru R. Zhang , Yuchen Zhou

We consider a multivariate distributional recursion of sum-type as arising in the probabilistic analysis of algorithms and random trees. We prove an upper tail bound for the solution using Chernoff's bounding technique by estimating the…

Probability · Mathematics 2011-06-21 Goetz Olaf Munsonius

We study generalisations of a simple, combinatorial proof of a Chernoff bound similar to the one by Impagliazzo and Kabanets (RANDOM, 2010). In particular, we prove a randomized version of the hitting property of expander random walks and…

Discrete Mathematics · Computer Science 2015-01-16 Jan Hązła , Thomas Holenstein

Chernoff's bound binds a tail probability (ie. $Pr(X \ge a)$, where $a \ge EX$). Assuming that the distribution of $X$ is $Q$, the logarithm of the bound is known to be equal to the value of relative entropy (or minus Kullback-Leibler…

Probability · Mathematics 2012-08-27 M. Grendar, , M. Grendar

This paper describes the construction of a lower bound for the tails of general random variables, using solely knowledge of their moment generating function. The tilting procedure used allows for the construction of lower bounds that are…

Probability · Mathematics 2007-06-13 Ted Theodosopoulos

We prove a Chernoff-type bound for sums of matrix-valued random variables sampled via a random walk on an expander, confirming a conjecture due to Wigderson and Xiao. Our proof is based on a new multi-matrix extension of the Golden-Thompson…

Probability · Mathematics 2018-04-18 Ankit Garg , Yin Tat Lee , Zhao Song , Nikhil Srivastava

Recent research has made significant progress on the problem of bounding log partition functions for exponential family graphical models. Such bounds have associated dual parameters that are often used as heuristic estimates of the marginal…

Machine Learning · Computer Science 2012-07-19 Pradeep Ravikumar , John Lafferty

The Chernoff bound is a well-known tool for obtaining a high probability bound on the expectation of a Bernoulli random variable in terms of its sample average. This bound is commonly used in statistical learning theory to upper bound the…

Machine Learning · Statistics 2022-05-18 Andrew Y. K. Foong , Wessel P. Bruinsma , David R. Burt

Chernoff approximations of Feller semigroups and the associated diffusion processes in Riemannian manifolds are studied. The manifolds are assumed to be of bounded geometry, thus including all compact manifolds and also a wide range of…

Functional Analysis · Mathematics 2022-10-17 Sonia Mazzucchi , Valter Moretti , Ivan Remizov , Oleg Smolyanov

We derive simple but nearly tight upper and lower bounds for the binomial lower tail probability (with straightforward generalization to the upper tail probability) that apply to the whole parameter regime. These bounds are easy to compute…

Probability · Mathematics 2022-11-04 Huangjun Zhu , Zihao Li , Masahito Hayashi

We prove tail estimates for variables $\sum_i f(X_i)$, where $(X_i)_i$ is the trajectory of a random walk on an undirected graph (or, equivalently, a reversible Markov chain). The estimates are in terms of the maximum of the function $f$,…

Probability · Mathematics 2007-12-25 Roy Wagner

This paper is the Part II of a serious work about T product tensors focusing at establishing new probability bounds for sums of random, independent, T product tensors. These probability bounds characterize large deviation behavior of the…

Probability · Mathematics 2021-12-10 Shih Yu Chang , Yimin Wei

We study the relative entropy of the empirical probability vector with respect to the true probability vector in multinomial sampling of $k$ categories, which, when multiplied by sample size $n$, is also the log-likelihood ratio statistic.…

Statistics Theory · Mathematics 2022-12-06 F. Richard Guo , Thomas S. Richardson
‹ Prev 1 2 3 10 Next ›