English
Related papers

Related papers: Efficient computation of tight approximations to C…

200 papers

Many management decisions involve accumulated random realizations for which only the first and second moments of their distribution are available. The sharp Chebyshev-type bound for the tail probability and Scarf bound for the expected loss…

Econometrics · Economics 2025-05-15 Zhaolin Li , Artem Prokhorov

We prove a Chernoff-type bound for sums of matrix-valued random variables sampled via a regular (aperiodic and irreducible) finite Markov chain. Specially, consider a random walk on a regular Markov chain and a Hermitian matrix-valued…

Machine Learning · Statistics 2020-10-30 Jiezhong Qiu , Chi Wang , Ben Liao , Richard Peng , Jie Tang

We provide finite sample upper and lower bounds on the Binomial tail probability which are a direct application of Sanov's theorem. We then use these to obtain high probability upper and lower bounds on the minimum of i.i.d. Binomial random…

Probability · Mathematics 2025-02-27 Xiaohan Zhu , Mesrob I. Ohannessian , Nathan Srebro

We derive exponential tail inequalities for sums of random matrices with no dependence on the explicit matrix dimensions. These are similar to the matrix versions of the Chernoff bound and Bernstein inequality except with the explicit…

Probability · Mathematics 2011-05-16 Daniel Hsu , Sham M. Kakade , Tong Zhang

The non-asymptotic tail bounds of random variables play crucial roles in probability, statistics, and machine learning. Despite much success in developing upper bounds on tail probability in literature, the lower bounds on tail…

Probability · Mathematics 2020-09-08 Anru R. Zhang , Yuchen Zhou

An identity between two versions of the Chernoff bound on the probability a certain large deviations event, is established. This identity has an interpretation in statistical physics, namely, an isothermal equilibrium of a composite system…

Information Theory · Computer Science 2007-07-13 Neri Merhav

In this paper we develop algorithms for approximating matrix multiplication with respect to the spectral norm. Let A\in{\RR^{n\times m}} and B\in\RR^{n \times p} be two matrices and \eps>0. We approximate the product A^\top B using two…

Data Structures and Algorithms · Computer Science 2010-10-28 Avner Magen , Anastasios Zouzias

In this paper, we develop a general approach for probabilistic estimation and optimization. An explicit formula and a computational approach are established for controlling the reliability of probabilistic estimation based on a mixed…

Statistics Theory · Mathematics 2012-12-06 Xinjia Chen

We consider a multivariate distributional recursion of sum-type as arising in the probabilistic analysis of algorithms and random trees. We prove an upper tail bound for the solution using Chernoff's bounding technique by estimating the…

Probability · Mathematics 2011-06-21 Goetz Olaf Munsonius

The classical Chernoff's theorem is a statement about discrete-time approximations of semigroups, where the approximations are consturcted as products of time-dependent contraction operators strongly differentiable at zero. We generalize…

Functional Analysis · Mathematics 2011-01-19 Evelina Shamarova

The idea of the restricted mean has been used to establish a significantly improved version of Markov's inequality that does not require any new assumptions. The result immediately extends on Chebyshev's inequalities and Chernoff's bound.…

Statistics Theory · Mathematics 2023-08-09 Joan del Castillo

In this note the Chernoff Theorem is used to approximate evolution semigroups constructed by the procedure of subordination. The considered semigroups are subordinate to some original, unknown explicitly but already approximated by the same…

Probability · Mathematics 2021-03-16 Yana A. Butko

In this paper, we develop a general theory of truncated inverse binomial sampling. In this theory, the fixed-size sampling and inverse binomial sampling are accommodated as special cases. In particular, the classical Chernoff-Hoeffding…

Statistics Theory · Mathematics 2019-08-20 Xinjia Chen

A survey is given of some Chernoff type bounds for the tail probabilities P(X-EX > a) and P(X-EX < a) when X is a random variable that can be written as a sum of indicator variables that are either independent or negatively related. Most…

Probability · Mathematics 2016-09-05 Svante Janson

Using terminologies of information geometry, we derive upper and lower bounds of the tail probability of the sample mean. Employing these bounds, we obtain upper and lower bounds of the minimum error probability of the 2nd kind of error…

Statistics Theory · Mathematics 2024-09-10 Shun Watanabe , Masahito Hayashi

The Chernoff approximation method is a powerful and flexible tool of functional analysis, which allows in many cases to express exp(tL) in terms of variable coefficients of a linear differential operator L. In this paper, we prove a theorem…

Functional Analysis · Mathematics 2025-03-31 Ivan D. Remizov

We present simple randomized and exchangeable improvements of Markov's inequality, as well as Chebyshev's inequality and Chernoff bounds. Our variants are never worse and typically strictly more powerful than the original inequalities. The…

Statistics Theory · Mathematics 2023-05-10 Aaditya Ramdas , Tudor Manole

For a wide class of monotonic functions $f$, we develop a Chernoff-style concentration inequality for quadratic forms $Q_f \sim \sum\limits_{i=1}^n f(\eta_i) (Z_i + \delta_i)^2$, where $Z_i \sim N(0,1)$. The inequality is expressed in terms…

Statistics Theory · Mathematics 2019-11-14 Robert E. Gallagher , Louis J. M. Aslett , David Steinsaltz , Ryan R. Christ

Extending recent work of Corrado, we derive an algorithm that computes rigorous upper and lower bounds for rectangle scan probabilities for Markov increments. We experimentally examine the closeness of the bounds computed by the algorithm…

Computation · Statistics 2011-09-16 Jannis Dimitriadis

This work introduces the minimax Laplace transform method, a modification of the cumulant-based matrix Laplace transform method developed in "User-friendly tail bounds for sums of random matrices" (arXiv:1004.4389v6) that yields both upper…

Probability · Mathematics 2011-07-22 Alex Gittens , Joel A. Tropp