English
Related papers

Related papers: Strengthened Chernoff-type variance bounds

200 papers

We prove a Chernoff-type bound for sums of matrix-valued random variables sampled via a regular (aperiodic and irreducible) finite Markov chain. Specially, consider a random walk on a regular Markov chain and a Hermitian matrix-valued…

Machine Learning · Statistics 2020-10-30 Jiezhong Qiu , Chi Wang , Ben Liao , Richard Peng , Jie Tang

In the first five sections, we deal with the class of probability measures with asymptotically periodic Verblunsky coefficients of p-type bounded variation. The goal is to investigate the perturbation of the Verblunsky coefficients when we…

Classical Analysis and ODEs · Mathematics 2010-10-26 Manwah Lilian Wong

We develop a class of exponential bounds for the probability that a martingale sequence crosses a time-dependent linear threshold. Our key insight is that it is both natural and fruitful to formulate exponential concentration inequalities…

Probability · Mathematics 2025-12-18 Steven R. Howard , Aaditya Ramdas , Jon McAuliffe , Jasjeet Sekhon

We prove a Bernstein-type bound for the difference between the average of negative log-likelihoods of independent discrete random variables and the Shannon entropy, both defined on a countably infinite alphabet. The result holds for the…

Information Theory · Computer Science 2021-06-24 Yunpeng Zhao

We present new scalar and matrix Chernoff-style concentration bounds for a broad class of probability distributions over the binary hypercube $\{0,1\}^n$. Motivated by recent tools developed for the study of mixing times of Markov chains on…

Discrete Mathematics · Computer Science 2022-01-07 Tali Kaufman , Rasmus Kyng , Federico Soldá

We present simple randomized and exchangeable improvements of Markov's inequality, as well as Chebyshev's inequality and Chernoff bounds. Our variants are never worse and typically strictly more powerful than the original inequalities. The…

Statistics Theory · Mathematics 2023-05-10 Aaditya Ramdas , Tudor Manole

We show that a family of random variables is uniformly integrable if and only if it is stochastically bounded in the increasing convex order by an integrable random variable. This result is complemented by proving analogous statements for…

Probability · Mathematics 2011-06-06 Lasse Leskelä , Matti Vihola

We consider the class of higher derivative $3d$ vector field models with the field equation operator being a polynomial of the Chern-Simons operator. For $n$-th order theory of this type, we provide a general receipt for constructing…

High Energy Physics - Theory · Physics 2016-01-20 D. S. Kaparulin , I. Yu. Karataeva , S. L. Lyakhovich

Let $\{W_t\}_{t=1}^{\infty}$ be a finite state stationary Markov chain, and suppose that $f$ is a real-valued function on the state space. If $f$ is bounded, then Gillman's expander Chernoff bound (1993) provides concentration estimates for…

Probability · Mathematics 2019-06-19 Assaf Naor , Shravas Rao , Oded Regev

We consider the approximation of a convolution of possibly different probability measures by (compound) Poisson distributions and also by related signed measures of higher order. We present new total variation bounds having a better…

Probability · Mathematics 2017-03-08 Bero Roos

Let $\{X_n\}$ be a stationary and ergodic time series taking values from a finite or countably infinite set ${\cal X}$. Assume that the distribution of the process is otherwise unknown. We propose a sequence of stopping times $\lambda_n$…

Probability · Mathematics 2008-06-19 G. Morvai , B. Weiss

Vapnik--Chervonenkis' theorem is a seminal result in machine learning. It establishes sufficient conditions for empirical probabilities to converge to theoretical probabilities, uniformly over families of events. It also provides an…

Machine Learning · Computer Science 2026-01-26 A. Iosevich , A. Vagharshakyan , E. Wyman

Let $\{Y_i\}_{i=1}^{\infty}$ be a stationary reversible Markov chain with state space $[N]$, let $(X, \| \cdot \|)$ be a real-valued Banach space and let $f_1, \ldots, f_n: [N] \rightarrow X$ be functions with mean $0$ such that $\|f_i(v)\|…

Probability · Mathematics 2026-03-02 Shravas Rao

At any order, the perturbative expansion of the expectation values of Wilson lines in Chern-Simons theory gives certain integral expressions. We show that they all lead to knot invariants. Moreover these are finite type invariants whose…

q-alg · Mathematics 2009-10-30 Daniel Altschuler , Laurent Freidel

For a wide class of monotonic functions $f$, we develop a Chernoff-style concentration inequality for quadratic forms $Q_f \sim \sum\limits_{i=1}^n f(\eta_i) (Z_i + \delta_i)^2$, where $Z_i \sim N(0,1)$. The inequality is expressed in terms…

Statistics Theory · Mathematics 2019-11-14 Robert E. Gallagher , Louis J. M. Aslett , David Steinsaltz , Ryan R. Christ

In this paper we present the result of successively applying a Chebyshev polynomial to a continuous random variable. In particular we show that under mild assumptions the limiting distribution will be the same as the weight with respect to…

Numerical Analysis · Mathematics 2023-10-27 Javier Chico Vazquez , Andrew J. Horning

Limiting cases are studied of the Koornwinder-Macdonald multivariable generalization of the Askey-Wilson polynomials. We recover recently and not so recently introduced families of hypergeometric orthogonal polynomials in several variables…

q-alg · Mathematics 2010-09-28 Jan F. van Diejen

We present novel bounds for estimating discrete probability distributions under the $\ell_\infty$ norm. These are nearly optimal in various precise senses, including a kind of instance-optimality. Our data-dependent convergence guarantees…

Statistics Theory · Mathematics 2024-02-14 Aryeh Kontorovich , Amichai Painsky

In this paper, we develop a general approach for probabilistic estimation and optimization. An explicit formula and a computational approach are established for controlling the reliability of probabilistic estimation based on a mixed…

Statistics Theory · Mathematics 2012-12-06 Xinjia Chen

An alternative classification of the Pearson family of probability densities is related to the orthogonality of the corresponding Rodrigues polynomials. This leads to a subset of the ordinary Pearson system, the Integrated Pearson Family.…

Methodology · Statistics 2016-11-18 Giorgos Afendras , Nickos Papadatos