English
Related papers

Related papers: On the Bernstein-Hoeffding method

200 papers

Li and Hu recently established variance-type O(1/n) bounds for the sample mean of independent random vectors under sublinear expectations. We extend their results to the exponential concentration regime. For bounded, independent R^d-valued…

Statistics Theory · Mathematics 2026-02-26 Nahom Seyoum

The speed with which a learning algorithm converges as it is presented with more data is a central problem in machine learning --- a fast rate of convergence means less data is needed for the same level of performance. The pursuit of fast…

Machine Learning · Computer Science 2021-08-31 Tim van Erven , Peter D. Grünwald , Nishant A. Mehta , Mark D. Reid , Robert C. Williamson

In this paper, we establish moment and Bernstein-type inequalities for additive functionals of geometrically ergodic Markov chains. These inequalities extend the corresponding inequalities for independent random variables. Our conditions…

Probability · Mathematics 2023-06-16 Alain Durmus , Eric Moulines , Alexey Naumov , Sergey Samsonov

We analyze the assumptions that are made in the proofs of Bell-type inequalities for the results of Einstein-Podolsky-Rosen type of experiments. We find that the introduction of time-like random variables permits the construction of a…

Quantum Physics · Physics 2007-05-23 Karl Hess , Walter Philipp

Sums of independent, bounded random variables concentrate around their expectation approximately as well a Gaussian of the same variance. Well known results of this form include the Bernstein, Hoeffding, and Chernoff inequalities and many…

Discrete Mathematics · Computer Science 2017-04-25 Thomas Steinke , Jonathan Ullman

We introduce a framework to derive quantitative central limit theorems in the context of non-linear approximation of Gaussian random variables taking values in a separable Hilbert space. In particular, our method provides an alternative to…

Probability · Mathematics 2020-11-25 Solesne Bourguin , Simon Campese

The more then hundred years old Bernstein inequality states that the supremum norm of the derivative of a trigonometric polynomial of fixed degree can be bounded from above by supremum norm of the polynomial itself. The reversed Bernstein…

Classical Analysis and ODEs · Mathematics 2023-03-09 Parvaneh Joharinad , Jürgen Jost , Sunhyuk Lim , Rostislav Matveev

Historically, to bound the mean for small sample sizes, practitioners have had to choose between using methods with unrealistic assumptions about the unknown distribution (e.g., Gaussianity) and methods like Hoeffding's inequality that use…

Statistics Theory · Mathematics 2021-10-27 My Phan , Philip S. Thomas , Erik Learned-Miller

We prove concentration inequalities of the form $P(Y \ge t) \le \exp(-B(t))$ for a random variable $Y$ with mean zero and variance $\sigma^2$ using a coupling technique from Stein's method that is so-called approximate zero bias couplings.…

Probability · Mathematics 2025-12-24 Nathakhun Wiroonsri

We provide an inequality which is a useful tool in studying both large deviation results and limit theorems for sums of random fields with "negligible" small values. In particular, the inequality covers cases of stable limits for random…

Probability · Mathematics 2017-09-06 Adam Jakubowski , Jan Rosiński

We use a new method via $p$-Wasserstein bounds to prove Cram\'er-type moderate deviations in (multivariate) normal approximations. In the classical setting that $W$ is a standardized sum of $n$ independent and identically distributed…

Probability · Mathematics 2022-05-27 Xiao Fang , Yuta Koike

We present a new PAC-Bayesian generalization bound. Standard bounds contain a $\sqrt{L_n \cdot \KL/n}$ complexity term which dominates unless $L_n$, the empirical error of the learning algorithm's randomized predictions, vanishes. We manage…

Machine Learning · Computer Science 2021-12-16 Zakaria Mhammedi , Peter D. Grunwald , Benjamin Guedj

In this article we study generalization of the classical Talagrand transport-entropy inequality in which the Wasserstein distance is replaced by the entropic transportation cost. This class of inequalities has been introduced in the recent…

Probability · Mathematics 2019-07-02 Giovanni Conforti , Luigia Ripani

Let $S_N$ be the sum of vector-valued functions defined on a finite Markov chain. An analogue of the Bernstein--Hoeffding inequality is derived for the probability of large deviations of $S_N$ and relates the probability to the spectral gap…

Probability · Mathematics 2009-09-29 Vladislav Kargin

For a real-valued measurable function $f$ and a nonnegative, nondecreasing function $\phi$, we first obtain a Chebyshev type inequality which provides an upper bound for $\displaystyle \phi(\lambda_{1}) \mu(\{x \in \Omega : f(x) \geq…

Functional Analysis · Mathematics 2022-09-14 M. Ashraf Bhat , G. Sankara Raju Kosuru

In this paper, we study semiparametric inference for linear multivariate Hawkes processes, a class of point processes widely used to describe self and mutually exciting phenomena. We establish a convolution theorem giving the best limiting…

Statistics Theory · Mathematics 2026-03-26 Mael Duverger , Judith Rousseau

The Robbins-Siegmund theorem is one of the most important results in stochastic optimization, where it is widely used to prove the convergence of stochastic algorithms. We provide a quantitative version of the theorem, establishing a bound…

Optimization and Control · Mathematics 2025-09-30 Morenikeji Neri , Thomas Powell

We give some estimates of the remainder terms for several conformally-invariant Sobolev-type inequalities on the Heisenberg group, in analogy with the Euclidean case. By considering the variation of associated functionals, we give a…

Analysis of PDEs · Mathematics 2016-01-20 Heping Liu , An Zhang

We provide a Lyapunov type bound in the multivariate central limit theorem for sums of independent, but not necessarily identically distributed random vectors. The error in the normal approximation is estimated for certain classes of sets,…

Probability · Mathematics 2019-07-24 Martin Raič

The dynamics of one parameter diagonal group actions on finite volume homogeneous spaces has a partially hyperbolic feature. In this paper we extend the Liv\v{s}ic type result to these possibly noncompact and nonaccessible systems. We also…

Dynamical Systems · Mathematics 2019-03-27 Ronggang Shi