English
Related papers

Related papers: Time-Uniform Self-Normalized Concentration for Vec…

200 papers

Recent development in high-dimensional statistical inference has necessitated concentration inequalities for a broader range of random variables. We focus on sub-Weibull random variables, which extend sub-Gaussian or sub-exponential random…

Statistics Theory · Mathematics 2023-02-28 Heejong Bong , Arun Kumar Kuchibhotla

We obtain a Bernstein-type inequality for sums of Banach-valued random variables satisfying a weak dependence assumption of general type and under certain smoothness assumptions of the underlying Banach norm. We use this inequality in order…

Machine Learning · Statistics 2018-12-11 Gilles Blanchard , Oleksandr Zadorozhnyi

We give a distribution-dependent concentration inequality for functions of independent variables. The result extends Bernstein's inequality from sums to more general functions, whose variation in any argument does not depend too much on the…

Probability · Mathematics 2017-05-12 Andreas Maurer

Constant-specified and exponential concentration inequalities play an essential role in the finite-sample theory of machine learning and high-dimensional statistics area. We obtain sharper and constants-specified concentration inequalities…

Statistics Theory · Mathematics 2022-07-04 Huiming Zhang , Haoyu Wei

Many fundamental machine learning tasks can be formulated as a problem of learning with vector-valued functions, where we learn multiple scalar-valued functions together. Although there is some generalization analysis on different specific…

Machine Learning · Computer Science 2021-04-30 Liang Wu , Antoine Ledent , Yunwen Lei , Marius Kloft

We present some extensions of Bernstein's concentration inequality for random matrices. This inequality has become a useful and powerful tool for many problems in statistics, signal processing and theoretical computer science. The main…

Probability · Mathematics 2017-04-18 Stanislav Minsker

We derive in this article the exact non-asymptotical exponential and power estimates for self-normalized sums of centered independent random variables (r.v.) under natural norming. We will use also the theory of the so-called Grand Lebesgue…

Probability · Mathematics 2018-09-25 E. Ostrovsky , L. Sirota

Concentration inequalities, a major tool in probability theory, quantify how much a random variable deviates from a certain quantity. This paper proposes a systematic convex optimization approach to studying and generating concentration…

Probability · Mathematics 2024-08-30 Celine Moucer , Adrien Taylor , Francis Bach

Initially motivated by the study of the non-asymptotic properties of non-parametric tests based on permutation methods, concentration inequalities for uniformly permuted sums have been largely studied in the literature. Recently, Delyon et…

Probability · Mathematics 2018-05-10 Mélisande Albert

We give Hoeffding and Bernstein-type concentration inequalities for the largest eigenvalue of sums of random matrices arising from a Markov chain. We consider time-dependent matrix-valued functions on a general state space, generalizing…

Probability · Mathematics 2025-07-01 Joe Neeman , Bobby Shi , Rachel Ward

In recent years, tensors have been applied to different applications in science and engineering fields. In order to establish theory about tail bounds of the tensors summation behavior, this work extends previous work by considering the…

Probability · Mathematics 2021-10-05 Shih Yu Chang

In this note, we establish a compact law of the iterated logarithm under the upper capacity for independent and identically distributed random variables in a sub-linear expectation space. For showing the result, a self-normalized law of the…

Probability · Mathematics 2022-02-28 Li-Xin Zhang

We obtain a Bernstein type Gaussian concentration inequality for martingales. Our inequality improves the Azuma-Hoeffding inequality for moderate deviations $x$. Following the work of McDiarmid (1989), Talagrand (1996) and Boucheron, Lugosi…

Probability · Mathematics 2017-10-17 Xiequan Fan

While effective concentration inequalities for suprema of empirical processes exist under boundedness or strict tail assumptions, no comparable results have been available under considerably weaker assumptions. In this paper, we derive…

Probability · Mathematics 2014-10-23 Johannes Lederer , Sara van de Geer

In this paper, we study the learning rate of generalized Bayes estimators in a general setting where the hypothesis class can be uncountable and have an irregular shape, the loss function can have heavy tails, and the optimal hypothesis may…

Statistics Theory · Mathematics 2021-11-22 Lam Si Tung Ho , Binh T. Nguyen , Vu Dinh , Duy Nguyen

We introduce a dimension-free Bernstein-type tail inequality for self-normalised martingales, where the normalisation uses the predictable quadratic variation and the radius depends on the information gain of the observed covariance. As…

Probability · Mathematics 2026-05-19 Arya Akhavan , Amitis Shidani , Alex Ayoub , David Janz

We present a new PAC-Bayesian generalization bound. Standard bounds contain a $\sqrt{L_n \cdot \KL/n}$ complexity term which dominates unless $L_n$, the empirical error of the learning algorithm's randomized predictions, vanishes. We manage…

Machine Learning · Computer Science 2021-12-16 Zakaria Mhammedi , Peter D. Grunwald , Benjamin Guedj

We obtain an uniform tail estimates for natural normed sums of independent random variables (r.v.) with regular varying tails of distributions. We give also many examples on order to show the exactness of offered estimates and discuss some…

Probability · Mathematics 2012-06-22 E. Ostrovsky , L. Sirota

Building on the inequalities for homogeneous tetrahedral polynomials in independent Gaussian variables due to R. Lata{\l}a we provide a concentration inequality for non-necessarily Lipschitz functions $f\colon \R^n \to \R$ with bounded…

Probability · Mathematics 2013-04-09 Radosław Adamczak , Paweł Wolff

The sub-linear expectation or called G-expectation is a nonlinear expectation having advantage of modeling non-additive probability problems and the volatility uncertainty in finance. Let $\{X_n;n\ge 1\}$ be a sequence of independent random…

Probability · Mathematics 2016-08-03 Li-Xin Zhang