English
Related papers

Related papers: On Bernstein Type Inequalities for Stochastic Inte…

200 papers

We develop novel empirical Bernstein inequalities for the variance of bounded random variables. Our inequalities hold under constant conditional variance and mean, without further assumptions like independence or identical distribution of…

Statistics Theory · Mathematics 2026-05-28 Diego Martinez-Taboada , Aaditya Ramdas

The aim of this paper is to establish Hoeffding and Bernstein type concentration inequalities for weighted sums of exchangeable random variables. A special case is the i.i.d. setting, where random variables are sampled independently from…

Statistics Theory · Mathematics 2025-08-11 Rina Foygel Barber

As an alternative to the well-known methods of "chaining" and "bracketing" that have been developed in the study of random fields, a new method, which is based on a {\em stochastic maximal inequality} derived by using the formula for…

Probability · Mathematics 2017-08-16 Yoichi Nishiyama

The paper is devoted to establishing some general exponential inequalities for supermartingales. The inequalities improve or generalize many exponential inequalities of Bennett, Freedman, de la Pe\~{n}a, Pinelis and van de Geer. Moreover,…

Probability · Mathematics 2015-01-22 Xiequan Fan , Ion Grama , Quansheng Liu

The concentration of measure phenomenon may be summarized as follows: a function of many weakly dependent random variables that is not too sensitive to any of its individual arguments will tend to take values very close to its expectation.…

Probability · Mathematics 2016-11-18 Aryeh Kontorovich , Maxim Raginsky

We present some extensions of Bernstein's concentration inequality for random matrices. This inequality has become a useful and powerful tool for many problems in statistics, signal processing and theoretical computer science. The main…

Probability · Mathematics 2017-04-18 Stanislav Minsker

We use the generic chaining device proposed by Talagrand to establish exponential bounds on the deviation probability of some suprema of random processes. Then, given a random vector $\xi$ in $\R^{n}$ the components of which are independent…

Statistics Theory · Mathematics 2009-04-22 Yannick Baraud

We consider the three dimensional array $\mathcal{A} = \{a_{i,j,k}\}_{1\le i,j,k \le n}$, with $a_{i,j,k} \in [0,1]$, and the two random statistics $T_{1}:= \sum_{i=1}^n \sum_{j=1}^n a_{i,j,\sigma(i)}$ and $T_{2}:= \sum_{i=1}^{n}…

Probability · Mathematics 2020-03-13 Debapratim Banerjee , Matteo Sordello

We obtain the tail probability of generalized sub-Gaussian canonical processes. It can be viewed as a variant of the Bernstein-type inequality in the i.i.d case, and we further get a tighter bound of concentration inequality through…

Probability · Mathematics 2024-02-02 Yiming Chen , Yuxuan Wang , Kefan Zhu

A generalization of the Bernstein matrix concentration inequality to random tensors of general order is proposed. This generalization is based on the use of Einstein products between tensors, from which a strong link can be established…

Statistics Theory · Mathematics 2021-05-31 Z. Luo , L. Qi , Ph. L. Toint

Self-normalized processes arise naturally in many learning-related tasks. While self-normalized concentration has been extensively studied for scalar-valued processes, there are few results for multidimensional processes outside of the…

Probability · Mathematics 2025-05-02 Justin Whitehouse , Zhiwei Steven Wu , Aaditya Ramdas

We are concerned with obtaining novel concentration inequalities for the missing mass, i.e. the total probability mass of the outcomes not observed in the sample. We not only derive - for the first time - distribution-free Bernstein-like…

Machine Learning · Statistics 2015-06-22 Bahman Yari Saeed Khanloo , Gholamreza Haffari

In this paper we obtain a Bernstein type inequality for the sum of self-adjoint centered and geometrically absolutely regular random matrices with bounded largest eigenvalue. This inequality can be viewed as an extension to the matrix…

Probability · Mathematics 2018-07-19 Marwa Banna , Florence Merlevède , Pierre Youssef

We consider solutions of stochastic differential equations which diverge to infinity as the time parameter goes to infinity. If the coefficients converge as the spacial variable goes to infinity, then the solutions will get close to some…

Probability · Mathematics 2024-11-14 Seiichiro Kusuoka , Yuichi Shiozawa

Let $\pa{X_{t}}_{t\in T}$ be a family of real-valued centered random variables indexed by a countable set $T$. In the first part of this paper, we establish exponential bounds for the deviation probabilities of the supremum $Z=\sup_{t\in…

Statistics Theory · Mathematics 2009-09-11 Yannick Baraud

We develop a new framework for deriving time-uniform concentration bounds for the output of stochastic sequential algorithms satisfying certain recursive inequalities akin to those defining the almost-supermartingale processes introduced by…

Statistics Theory · Mathematics 2025-11-25 Tuan Pham , Alessandro Rinaldo , Purnamrita Sarkar

We study the problem of parameter estimation for the homogenization limit of multiscale systems involving fractional dynamics. In the case of stochastic multiscale systems driven by Brownian motion, it has been shown that in order for the…

Statistics Theory · Mathematics 2025-05-14 Pablo Ramses Alonso-Martin , Horatio Boedihardjo , Anastasia Papavasiliou

We give concentration bounds for martingales that are uniform over finite times and extend classical Hoeffding and Bernstein inequalities. We also demonstrate our concentration bounds to be optimal with a matching anti-concentration…

Probability · Mathematics 2015-12-03 Akshay Balsubramani

We prove a new concentration inequality for U-statistics of order two for uniformly ergodic Markov chains. Working with bounded and $\pi$-canonical kernels, we show that we can recover the convergence rate of Arcones and Gin{\'e} who proved…

Probability · Mathematics 2022-03-21 Quentin Duchemin , Yohann de Castro , Claire Lacour

For a class of piecewise deterministic Markov processes we introduce a stochastic calculus which is a certain non-Gaussian counterpart to the classical Malliavin calculus. As an application we investigate the regularity of densities of…

Probability · Mathematics 2023-06-21 Jörg-Uwe Löbus