English
Related papers

Related papers: Concentration inequalities for dependent Random va…

200 papers

In this paper, we study the risk bounds for samples independently drawn from an infinitely divisible (ID) distribution. In particular, based on a martingale method, we develop two deviation inequalities for a sequence of random variables of…

Machine Learning · Statistics 2012-02-20 Chao Zhang , Dacheng Tao

The problem of missing mass in statistical inference (posed by McAllester and Ortiz, NIPS'02; most recently revisited by Changa and Thangaraj, ISIT'2019) seeks to estimate the weight of symbols that have not been sampled yet from a source.…

Probability · Mathematics 2020-01-15 Maciej Skorski

The concentration inequality approach for normal approximation by Stein's method is generalized to the multivariate setting. We use this approach to prove a non-smooth function distance for multivariate normal approximation for standardized…

Probability · Mathematics 2015-05-19 Louis H. Y. Chen , Xiao Fang

We investigate concentration properties of functions of random vectors with values in the discrete cube, satisfying the stochastic covering property (SCP) or the strong Rayleigh property (SRP). Our result for SCP measures include…

Probability · Mathematics 2021-08-31 Radosław Adamczak , Bartłomiej Polaczyk

We develop concentration inequalities for the $l_\infty$ norm of vector linear processes with sub-Weibull, mixingale innovations. This inequality is used to obtain a concentration bound for the maximum entrywise norm of the lag-$h$…

Statistics Theory · Mathematics 2024-10-18 Eduardo Fonseca Mendes , Fellipe Lopes

The first paper in this series introduced a new family of nonasymptotic matrix concentration inequalities that sharply capture the spectral properties of very general random matrices in terms of an associated noncommutative model. These…

Probability · Mathematics 2025-11-13 Afonso S. Bandeira , Giorgio Cipolloni , Dominik Schröder , Ramon van Handel

Azuma's inequality is a tool for proving concentration bounds on random variables. The inequality can be thought of as a natural generalization of additive Chernoff bounds. On the other hand, the analogous generalization of multiplicative…

Data Structures and Algorithms · Computer Science 2025-01-07 William Kuszmaul , Qi Qi

We illustrate a process that constructs martingales from raw material that arises naturally from the theory of sampling without replacement.The usefulness of the new martingales is illustrated by the development of maximal inequalities for…

Probability · Mathematics 2012-10-30 Vladimir Pozdnyakov , J. Michael Steele

In this paper, we investigate the concentration properties of cumulative reward in Markov Decision Processes (MDPs), focusing on both asymptotic and non-asymptotic settings. We introduce a unified approach to characterize reward…

Machine Learning · Computer Science 2025-12-04 Borna Sayedana , Peter E. Caines , Aditya Mahajan

We establish an Azuma type inequality under a Lipshitz condition for martingales in the framework of noncommutative probability spaces and apply it to deduce a noncommutative Heoffding inequality as well as a noncommutative McDiarmid type…

Operator Algebras · Mathematics 2021-07-23 Ghadir Sadeghi , Mohammad Sal Moslehian

Conditions on the generator of a Markov process to control the fluctuations of its bridges are found. In particular, continuous time random walks on graphs and gradient diffusions are considered. Under these conditions, a concentration of…

Probability · Mathematics 2016-03-08 Giovanni Conforti

We provide a systematic approach to deal with the following problem. Let $X_1,\ldots,X_n$ be, possibly dependent, $[0,1]$-valued random variables. What is a sharp upper bound on the probability that their sum is significantly larger than…

Probability · Mathematics 2015-07-27 Christos Pelekis , Jan Ramon

Uncertainty associated with statistical problems arises due to what has not been seen as opposed to what has been seen. Using probability to quantify the uncertainty the task is to construct a probability model for what has not been seen…

Methodology · Statistics 2025-01-06 Fuheng Cui , Stephen G. Walker

The slow processes of metastable stochastic dynamical systems are difficult to access by direct numerical simulation due the sampling problem. Here, we suggest an approach for modeling the slow parts of Markov processes by approximating the…

Mathematical Physics · Physics 2012-12-03 Frank Noé , Feliks Nüske

Causal inference methods based on conditional independence construct Markov equivalent graphs, and cannot be applied to bivariate cases. The approaches based on independence of cause and mechanism state, on the contrary, that causal…

Machine Learning · Computer Science 2021-08-04 Nataliya Sokolovska , Pierre-Henri Wuillemin

Concentration inequalities are indispensable tools for studying the generalization capacity of learning models. Hoeffding's and McDiarmid's inequalities are commonly used, giving bounds independent of the data distribution. Although this…

Machine Learning · Statistics 2017-02-21 Xinxing Wu , Junping Zhang

We present a class of inequality constraints on the set of distributions induced by local interventions on variables governed by a causal Bayesian network, in which some of the variables remain unmeasured. We derive bounds on causal effects…

Artificial Intelligence · Computer Science 2012-07-02 Changsung Kang , Jin Tian

Estimates are constructed for the deviation of the concentration functions of sums of independent random variables with finite variances from the folded normal distribution function without any assumptions concerning the existence of the…

Probability · Mathematics 2016-08-11 V. Yu. Korolev , A. V. Dorofeeva

This paper delves into stochastic optimization problems that involve Markovian noise. We present a unified approach for the theoretical analysis of first-order gradient methods for stochastic optimization and variational inequalities. Our…

Optimization and Control · Mathematics 2024-04-02 Aleksandr Beznosikov , Sergey Samsonov , Marina Sheshukova , Alexander Gasnikov , Alexey Naumov , Eric Moulines

In this article we present a Bernstein inequality for sums of random variables which are defined on a spatial lattice structure. The inequality can be used to derive concentration inequalities. It can be useful to obtain consistency…

Statistics Theory · Mathematics 2017-12-06 Eduardo Valenzuela-Domínguez , Johannes T. N. Krebs , Jürgen E. Franke