English
Related papers

Related papers: Concentration Inequalities from Likelihood Ratio M…

200 papers

Let $\mathbf{W}=(W_1,W_2,...,W_k)$ be a random vector with nonnegative coordinates having nonzero and finite variances. We prove concentration inequalities for $\mathbf{W}$ using size biased couplings that generalize the previous univariate…

Probability · Mathematics 2013-10-22 Subhankar Ghosh , Umit Islak

The purpose of this dissertation is to introduce a version of Stein's method of exchangeable pairs to solve problems in measure concentration. We specifically target systems of dependent random variables, since that is where the power of…

Probability · Mathematics 2016-03-09 Sourav Chatterjee

Concentration inequalities quantify the deviation of a random variable from a fixed value. In spite of numerous applications, such as opinion surveys or ecological counting procedures, few concentration results are known for the setting of…

Statistics Theory · Mathematics 2015-07-28 Rémi Bardenet , Odalric-Ambrym Maillard

In this paper, we propose a new approach for deriving probabilistic inequalities. Our main idea is to exploit the information of underlying distributions by virtue of the monotone likelihood ratio property and Berry-Essen inequality.…

Probability · Mathematics 2015-03-17 Xinjia Chen

Matrix concentration inequalities provide information about the probability that a random matrix is close to its expectation with respect to the $l_2$ operator norm. This paper uses semigroup methods to derive sharp nonlinear matrix…

Probability · Mathematics 2021-01-08 De Huang , Joel A. Tropp

We give a distribution-dependent concentration inequality for functions of independent variables. The result extends Bernstein's inequality from sums to more general functions, whose variation in any argument does not depend too much on the…

Probability · Mathematics 2017-05-12 Andreas Maurer

Random matrices now play a role in many parts of computational mathematics. To advance these applications, it is desirable to have tools that are flexible, easy to use, and powerful. Over the last 25 years, researchers have developed a…

Probability · Mathematics 2026-05-01 Joel A. Tropp

Concentration results and probabilistic analysis for combinatorial problems like the TSP, MWST, graph coloring have received much attention, but generally, for i.i.d. samples (i.i.d. points in the unit square for the TSP, for example).…

Probability · Mathematics 2010-05-24 Ravindran Kannan

We derive novel concentration inequalities that bound the statistical error for a large class of stochastic optimization problems, focusing on the case of unbounded objective functions. Our derivations utilize the following key tools: 1) A…

Machine Learning · Statistics 2026-01-01 Jeremiah Birrell

Concentration inequalities are indispensable tools for studying the generalization capacity of learning models. Hoeffding's and McDiarmid's inequalities are commonly used, giving bounds independent of the data distribution. Although this…

Machine Learning · Statistics 2017-02-21 Xinxing Wu , Junping Zhang

By using stochastic analysis, two probability versions of Li-Yau type inequalities are established for diffusion semigroups on a manifold possibly with (non-convex) boundary. The inequalities are explicitly given by the Bakry-Emery…

Probability · Mathematics 2024-11-07 Feng-Yu Wang , Li-Juan Cheng

Aleatoric uncertainty quantification seeks for distributional knowledge of random responses, which is important for reliability analysis and robustness improvement in machine learning applications. Previous research on aleatoric uncertainty…

Machine Learning · Computer Science 2022-06-10 Ziyi Huang , Henry Lam , Haofeng Zhang

We consider the stochastic integrals of multivariate point processes and study their concentration phenomena. In particular, we obtain a Bernstein type of concentration inequality through Dol\'eans-Dade exponential formula and a uniform…

Probability · Mathematics 2017-03-24 Hanchao Wang , Zhengyan Lin , Zhonggen Su

In many areas of engineering and sciences, decision rules and control strategies are usually designed based on nominal values of relevant system parameters. To ensure that a control strategy or decision rule will work properly when the…

Probability · Mathematics 2020-06-16 Xinjia Chen

The aim of this paper is to prove an improved version of the bounded differences inequality for matrix valued functions, by developing the methods of Mackey et al.: "Matrix Concentration Inequalities via the Method of Exchangeable Pairs".…

Probability · Mathematics 2013-02-20 Daniel Paulin

In this work, we will generalize the moment generating function to Riesz spaces. We will derive some of its properties and use it to prove concentration inequalities on Riesz spaces.

Functional Analysis · Mathematics 2020-11-10 Mohamed Amine Ben Amor , Amal Omrani

The sample correlation coefficient $R$ plays an important role in many statistical analyses. We study the moments of $R$ under the bivariate Gaussian model assumption, provide a novel approximation for its finite sample mean and connect it…

Statistics Theory · Mathematics 2024-01-23 Daniel Salnikov

A general method for obtaining moment inequalities for functions of independent random variables is presented. It is a generalization of the entropy method which has been used to derive concentration inequalities for such functions…

Probability · Mathematics 2007-05-23 Stephane Boucheron , Olivier Bousquet , Gabor Lugosi , Pascal Massart

New Vapnik and Chervonenkis type concentration inequalities are derived for the empirical distribution of an independent random sample. Focus is on the maximal deviation over classes of Borel sets within a low probability region. The…

Statistics Theory · Mathematics 2022-04-26 Stéphane Lhaut , Anne Sabourin , Johan Segers

Using the method of transportation-information inequality introduced in \cite{GLWY}, we establish Bernstein type's concentration inequalities for empirical means $\frac 1t \int_0^t g(X_s)ds$ where $g$ is a unbounded observable of the…

Probability · Mathematics 2010-02-11 Fuqing Gao , Arnaud Guillin , Liming Wu