English
Related papers

Related papers: Revisiting Concentration of Missing Mass

200 papers

We are concerned with obtaining novel concentration inequalities for the missing mass, i.e. the total probability mass of the outcomes not observed in the sample. We not only derive - for the first time - distribution-free Bernstein-like…

Machine Learning · Statistics 2015-06-22 Bahman Yari Saeed Khanloo , Gholamreza Haffari

Novel concentration inequalities are obtained for the missing mass, i.e. the total probability mass of the outcomes not observed in the sample. We derive distribution-free deviation bounds with sublinear exponents in deviation size for…

Machine Learning · Statistics 2015-12-02 Bahman Yari Saeed Khanloo

In this note, we improve some concentration inequalities for martingales with bounded increments. These results recover the missing factor in Freedman-style inequalities and are near optimal. We also provide minor refinements of…

Probability · Mathematics 2024-12-31 Arun Kumar Kuchibhotla

Initially motivated by the study of the non-asymptotic properties of non-parametric tests based on permutation methods, concentration inequalities for uniformly permuted sums have been largely studied in the literature. Recently, Delyon et…

Probability · Mathematics 2018-05-10 Mélisande Albert

We study the estimation and concentration on its expectation of the probability to observe data further than a specified distance from a given iid sample in a metric space. The problem extends the classical problem of estimation of the…

Statistics Theory · Mathematics 2022-11-23 Andreas Maurer

We show that the mixing times of random walks on compact groups can be used to obtain concentration inequalities for the respective Haar measures. As an application, we derive a concentration inequality for the empirical distribution of…

Probability · Mathematics 2007-05-23 Sourav Chatterjee

We prove a general inequality for mixed Hessian measures by global arguments. Our method also yields a simplification for the case of complex Monge-Amp\`ere equation. Exploiting this and using Ko{\l}odziej's mass concentration technique we…

Complex Variables · Mathematics 2014-04-25 Sławomir Dinew , Chinh H. Lu

In this paper, we are concerned with obtaining distribution-free concentration inequalities for mixture of independent Bernoulli variables that incorporate a notion of variance. Missing mass is the total probability mass associated to the…

Machine Learning · Statistics 2015-03-05 Bahman Yari Saeed Khanloo

The missing mass refers to the probability of elements not observed in a sample, and since the work of Good and Turing during WWII, has been studied extensively in many areas including ecology, linguistic, networks and information theory.…

Information Theory · Computer Science 2021-04-16 Maciej Skorski

The martingale method is used to establish concentration inequalities for a class of dependent random sequences on a countable state space, with the constants in the inequalities expressed in terms of certain mixing coefficients. Along the…

Probability · Mathematics 2009-01-22 Leonid , Kontorovich , Kavita Ramanan

We give concentration bounds for martingales that are uniform over finite times and extend classical Hoeffding and Bernstein inequalities. We also demonstrate our concentration bounds to be optimal with a matching anti-concentration…

Probability · Mathematics 2015-12-03 Akshay Balsubramani

Estimating the underlying distribution from \textit{iid} samples is a classical and important problem in statistics. When the alphabet size is large compared to number of samples, a portion of the distribution is highly likely to be…

Statistics Theory · Mathematics 2023-05-30 Prafulla Chandra , Andrew Thangaraj

We prove concentration inequalities for functions of independent random variables {under} sub-gaussian and sub-exponential conditions. The utility of the inequalities is demonstrated by an extension of the now classical method of Rademacher…

Probability · Mathematics 2021-06-24 Andreas Maurer , Massimiliano Pontil

We explore the applications of our previously established likelihood-ratio method for deriving concentration inequalities for a wide variety of univariate and multivariate distributions. New concentration inequalities for various…

Statistics Theory · Mathematics 2014-09-23 Xinjia Chen

Halo masses and concentrations have been studied extensively, by means of N-body simulations as well as observationally, during the last decade. Nevertheless, the exact form of the mass-concentration relation is still widely debated. One of…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-18 Roberto Mainini , Anna Romano

We propose new concentration inequalities for self-normalized martingales. The main idea is to introduce a suitable weighted sum of the predictable quadratic variation and the total quadratic variation of the martingale. It offers much more…

Probability · Mathematics 2019-06-17 Bernard Bercu , Taieb Touati

We give a concentration inequality based on the premise that random variables take values within a particular region. The concentration inequality guarantees that, for any sequence of correlated random variables, the difference between the…

Probability · Mathematics 2020-02-21 Go Kato

Concentration inequalities quantify the deviation of a random variable from a fixed value. In spite of numerous applications, such as opinion surveys or ecological counting procedures, few concentration results are known for the setting of…

Statistics Theory · Mathematics 2015-07-28 Rémi Bardenet , Odalric-Ambrym Maillard

This paper gives a review of concentration inequalities which are widely employed in non-asymptotical analyses of mathematical statistics in a wide range of settings, from distribution-free to distribution-dependent, from sub-Gaussian to…

Statistics Theory · Mathematics 2025-02-24 Huiming Zhang , Song Xi Chen

The concentration of measure phenomenon may be summarized as follows: a function of many weakly dependent random variables that is not too sensitive to any of its individual arguments will tend to take values very close to its expectation.…

Probability · Mathematics 2016-11-18 Aryeh Kontorovich , Maxim Raginsky
‹ Prev 1 2 3 10 Next ›