English
Related papers

Related papers: Fano's inequality for random variables

200 papers

Let $\left\{ S_{n},n\geq 0\right\} $ be a random walk whose increment distribution belongs without centering to the domain of attraction of an $% \alpha $-stable law, i.e., there are some scaling constants $a_{n}$ such that the sequence…

Probability · Mathematics 2023-12-19 Congzao Dong , Elena Dyakonova , Vladimir Vatutin

The main purpose of this paper is to establish a noncommutative analogue of the Efron--Stein inequality, which bounds the variance of a general function of some independent random variables. Moreover, we state an operator version including…

Functional Analysis · Mathematics 2021-07-23 Ali Talebi , Mohammad Sal Moslehian

We give the proof of a tight lower bound on the probability that a binomial random variable exceeds its expected value. The inequality plays an important role in a variety of contexts, including the analysis of relative deviation bounds in…

Machine Learning · Computer Science 2013-11-12 Spencer Greenberg , Mehryar Mohri

We prove semi-empirical concentration inequalities for random variables which are given as possibly nonlinear functions of independent random variables. These inequalities describe concentration of random variable in terms of the…

Machine Learning · Computer Science 2020-02-04 Ilja Kuzborskij , Csaba Szepesvári

This paper extends classical probabilistic results to the broader class of demimartingales and demisubmartingales. We establish variants of Doob's-type optional sampling theorem under minimal structural conditions on stopping times, relying…

Probability · Mathematics 2025-07-24 Milto Hadjikyriakou , B. L. S Prakasa Rao

Upper and lower bounds are obtained for the joint entropy of a collection of random variables in terms of an arbitrary collection of subset joint entropies. These inequalities generalize Shannon's chain rule for entropy as well as…

Information Theory · Computer Science 2024-05-07 Mokshay Madiman , Prasad Tetali

In Bayesian statistics, improper distributions and finitely additive probabilities (FAPs) are the two main alternatives to proper distributions, i.e. countably additive probabilities. Both of them can be seen as limits of proper…

Statistics Theory · Mathematics 2023-06-21 Erwan Saint Loubert Bié , Pierre Druilhet , Erwan Saint , Loubert Bié

Concentration inequalities quantify the deviation of a random variable from a fixed value. In spite of numerous applications, such as opinion surveys or ecological counting procedures, few concentration results are known for the setting of…

Statistics Theory · Mathematics 2015-07-28 Rémi Bardenet , Odalric-Ambrym Maillard

In this paper we provide a probabilistic representation of Lagrange's identity which we use to obtain Papathanasiou-type variance expansions of arbitrary order. Our expansions lead to generalized sequences of weights which depend on an…

Probability · Mathematics 2019-06-21 Marie Ernst , Gesine Reinert , Yvik Swan

We prove extensions of classical concentration inequalities for random variables which have $\alpha$-subexponential tail decay for any $\alpha \in (0,2]$. This includes Hanson--Wright type and convex concentration inequalities. We also…

Probability · Mathematics 2022-12-09 Holger Sambale

We investigate Fano schemes of conditionally generic intersections, i.e. of hypersurfaces in projective space chosen generically up to additional conditions. Via a correspondence between generic properties of algebraic varieties and events…

Algebraic Geometry · Mathematics 2013-01-15 Franz Király , Paul Larsen

This paper gives a review of concentration inequalities which are widely employed in non-asymptotical analyses of mathematical statistics in a wide range of settings, from distribution-free to distribution-dependent, from sub-Gaussian to…

Statistics Theory · Mathematics 2025-02-24 Huiming Zhang , Song Xi Chen

We establish bounds for the covariance of a large class of functions of infinite variance stable random variables, including unbounded functions such as the power function and the logarithm. These bounds involve measures of dependence…

Statistics Theory · Mathematics 2011-11-10 Vladas Pipiras , Murad S. Taqqu , Patrice Abry

Given an observed random variable, consider the problem of recovering its distribution among a family of candidate ones. The two-point inequality, Fano's lemma and more recently an inequality due to Venkataramanan and Johnson (2018) allow…

Statistics Theory · Mathematics 2018-07-17 Yannick Baraud

Using coupling techniques based on Stein's method for probability approximation, we revisit classical variance bounding inequalities of Chernoff, Cacoullos, Chen and Klaassen. Taking advantage of modern coupling techniques allows us to…

Probability · Mathematics 2019-11-11 Fraser Daly , Fatemeh Ghaderinezhad , Christophe Ley , Yvik Swan

We consider the problem of choosing design parameters to minimize the probability of an undesired rare event that is described through the average of $n$ iid random variables. Since the probability of interest for near optimal design…

Optimization and Control · Mathematics 2019-02-22 Amarjit Budhiraja , Shu Lu , Yang Yu , Quoc Tran-Dinh

The processes of the averaged regression quantiles and of their modifications provide useful tools in the regression models when the covariates are not fully under our control. As an application we mention the probabilistic risk assessment…

Statistics Theory · Mathematics 2017-10-19 Jana Jurečková , Martin Schindler , Jan Picek

In this paper we extend the work of Owen (2007) by deriving a second order expansion for the slope parameter in logistic regression, when the size of the majority class is unbounded and the minority class is finite. More precisely, we…

Statistics Theory · Mathematics 2022-04-29 Dorian Goldman , Bo Zhang

We derive new upper and lower bounds for probabilities that $r$ or at least $r$ from $n$ events occur. These bounds can turn to equalities. The method is discussed as well. It works for measurable space and measures with sign, too. We also…

Probability · Mathematics 2020-08-12 Andrei N. Frolov

Some probabilistic aspects of the number variance statistic are investigated. Infinite systems of independent Brownian motions and symmetric alpha-stable processes are used to construct new examples of processes which exhibit both divergent…

Probability · Mathematics 2007-05-23 Ben Hambly , Liza Jones