English
Related papers

Related papers: Concentration functions and entropy bounds for dis…

200 papers

Two--sided bounds are constructed for a probability density function of a weighted sum of chi-square variables. Both cases of central and non-central chi-square variables are considered. The upper and lower bounds have the same dependence…

Probability · Mathematics 2020-12-22 Sergey G. Bobkov , Alexey A. Naumov , Vladimir V. Ulyanov

We develop a new technique for proving distribution testing lower bounds for properties defined by inequalities involving the bin probabilities of the distribution in question. Using this technique we obtain new lower bounds for…

Machine Learning · Computer Science 2023-08-02 Yuqian Cheng , Daniel M. Kane , Zhicheng Zheng

A new sharp inequality featuring the differential R\'enyi entropy, the R\'enyi divergence and the R\'enyi cross-entropy of a pair of probability density functions is established. The equality is reached when one of the probability density…

Information Theory · Computer Science 2026-03-10 Razvan Gabriel Iagar , David Puertas-Centeno

Using a sharp version of the reverse Young inequality, and a R\'enyi entropy comparison result due to Fradelizi, Madiman, and Wang, the authors are able to derive R\'enyi entropy power inequalities for log-concave random vectors when…

Information Theory · Computer Science 2018-07-24 Arnaud Marsiglietti , James Melbourne

We show sharpened forms of the concentration of measure phenomenon centered at first order stochastic expansions. The bound are based on second order difference operators and second order derivatives. Applications to functions on the…

Probability · Mathematics 2019-11-22 Friedrich Götze , Holger Sambale

We establish sharp exponential deviation estimates of the information content as well as a sharp bound on the varentropy for the class of convex measures on Euclidean spaces. This generalizes a similar development for log-concave measures…

Probability · Mathematics 2020-02-25 Matthieu Fradelizi , Jiange Li , Mokshay Madiman

Since their introduction in the early sixties, the R\'enyi entropies have been used in many contexts, ranging from information theory to astrophysics, turbulence phenomena and others. In this note, we enlighten the main connections between…

Mathematical Physics · Physics 2014-01-20 Giuseppe Toscani

We show that for any $\alpha>0$ the R\'enyi entropy of order $\alpha$ is minimized, among all symmetric log-concave random variables with fixed variance, either for a uniform distribution or for a two sided exponential distribution. The…

Information Theory · Computer Science 2021-10-05 Maciej Białobrzeski , Piotr Nayar

We establish two-sided bounds for expectations of order statistics ($k$-th maxima) of moduli of coordinates of centered log-concave random vectors with uncorrelated coordinates. Our bounds are exact up to multiplicative universal constants…

Probability · Mathematics 2020-10-27 Rafał Latała , Marta Strzelecka

Entanglement R\'enyi-$\alpha$ entropy is an entanglement measure. It generalizes the entanglement of formation, and they coincide when $\alpha$ tends to 1. We derive analytical lower and upper bounds for the entanglement R\'enyi-$\alpha$…

Quantum Physics · Physics 2017-03-07 Wei Song , Lin Chen , Zhuo-Liang Cao

We demonstrate a simple analytic argument that may be used to bound the Levy concentration function of a sum of independent random variables. The main application is a version of a recent inequality due to Rudelson and Vershynin, and its…

Probability · Mathematics 2007-11-21 Omer Friedland , Sasha Sodin

The paper deals with studying a connection of the Littlewood--Offord problem with estimating the concentration functions of some symmetric infinitely divisible distributions.

Probability · Mathematics 2022-11-15 Friedrich Götze , Andrei Yu. Zaitsev

We investigate the role of convexity in R\'enyi entropy power inequalities. After proving that a general R\'enyi entropy power inequality in the style of Bobkov-Chistyakov (2015) fails when the R\'enyi parameter $r\in(0,1)$, we show that…

Probability · Mathematics 2019-09-30 Jiange Li , Arnaud Marsiglietti , James Melbourne

This work explores properties of Strong Data-Processing constants for R\'enyi Divergences. Parallels are made with the well-studied $\varphi$-Divergences, and it is shown that the order $\alpha$ of R\'enyi Divergences dictates whether…

Information Theory · Computer Science 2026-01-15 Adrien Vandenbroucque , Amedeo Roberto Esposito , Michael Gastpar

Many axiomatic definitions of entropy, such as the R\'enyi entropy, of a random variable are closely related to the $\ell_{\alpha}$-norm of its probability distribution. This study considers probability distributions on finite sets, and…

Information Theory · Computer Science 2016-05-06 Yuta Sakai , Ken-ichi Iwata

The paper deals with studying a connection of the Littlewood--Offord problem with estimating the concentration functions of some symmetric infinitely divisible distributions. It is shown that the values at zero of the concentration…

Probability · Mathematics 2022-08-04 Andrei Yu. Zaitsev

We obtain two-sided bounds for the density of stochastic processes satisfying a weak H\"ormander condition. In particular we consider the cases when the support of the density is not the whole space and when the density has various…

Probability · Mathematics 2012-12-14 Chiara Cinti , Stephane Menozzi , Sergio Polidoro

A novel, non-trivial, probabilistic upper bound on the entropy of an unknown one-dimensional distribution, given the support of the distribution and a sample from that distribution, is presented. No knowledge beyond the support of the…

Information Theory · Computer Science 2007-07-13 Joseph DeStefano , Erik Learned-Miller

Viewing a two time scale stochastic approximation scheme as a noisy discretization of a singularly perturbed differential equation, we obtain a concentration bound for its iterates that captures its behavior with quantifiable high…

Optimization and Control · Mathematics 2018-06-29 Vivek S. Borkar , Sarath Pattathil

This paper concerns the concentration of Dirichlet eigenfunctions of the Laplacian on a compact two-dimensional Riemannian manifold with strictly geodesically concave boundary. We link three inequalities which bound the concentration in…

Analysis of PDEs · Mathematics 2011-11-01 Sinan Ariturk