English
Related papers

Related papers: Optimal Concentration of Information Content For L…

200 papers

We utilize a discrete version of the notion of degree of freedom to prove a sharp min-entropy-variance inequality for integer valued log-concave random variables. More specifically, we show that the geometric distribution minimizes the…

Probability · Mathematics 2023-09-08 Heshan Aravinda

We prove, using optimal transport tools, weighted Poincar'e inequalities for log-concave random vectors satisfying some centering conditions. We recover by this way similar results by Klartag and Barthe-Cordero-Erausquin for log-concave…

Probability · Mathematics 2014-07-14 Dario Cordero-Erausquin , Nathael Gozlan

We prove a pointwise version of the multi-dimensional central limit theorem for convex bodies. Namely, let X be an isotropic random vector in R^n with a log-concave density. For a typical subspace E in R^n of dimension n^c, consider the…

Metric Geometry · Mathematics 2007-08-21 Ronen Eldan , Bo'az Klartag

This paper provides an extensive study of the behavior of the best achievable rate (and other related fundamental limits) in variable-length lossless compression. In the non-asymptotic regime, the fundamental limits of fixed-to-variable…

Information Theory · Computer Science 2012-12-13 Ioannis Kontoyiannis , Sergio Verdu

We show a general phenomenon of the constrained functional value for densities satisfying general convexity conditions, which generalizes the observation in Bobkov and Madiman (2011) that the entropy per coordinate in a log-concave random…

Information Theory · Computer Science 2020-10-27 Yanjun Han

Let $C$ and $K$ be centrally symmetric convex bodies of volume $1$ in ${\mathbb R}^n$. We provide upper bounds for the multi-integral expression \begin{equation*}\|{\bf…

Metric Geometry · Mathematics 2019-06-11 Giorgos Chasapis , Apostolos Giannopoulos , Nikos Skarmogiannis

We propose a method for estimating a log-concave density on $\mathbb R^d$ from samples, under the assumption that there exists an orthogonal transformation that makes the components of the random vector independent. While log-concave…

Statistics Theory · Mathematics 2024-12-20 Sharvaj Kubal , Christian Campbell , Elina Robeva

We consider the central limit theorem for stable laws in the case of the standardized sum of independent and identically distributed random variables with regular probability density function. By showing decay of different entropy…

Probability · Mathematics 2016-10-12 Giuseppe Toscani

We study nonparametric maximum likelihood estimation of a log-concave probability density and its distribution and hazard function. Some general properties of these estimators are derived from two characterizations. It is shown that the…

Statistics Theory · Mathematics 2023-04-17 Lutz Duembgen , Kaspar Rufibach

We prove an exponential decay concentration inequality to bound the tail probability of the difference between the log-likelihood of discrete random variables on a finite alphabet and the negative entropy. The concentration bound we derive…

Probability · Mathematics 2021-06-23 Yunpeng Zhao

We establish a discrete analog of the R\'enyi entropy comparison due to Bobkov and Madiman. For log-concave variables on the integers, the min entropy is within log e of the usual Shannon entropy. Additionally we investigate the entropic…

Probability · Mathematics 2021-06-01 James Melbourne , Tomasz Tkocz

Threshold-type counts based on multivariate occupancy models with log concave marginals admit bounded size biased couplings under weak conditions, leading to new concentration of measure results for random graphs, germ-grain models in…

Probability · Mathematics 2017-05-25 Jay Bartroff , Larry Goldstein , Ümit Işlak

We provide a sharp rate of convergence in the central limit theorem for random vectors with an unconditional, log-concave density. The argument relies on analysis of the Neumann laplacian on convex domains and on the theory of optimal…

Probability · Mathematics 2008-05-01 Bo'az Klartag

We show that for log-concave real random variables with fixed variance the Shannon differential entropy is minimized for an exponential random variable. We apply this result to derive upper bounds on capacities of additive noise channels…

Probability · Mathematics 2024-03-19 James Melbourne , Piotr Nayar , Cyril Roberto

For sampling from a log-concave density, we study implicit integrators resulting from $\theta$-method discretization of the overdamped Langevin diffusion stochastic differential equation. Theoretical and algorithmic properties of the…

Machine Learning · Statistics 2021-07-13 Liam Hodgkinson , Robert Salomone , Fred Roosta

In this paper, we provide explicit lower bounds with respect to some quantities of interest (parameters of the underlying distribution, dimension, geometrical characteristics of the domain, position of the origin, etc.) on the spectral gap…

Functional Analysis · Mathematics 2024-03-27 Michel Bonnefont , Aldéric Joulin

We investigate the equilibrium behavior for the decentralized cheap talk problem for real random variables and quadratic cost criteria in which an encoder and a decoder have misaligned objective functions. In prior work, it has been shown…

Information Theory · Computer Science 2021-11-16 Ertan Kazıklı , Serkan Sarıtaş , Sinan Gezici , Tamás Linder , Serdar Yüksel

A lower bound on the probability $P(0<X<\delta)$ for all real $\delta>0$ and all random variables $X$ with log-concave p.d.f.'s such that $EX=0$ and $EX^2=1$ is obtained.

Probability · Mathematics 2026-02-09 Iosif Pinelis

We prove sharp anti-concentration results for log-concave random variables on the real line in both the discrete and continuous setting. Our approach is elementary and uses majorization techniques to recover and extend some recent and not…

Probability · Mathematics 2025-05-12 Tulio Gaxiola , James Melbourne , Vincent Pigno , Emma Pollard

Maximum likelihood estimation of a log-concave probability density is formulated as a convex optimization problem and shown to have an equivalent dual formulation as a constrained maximum Shannon entropy problem. Closely related maximum…

Methodology · Statistics 2010-11-16 Roger Koenker , Ivan Mizera