English
Related papers

Related papers: The entropy per coordinate of a random vector is h…

200 papers

Bi-log-concavity of probability measures is a univariate extension of the notion of log-concavity that has been recently proposed in a statistical literature. Among other things, it has the nice property from a modelisation perspective to…

Probability · Mathematics 2019-03-20 Adrien Saumard

We study the problem of reconstructing a convex body using only a finite number of measurements of outer normal vectors. More precisely, we suppose that the normal vectors are measured at independent random locations uniformly distributed…

Computational Geometry · Computer Science 2014-02-21 Hiba Abdallah , Quentin Mérigot

Minimization of the (regularized) entropy of classification probabilities is a versatile class of discriminative clustering methods. The classification probabilities are usually defined through the use of some classical losses from…

Statistics Theory · Mathematics 2021-12-17 Edouard Genetay , Adrien Saumard , Rémi Coulaud

In this paper, we study two problems: (1) estimation of a $d$-dimensional log-concave distribution and (2) bounded multivariate convex regression with random design with an underlying log-concave density or a compactly supported…

Statistics Theory · Mathematics 2020-02-21 Gil Kur , Yuval Dagan , Alexander Rakhlin

We develop an information-theoretic perspective on some questions in convex geometry, providing for instance a new equipartition property for log-concave probability measures, some Gaussian comparison results for log-concave measures, an…

Functional Analysis · Mathematics 2011-03-31 Sergey Bobkov , Mokshay Madiman

We establish sharp exponential deviation estimates of the information content as well as a sharp bound on the varentropy for the class of convex measures on Euclidean spaces. This generalizes a similar development for log-concave measures…

Probability · Mathematics 2020-02-25 Matthieu Fradelizi , Jiange Li , Mokshay Madiman

We consider distributions of ordered random vectors with given one-dimensional marginal distributions. We give an elementary necessary and sufficient condition for the existence of such a distribution with finite entropy. In this case, we…

Statistics Theory · Mathematics 2015-09-08 Cristina Butucea , Jean-François Delmas , Anne Dutfoy , Richard Fischer

In this paper we show that the family P_d of probability distributions on R^d with log-concave densities satisfies a strong continuity condition. In particular, it turns out that weak convergence within this family entails (i) convergence…

Probability · Mathematics 2013-11-26 Dominic Schuhmacher , Andre Huesler , Lutz Duembgen

We establish concentration inequalities in the class of ultra log-concave distributions. In particular, we show that ultra log-concave distributions satisfy Poisson concentration bounds. As an application, we derive concentration bounds for…

Probability · Mathematics 2021-10-04 Heshan Aravinda , Arnaud Marsiglietti , James Melbourne

Random metastability occurs when an externally forced or noisy system possesses more than one state of apparent equilibrium. This work investigates a class of random dynamical systems, arising from perturbing a one-dimensional piecewise…

Dynamical Systems · Mathematics 2025-10-27 Cecilia González-Tokman , Joshua Peters

An elementary proof is provided of sharp bounds for the varentropy of random vectors with log-concave densities, as well as for deviations of the information content from its mean. These bounds significantly improve on the bounds obtained…

Probability · Mathematics 2019-03-06 Matthieu Fradelizi , Mokshay Madiman , Liyao Wang

Most entropy measures depend on the spread of the probability distribution over the sample space $\mathcal{X}$, and the maximum entropy achievable scales proportionately with the sample space cardinality $|\mathcal{X}|$. For a finite…

Machine Learning · Computer Science 2023-05-25 Rohan Ghosh , Mehul Motani

A lower bound on the probability $P(0<X<\delta)$ for all real $\delta>0$ and all random variables $X$ with log-concave p.d.f.'s such that $EX=0$ and $EX^2=1$ is obtained.

Probability · Mathematics 2026-02-09 Iosif Pinelis

The distribution of the hypervolume $V$ and surface $\partial V$ of convex hulls of (multiple) random walks in higher dimensions are determined numerically, especially containing probabilities far smaller than $P = 10^{-1000}$ to estimate…

Statistical Mechanics · Physics 2017-12-06 Hendrik Schawe , Alexander K. Hartmann , Satya N. Majumdar

We introduce a new generalization of relative entropy to non-negative vectors with sums $\gt 1$. We show in a purely combinatorial setting, with no probabilistic considerations, that in the presence of linear constraints defining a convex…

Information Theory · Computer Science 2024-05-08 Kostas N. Oikonomou

We study the asymptotic behavior of the diameter or maximum interpoint distance of a cloud of i.i.d. $d$-dimensional random vectors when the number of points in the cloud tends to infinity. This is a non standard extreme value problem since…

Probability · Mathematics 2017-11-30 Yann Demichel , Ana Karina Fermin , Philippe Soulier

In this paper, we study the problem of sampling from log-concave distributions supported on convex, compact sets, with a particular focus on the randomized midpoint discretization of both vanilla and kinetic Langevin diffusions in this…

Machine Learning · Statistics 2025-05-27 Yifeng Yu , Lu Yu

The phenomenon of entropy concentration provides strong support for the maximum entropy method, MaxEnt, for inferring a probability vector from information in the form of constraints. Here we extend this phenomenon, in a discrete setting,…

Information Theory · Computer Science 2021-01-11 Kostas N. Oikonomou

We show that the natural scaling of measurement for a particular problem defines the most likely probability distribution of observations taken from that measurement scale. Our approach extends the method of maximum entropy to use…

Quantitative Methods · Quantitative Biology 2010-03-02 Steven A. Frank , D. Eric Smith

On a compact group the Haar probability measure plays the role of uniform distribution. The entropy and rate distortion theory for this uniform distribution is studied. New results and simplified proofs on convergence of convolutions on…

Information Theory · Computer Science 2010-05-27 Peter Harremoes