English
Related papers

Related papers: Log-concavity, ultra-log-concavity, and a maximum …

200 papers

Motivated, in part, by the desire to develop an information-theoretic foundation for compound Poisson approximation limit theorems (analogous to the corresponding developments for the central limit theorem and for simple Poisson…

Information Theory · Computer Science 2010-10-21 Oliver Johnson , Ioannis Kontoyiannis , Mokshay Madiman

We prove that the Poisson distribution maximises entropy in the class of ultra-log-concave distributions, extending a result of Harremo\"{e}s. The proof uses ideas concerning log-concavity, and a semigroup action involving adding Poisson…

Probability · Mathematics 2010-08-17 Oliver Johnson

We establish concentration inequalities in the class of ultra log-concave distributions. In particular, we show that ultra log-concave distributions satisfy Poisson concentration bounds. As an application, we derive concentration bounds for…

Probability · Mathematics 2021-10-04 Heshan Aravinda , Arnaud Marsiglietti , James Melbourne

We develop the notion of discrete degrees of freedom of a log-concave sequence and use it to prove that geometric distribution minimises R\'enyi entropy of order infinity under fixed variance, among all discrete log-concave random variables…

Probability · Mathematics 2023-05-09 Jacek Jakimiuk , Daniel Murawski , Piotr Nayar , Semen Słobodianiuk

An "entropy increasing to the maximum" result analogous to the entropic central limit theorem (Barron 1986; Artstein et al. 2004) is obtained in the discrete setting. This involves the thinning operation and a Poisson limit. Monotonic…

Information Theory · Computer Science 2009-11-18 Yaming Yu

The Poisson log-normal model is a latent variable model that provides a generic framework for the analysis of multivariate count data. Inferring its parameters can be a daunting task since the conditional distribution of the latent…

Computation · Statistics 2026-05-19 Julien Stoehr , Stephane S. Robin

The entropy per coordinate in a log-concave random vector of any dimension with given density at the mode is shown to have a range of just 1. Uniform distributions on convex bodies are at the lower end of this range, the distribution with…

Information Theory · Computer Science 2024-05-07 Sergey Bobkov , Mokshay Madiman

In this paper, we study compound bi-free Poisson distributions for {\sl two-faced families of random variables}. We prove a Poisson limit theorem for compound bi-free Poisson distributions. Furthermore, a bi-free infinitely divisible…

Operator Algebras · Mathematics 2019-05-10 Mingchu Gao

The robust Poisson method is becoming increasingly popular when estimating the association of exposures with a binary outcome. Unlike the logistic regression model, the robust Poisson method yields results that can be interpreted as risk or…

Methodology · Statistics 2022-09-14 Denis Talbot , Miceline Mésidor , Yohann Chiu , Marc Simard , Caroline Sirois

This work considers a Poisson noise channel with an amplitude constraint. It is well-known that the capacity-achieving input distribution for this channel is discrete with finitely many points. We sharpen this result by introducing upper…

Information Theory · Computer Science 2021-07-30 Alex Dytso , Luca Barletta , Shlomo Shamai

Multivariate count data are commonly encountered through high-throughput sequencing technologies in bioinformatics, text mining, or in sports analytics. Although the Poisson distribution seems a natural fit to these count data, its…

Computation · Statistics 2020-04-16 Sanjeena Subedi , Ryan Browne

We consider the nonparametric maximum likelihood estimation for the underlying event time based on mixed-case interval-censored data, under a log-concavity assumption on its distribution function. This generalized framework relaxes the…

Computation · Statistics 2024-12-02 Chi Wing Chu , Hok Kan Ling , Chaoyu Yuan

Inspired by R. Speicher's multidimensional free central limit theorem and semicircle families, we prove an infinite dimensional compound Poisson limit theorem in free probability, and define infinite dimensional compound free Poisson…

Operator Algebras · Mathematics 2017-12-19 Guimei An , Mingchu Gao

We study the problem of sampling from strongly log-concave distributions over $\mathbb{R}^d$ using the Poisson midpoint discretization (a variant of the randomized midpoint method) for overdamped/underdamped Langevin dynamics. We prove its…

Probability · Mathematics 2025-10-02 Rishikesh Srinivasan , Dheeraj Nagaraj

We consider the entropy of sums of independent discrete random variables, in analogy with Shannon's Entropy Power Inequality, where equality holds for normals. In our case, infinite divisibility suggests that equality should hold for…

Information Theory · Computer Science 2010-10-21 Oliver Johnson , Yaming Yu

Jakimiuk et al. (2024) have proved that, if $X$ is an ultra log-concave random variable with integral mean, then $$\max_n \mathbb{P}\{X=n\} \geq \max_n \mathbb{P} \{Z=n\}\,,$$ where $Z$ is a Poisson random variable with the parameter…

Probability · Mathematics 2025-03-03 Heshan Aravinda

Sofic entropy is an invariant for probability-preserving actions of sofic groups. It was introduced a few years ago by Lewis Bowen, and shown to extend the classical Kolmogorov-Sinai entropy from the setting of amenable groups. Some parts…

Dynamical Systems · Mathematics 2016-06-14 Tim Austin

In this paper we introduce for a group $G$ the notion of ultralimit of measure class preserving actions of it, and show that its Furstenberg-Poisson boundaries can be obtained as an ultralimit of actions on itself, when equipped with…

Group Theory · Mathematics 2023-12-27 Elad Sayag , Yehuda Shalom

The Poisson distribution is the default choice of likelihood for probabilistic models of count data. However, due to the equidispersion contraint of the Poisson, such models may have predictive uncertainty that is artificially inflated.…

Methodology · Statistics 2025-07-15 Jimmy Lederman , Aaron Schein

The well known maximum-entropy principle due to Jaynes, which states that given mean parameters, the maximum entropy distribution matching them is in an exponential family, has been very popular in machine learning due to its "Occam's…

Machine Learning · Computer Science 2016-07-13 Yuanzhi Li , Andrej Risteski
‹ Prev 1 2 3 10 Next ›