English
Related papers

Related papers: Approximate Discrete Entropy Monotonicity for Log-…

200 papers

In this work we determine and discuss the entropic uncertainty measures of Shannon type for all the discrete stationary states of the multidimensional harmonic systems directly in terms of the states' hyperquantum numbers, the…

Quantum Physics · Physics 2018-12-19 I. V. Toranzo , J. S. Dehesa

We derive a lower bound on the differential entropy of a log-concave random variable $X$ in terms of the $p$-th absolute moment of $X$. The new bound leads to a reverse entropy power inequality with an explicit constant, and to new bounds…

Information Theory · Computer Science 2018-04-04 Arnaud Marsiglietti , Victoria Kostina

Let $r=r(n)$ be a sequence of integers such that $r\leq n$ and let $X_1,\ldots,X_{r+1}$ be independent random points distributed according to the Gaussian, the Beta or the spherical distribution on $\mathbb{R}^n$. Limit theorems for the…

Probability · Mathematics 2017-08-03 Julian Grote , Zakhar Kabluchko , Christoph Thäle

Let $X$ be a compact metric space and $T:X\longrightarrow X$ be continuous. Let $h^*(T)$ be the supremum of topological sequence entropies of $T$ over all subsequences of $\mathbb Z_+$ and $S(X)$ be the set of the values $h^*(T)$ for all…

Dynamical Systems · Mathematics 2019-05-01 Ľubomír Snoha , Xiangdong Ye , Ruifeng Zhang

Let $m$ and $k \geq 2$ be positive integers. We show that polynomial $P = (1+x)^m(1+x^k)$ is strongly unimodal (frequently known as {\it log concave\/}) if and only if $m \geq k^2 -3$; this is also the criterion for $P$ to be merely…

Combinatorics · Mathematics 2018-04-05 David Handelman

We revisit the problem of the estimation of the differential entropy $H(f)$ of a random vector $X$ in $R^d$ with density $f$, assuming that $H(f)$ exists and is finite. In this note, we study the consistency of the popular nearest neighbor…

Statistics Theory · Mathematics 2021-02-26 Luc Devroye , László Györfi

We study a quantity called discrete layered entropy, which approximates the Shannon entropy within a logarithmic gap. Compared to the Shannon entropy, the discrete layered entropy is piecewise linear, approximates the expected length of the…

Information Theory · Computer Science 2026-01-27 Cheuk Ting Li

The Kannan-Lov\'asz-Simonovits conjecture says that the Cheeger constant of any logconcave density is achieved to within a universal, dimension-independent constant factor by a hyperplane-induced subset. Here we survey the origin and…

Probability · Mathematics 2018-07-11 Yin Tat Lee , Santosh S. Vempala

We define a one-parameter family of entropies, each assigning a real number to any probability measure on a compact metric space (or, more generally, a compact Hausdorff space with a notion of similarity between points). These entropies…

Metric Geometry · Mathematics 2020-12-17 Tom Leinster , Emily Roff

For a random variable $X$ define $Q(X) = \sup_{x \in \mathbb{R}} \mathbb{P}(X=x)$. Let $X_1, \dots, X_n$ be independent integer random variables. Suppose $Q(X_i) \le \alpha_i \in (0,1]$ for each $i \in \{1, \dots, n\}$. Ju\v{s}kevi\v{c}ius…

Probability · Mathematics 2026-03-12 Valentas Kurauskas

We explore connections between homotopy type theory and information theory through homotopy cardinality. We define probability types and random variable types, prove that homotopy cardinality respects dependent sums under truncation and…

Category Theory · Mathematics 2026-03-17 Andrés Ortiz-Muñoz

We use probabilistic, topological and combinatorial methods to establish the following deviation inequality: For any normed space $X=(\mathbb R^n ,\|\cdot\| )$ there exists an invertible linear map $T:\mathbb R^n \to \mathbb R^n$ with \[…

Functional Analysis · Mathematics 2018-05-21 Grigoris Paouris , Petros Valettas

We prove the Shepp--Olkin conjecture, which states that the entropy of the sum of independent Bernoulli random variables is concave in the parameters of the individual random variables. Our proof is a refinement of an argument previously…

Probability · Mathematics 2017-05-24 Erwan Hillion , Oliver Johnson

This paper provides tight bounds on the R\'enyi entropy of a function of a discrete random variable with a finite number of possible values, where the considered function is not one-to-one. To that end, a tight lower bound on the R\'enyi…

Information Theory · Computer Science 2018-12-11 Igal Sason

In this paper, we develop Terence Tao's harmonic analysis method and apply it to restricted sumsets. The well known Cauchy-Davenport theorem asserts that if $A$ and $B$ are nonempty subsets of $Z/pZ$ with $p$ a prime, then $|A+B|\ge…

Number Theory · Mathematics 2008-11-29 Song Guo , Zhi-Wei Sun

B\o gvad and H\"agg proved that for a rational function with simple poles, the zeros of successive derivatives accumulate on the Voronoi diagram of the pole set, and the normalized zero-counting measures converge to a canonical probability…

Complex Variables · Mathematics 2026-04-08 Bosco Nyandwi , Christian Hägg , Celestin Kurujyibwami , Leon Fidele Ruganzu Uwimbabazi

Let $\{X,X_n,n\ge 1\}$ be a sequence of identically distributed, negatively dependent (NA) random variables under sub-linear expectations, and denote $S_n=\sum_{i=1}^{n}X_i$, $n\ge 1$. Assume that $h(\cdot)$ is a positive non-decreasing…

Probability · Mathematics 2024-08-21 Mingzhou Xu , Wei Wang

We introduce a simple geometrical construction similar to covariant holographic entanglement entropy but with the addition of a new term proportional to boundary region volume. This new procedure has properties strongly resembling classical…

High Energy Physics - Theory · Physics 2019-05-10 Sean J. Weinberg

The Shannon entropy of a random variable has much behaviour analogous to a signed measure. Previous work has explored this connection by defining a signed measure on abstract sets, which are taken to represent the information that different…

Information Theory · Computer Science 2025-05-28 Keenan J. A. Down , Pedro A. M. Mediano

Given a convex function $\varphi$ and two hermitian matrices $A$ and $B$, Lewin and Sabin study in [M. Lewin, J. Sabin, {\it A Family of Monotone Quantum Relative Entropies}, Lett. Math. Phys. \textbf{104} (2014), 691-705.] the relative…

Mathematical Physics · Physics 2016-12-20 Andreas Deuchert , Christian Hainzl , Robert Seiringer