English
Related papers

Related papers: Approximate Discrete Entropy Monotonicity for Log-…

200 papers

It is known that if a 2-universal hash function $H$ is applied to elements of a {\em block source} $(X_1,...,X_T)$, where each item $X_i$ has enough min-entropy conditioned on the previous items, then the output distribution…

Data Structures and Algorithms · Computer Science 2008-06-12 Kai-Min Chung , Salil Vadhan

We utilize a discrete version of the notion of degree of freedom to prove a sharp min-entropy-variance inequality for integer valued log-concave random variables. More specifically, we show that the geometric distribution minimizes the…

Probability · Mathematics 2023-09-08 Heshan Aravinda

We establish a sharp lower bound on the $L_p$-norm of sums of independent exponential random variables with fixed variance, for $p \geq 2$, thus extending Hunter's positivity theorem (1976) for completely homogeneous polynomials. We…

Probability · Mathematics 2026-02-04 Silouanos Brazitikos , Colin Tang , Tomasz Tkocz

We show that Shannon's entropy--power inequality admits a strengthened version in the case in which the densities are log-concave. In such a case, in fact, one can extend the Blachman--Stam argument to obtain a sharp inequality for the…

Information Theory · Computer Science 2014-08-19 Giuseppe Toscani

Let $G = (G,+)$ be an additive group. The sumset theory of Pl\"unnecke and Ruzsa gives several relations between the size of sumsets $A+B$ of finite sets $A, B$, and related objects such as iterated sumsets $kA$ and difference sets $A-B$,…

Combinatorics · Mathematics 2020-04-08 Terence Tao

The weak law of large numbers implies that, under mild assumptions on the source, the Renyi entropy per produced symbol converges (in probability) towards the Shannon entropy rate. This paper quantifies the speed of this convergence for…

Information Theory · Computer Science 2017-05-01 Maciej Skorski

In the Loop Quantum Gravity, black holes (or even more general Isolated Horizons) are described by a SU(2) Chern-Simons theory. There is an equivalent formulation of the horizon degrees of freedom in terms of a U(1) gauge theory which is…

General Relativity and Quantum Cosmology · Physics 2012-02-09 Romesh K. Kaul

Let $k\geq 2$ be an integer and let $\lambda$ be the Liouville function. Given $k$ non-negative distinct integers $h_1,\ldots,h_k$, the Chowla conjecture claims that $\sum_{n\leq x}\lambda(n+h_1)\cdots \lambda(n+h_k)=o(x)$ as $x\to\infty$.…

Number Theory · Mathematics 2025-05-27 Mikko Jaskari , Stelios Sachpazis

In 1935, Erd\H{o}s proved that the sums $f_k=\sum_n 1/(n\log n)$, over integers $n$ with exactly $k$ prime factors, are bounded by an absolute constant, and in 1993 Zhang proved that $f_k$ is maximized by the prime sum $f_1=\sum_p 1/(p\log…

Number Theory · Mathematics 2024-12-02 Ofir Gorodetsky , Jared Duker Lichtman , Mo Dick Wong

Let $A$ be an $N\times n$ random matrix whose entries are coordinates of an isotropic log-concave random vector in $\mathbb{R}^{Nn}$. We prove sharp lower tail estimates for the smallest singular value of $A$ in the following cases: (1)…

Probability · Mathematics 2025-08-26 Manuel Fernandez , Galyna V. Livshyts , Stephanie Mui

We describe five types of results concerning information and concentration of discrete random variables, and relationships between them, motivated by their counterparts in the continuous case. The results we consider are information…

Probability · Mathematics 2017-04-25 Oliver Johnson

We show that the essential properties of entropy (monotonicity, additivity and subadditivity) are consequences of entropy being a monoidal natural transformation from the under category functor $-/\mathsf{LProb}_{\rho}$ (where…

Category Theory · Mathematics 2024-04-16 Cheuk Ting Li

Sarnak's M\"{o}bius disjointness conjecture asserts that for any zero entropy dynamical system $(X,T)$, $\frac{1}{N} \sum_{n=1} ^N f(T^n x) \mu (n)= o(1)$ for every $f\in \mathcal{C}(X)$ and every $x\in X$. We construct examples showing…

Dynamical Systems · Mathematics 2022-02-22 Amir Algom , Zhiren Wang

Let (X_n) be a sequence of random variables (with values in a separable metric space) and (N_n) a sequence of random indices. Conditions for X_{N_n} to converge stably (in particular, in distribution) are provided. Some examples, where such…

Probability · Mathematics 2012-10-01 Patrizia Berti , Irene Crimaldi , Luca Pratelli , Pietro Rigo

Sampling from various kinds of distributions is an issue of paramount importance in statistics since it is often the key ingredient for constructing estimators, test procedures or confidence intervals. In many situations, the exact sampling…

Computation · Statistics 2016-12-06 Arnak S. Dalalyan

Let $P_1,\dots, P_n$ and $Q_1,\dots, Q_n$ be convex polytopes in $\mathbb{R}^n$ such that $P_i\subset Q_i$. It is well-known that the mixed volume has the monotonicity property: $V(P_1,\dots,P_n)\leq V(Q_1,\dots,Q_n)$. We give two criteria…

Metric Geometry · Mathematics 2020-12-22 Frédéric Bihan , Ivan Soprunov

We study the statistical entropy of a scalar field on the (1+1)-dimensional Maxwell-dilaton background without an artificial cutoff considering corrections to all orders in the Planck length from a generalized uncertainty principle (GUP) on…

General Relativity and Quantum Cosmology · Physics 2008-02-06 Yong-Wan Kim , Young-Jai Park

We propose a compression-based version of the empirical entropy of a finite string over a finite alphabet. Whereas previously one considers the naked entropy of (possibly higher order) Markov processes, we consider the sum of the…

Information Theory · Computer Science 2011-04-05 Paul M. B. Vitányi

The uncertainty relation based on the Shannon entropies of the probability densities in position and momentum spaces is improved for quantum systems in arbitrary $D$-dimensional spherically symmetric potentials. To find it, we have used the…

Mathematical Physics · Physics 2013-05-22 Łukasz Rudnicki , Pablo Sánchez-Moreno , Jesús S. Dehesa

We present a detailed derivation of some estimators of Shannon entropy for discrete distributions. They hold for finite samples of N points distributed into M "boxes", with N and M -> oo, but N/M < oo. In the high sampling regime (<< 1…

Data Analysis, Statistics and Probability · Physics 2011-11-09 P. Grassberger