Related papers: A Free Analogue of Shannon's Problem on Monotonici…

S. Artstein, K. Ball, F. Barthe, and A. Naor have shown that if (X_j) are i.i.d. random variables, then the entropy of n^{-1/2}(X_1+....+X_n) increases as n increases. The free analogue was recently proven by D. Shlyakhtenko. That is, if…

The classical problem of maximizing the Shannon entropy of a sum of independent random variables supported on a finite alphabet is considered and settled in the ternary case. Namely, the following theorem is established: if…

We consider the entropy of sums of independent discrete random variables, in analogy with Shannon's Entropy Power Inequality, where equality holds for normals. In our case, infinite divisibility suggests that equality should hold for…

We construct entropy increasing monotone factors in the context of a Bernoulli shift over the free group of rank at least two.

Let $ X_1, \ldots, X_n $ be independent random variables taking values in the alphabet $ \{0, 1, \ldots, r\} $, and $ S_n = \sum_{i = 1}^n X_i $. The Shepp--Olkin theorem states that, in the binary case ($ r = 1 $), the Shannon entropy of $…

It is proven that a conjecture of Tao (2010) holds true for log-concave random variables on the integers: For every $n \geq 1$, if $X_1,\ldots,X_n$ are i.i.d. integer-valued, log-concave random variables, then $$ H(X_1+\cdots+X_{n+1}) \geq…

Dunkel and Trigger [Phys. Rev. A {71}, 052102 (2005)] show that the Leipnik's joint entropy monotonously increases for the initially maximally classical Gaussian wave packet for a free particle. After expressing the joint entropy of the…

Consider tossing a collection of coins, each fair or biased towards heads, and take the distribution of the total number of heads that result. It is natural to conjecture that this distribution should be 'more random' when each coin is…

We show that there is equality in Shannon's Entropy Power Inequality (EPI) if and only if the random variables involved are Gaussian, assuming nothing beyond the existence of differential entropies. This is done by justifying de Bruijn's…

Various lower bounds are established for the entropy of sums, products and their combinations. First, we derive a prime-field analogue of a version of the entropy power inequality established by Tao over torsion-free groups. Next, we prove…

Through the study of large deviations theory for matrix Brownian motion, Biane-Capitaine-Guionnet proved the inequality $\chi(X) \leq \chi^*(X)$ that relates two analogs of entropy in free probability defined by Voiculescu. We give a new…

In noncommutative probability theory independence can be based on free products instead of tensor products. This yields a highly noncommutative theory: free probability . Here we show that the classical Shannon's entropy power inequality…

We prove the Shepp--Olkin conjecture, which states that the entropy of the sum of independent Bernoulli random variables is concave in the parameters of the individual random variables. Our proof is a refinement of an argument previously…

An "entropy increasing to the maximum" result analogous to the entropic central limit theorem (Barron 1986; Artstein et al. 2004) is obtained in the discrete setting. This involves the thinning operation and a Poisson limit. Monotonic…

We derive an asymptotic lower bound on the Shannon entropy $H$ of sums of $N$ arbitrary iid discrete random variables. The derived bound $H \geq \frac{r(X)}{2}\log(N) + {\it cst}$ is given in terms of the incommensurability rank $r(X)$ of…

By solving a free analog of the Monge-Amp\`ere equation, we prove a non-commutative analog of Brenier's monotone transport theorem: if an $n$-tuple of self-adjoint non-commutative random variables $Z_{1},...,Z_{n}$ satisfies a regularity…

We show how to reduce free independence to tensor independence in the strong sense. We construct a suitable unital *-algebra of closed operators `affiliated' with a given unital *-algebra and call the associated closure `monotone'. Then we…

The convex hull $P_{n}$ of a Gaussian sample $X_{1},...,X_{n}$ in $R^{d}$ is a Gaussian polytope. We prove that the expected number of facets $E f_{d-1} (P_n)$ is monotonically increasing in $n$. Furthermore we prove this for random…

We survey the connections between entropy, chaos, and independence in topological dynamics. We present extensions of two classical results placing the following notions in the context of symbolic dynamics: 1. Equivalence of positive entropy…

We prove that if two free p.m.p. $\mathbb{Z}$-actions are Shannon orbit equivalent then they have the same entropy. The argument also applies more generally to yield the same conclusion for free p.m.p. actions of finitely generated…