Related papers: Semicircularity, Gaussianity and Monotonicity of E…

We prove a free probability analog of a result of Artstein-Bally-Barthez-Naor. In particualar we prove that if X_{1},X_{2},... are freely independent identically distributed random variables, then the free entropy…

The classical problem of maximizing the Shannon entropy of a sum of independent random variables supported on a finite alphabet is considered and settled in the ternary case. Namely, the following theorem is established: if…

Dunkel and Trigger [Phys. Rev. A {71}, 052102 (2005)] show that the Leipnik's joint entropy monotonously increases for the initially maximally classical Gaussian wave packet for a free particle. After expressing the joint entropy of the…

Increasing the number $N$ of elements of a system typically makes the entropy to increase. The question arises on {\it what particular entropic form} we have in mind and {\it how it increases} with $N$. Thermodynamically speaking it makes…

Observational entropy -- a quantity that unifies Boltzmann's entropy, Gibbs' entropy, von Neumann's macroscopic entropy, and the diagonal entropy -- has recently been argued to play a key role in a modern formulation of statistical…

We investigate, via computer simulations, the time evolution of the (Boltzmann) entropy of a dense fluid not in local equilibrium. The macrovariables $M$ describing the system are the (empirical) particle density $f=\{f(\un{x},\un{v})\}$…

We ask the question whether entropy accumulates, in the sense that the operationally relevant total uncertainty about an $n$-partite system $A = (A_1, \ldots A_n)$ corresponds to the sum of the entropies of its parts $A_i$. The Asymptotic…

We define a one-parameter family of entropies, each assigning a real number to any probability measure on a compact metric space (or, more generally, a compact Hausdorff space with a notion of similarity between points). These entropies…

To illustrate Boltzmann's construction of an entropy function that is defined for a microstate of a macroscopic system, we present here the simple example of the free expansion of a one dimensional gas of non-interacting point particles.…

The concept of entropy connects the number of possible configurations with the number of variables in large stochastic systems. Independent or weakly interacting variables render the number of configurations scale exponentially with the…

Entropy comparison inequalities are obtained for the differential entropy $h(X+Y)$ of the sum of two independent random vectors $X,Y$, when one is replaced by a Gaussian. For identically distributed random vectors $X,Y$, these are closely…

Let $ X_1, \ldots, X_n $ be independent random variables taking values in the alphabet $ \{0, 1, \ldots, r\} $, and $ S_n = \sum_{i = 1}^n X_i $. The Shepp--Olkin theorem states that, in the binary case ($ r = 1 $), the Shannon entropy of $…

It is proven that a conjecture of Tao (2010) holds true for log-concave random variables on the integers: For every $n \geq 1$, if $X_1,\ldots,X_n$ are i.i.d. integer-valued, log-concave random variables, then $$ H(X_1+\cdots+X_{n+1}) \geq…

We study asymptotic expansions in free probability. In a class of classical limit theorems Edgeworth expansion can be obtained via a general approach using sequences of "influence" functions of individual random elements described by…

Let $(X_1,\dots,X_m)$ be self-adjoint non-commutative random variables distributed according to the free Gibbs law given by a sufficiently regular convex and semi-concave potential $V$, and let $(S_1,\dots,S_m)$ be a free semicircular…

The convex hull $P_{n}$ of a Gaussian sample $X_{1},...,X_{n}$ in $R^{d}$ is a Gaussian polytope. We prove that the expected number of facets $E f_{d-1} (P_n)$ is monotonically increasing in $n$. Furthermore we prove this for random…

We establish a lower bound on the entropy of weighted sums of (possibly dependent) random variables $(X_1, X_2, \dots, X_n)$ possessing a symmetric joint distribution. Our lower bound is in terms of the joint entropy of $(X_1, X_2, \dots,…

Given n (discrete or continuous) random variables X_i, the (2^n-1)-dimensional vector obtained by evaluating the joint entropy of all non-empty subsets of {X_1,...,X_n} is called an entropic vector. Determining the region of entropic…

Entropy increase is fundamentally related to the breaking of time-reversal symmetry. By adding the 'extra dimension' associated with thermodynamic forces, we extend that discrete symmetry to a continuous symmetry for the dynamical…

Entropy of matter in a very strong gravity depends on cross-sectional area of the container of the system -- is being further bolstered by calculating entropy of a monoatomic gas kept under uniform strong gravity at Newtonian scale. This…