Related papers: The Shannon-McMillan-Breiman theorem beyond amenab…
We show that every countable group with infinite FC-center has the Schmidt property, i.e., admits a free, ergodic, measure-preserving action on a standard probability space such that the full group of the associated orbit equivalence…
We provide a unifying approach which links results on algebraic actions by Lind and Schmidt, Chung and Li, and a topological result by Meyerovitch that relates entropy to the set of asymptotic pairs. In order to do this we introduce a…
In this paper, I expand Shannon's definition of entropy into a new form of entropy that allows integration of information from different random events. Shannon's notion of entropy is a special case of my more general definition of entropy.…
Gromov's theorem states that a finitely generated group has polynomial growth if and only if it is virtually nilpotent. A key ingredient in its proof is the small doubling property. In this work, we study entropy analogues of this property…
The Shannon entropy of a random variable has much behaviour analogous to a signed measure. Previous work has explored this connection by defining a signed measure on abstract sets, which are taken to represent the information that different…
We consider the analysis of probability distributions through their associated covariance operators from reproducing kernel Hilbert spaces. We show that the von Neumann entropy and relative entropy of these operators are intimately related…
The entropic region is formed by the collection of the Shannon entropies of all subvectors of finitely many jointly distributed discrete random variables. For four or more variables, the structure of the entropic region is mostly unknown.…
Local and category-theoretical entropies associated with an endomorphism of finite length (i.e., with zero-dimensional closed fiber) of a commutative Noetherian local ring are compared. Local entropy is shown to be less than or equal to…
We review subbadditivity properties of Shannon entropy, in particular, from the Shearer's inequality we derive the "infimum rule" for actions of amenable groups. We briefly discuss applicability of the "infimum formula" to actions of other…
The empirical measure of an interacting particle system is a purely atomic random probability measure. In the limit as the number of particles grows to infinity, we show for McKean-Vlasov systems with common noise that this measure becomes…
The notion of a surface-order specific entropy h_c(P) of a two-dimensional discrete random field P along a curve c is introduced as the limit of rescaled entropies along lattice approximations of the blowups of c. Existence is shown by…
We prove a pointwise ergodic theorem and a maximal inequality for actions of amenable groups on noncommutative measure spaces. To do so, we establish a square function estimate quantifying the difference between ergodic averages and some…
Quantum information-theoretic approach has been identified as a way to understand the foundations of quantum mechanics as early as 1950 due to Shannon. However there hasn't been enough advancement or rigorous development of the subject. In…
Although consistency is a minimum requirement of any estimator, little is known about consistency of the mean partition approach in consensus clustering. This contribution studies the asymptotic behavior of mean partitions. We show that…
Let $(X,\mu)$ be a standard probability space. An automorphism $T$ of $(X,\mu)$ has the weak Pinsker property if for every $\varepsilon > 0$ it has a splitting into a direct product of a Bernoulli shift and an automorphism of entropy less…
We give a new proof of a theorem of Giordano, Putnam and Skau characterizing orbit equivalence of minimal homeomorphisms of the Cantor space in terms of their sets of invariant Borel probability measures. The proof is based on a…
We discuss the Kolmogorov's entropy and Sinai's definition of it; and then define a deformation of the entropy, called {\it scaling entropy}; this is also a metric invariant of the measure preserving actions of the group, which is more…
The Shannon entropy, the desequilibrium and their generalizations (R\'enyi and Tsallis entropies) of the three-dimensional single-particle systems in a spherically-symmetric potential $V(r)$ can be decomposed into angular and radial parts.…
Data partitioning that maximizes/minimizes the Shannon entropy, or more generally the R\'enyi entropy is a crucial subroutine in data compression, columnar storage, and cardinality estimation algorithms. These partition algorithms can be…
Bowen's notion of sofic entropy is a powerful invariant for classifying probability-preserving actions of sofic groups. It can be defined in terms of the covering numbers of certain metric spaces associated to such an action, the `model…