Related papers: The Shannon-McMillan-Breiman theorem beyond amenab…
We consider the entropy of sums of independent discrete random variables, in analogy with Shannon's Entropy Power Inequality, where equality holds for normals. In our case, infinite divisibility suggests that equality should hold for…
We generalize Gabor's notion of topological Rokhlin dimension of $\mathbb{Z}^k$-actions on compact metric space to a class of general discrete countable amenable group actions which involves the approximate subgroup structure. Then with…
The unitary group U(N) acts by conjugations on the space H(N) of NxN Hermitian matrices, and every orbit of this action carries a unique invariant probability measure called an orbital measure. Consider the projection of the space H(N) onto…
We discuss the dependence of the Shannon entropy of normalized finite rank-1 POVMs on the choice of the input state, looking for the states that minimize this quantity. To distinguish the class of measurements where the problem can be…
The Wehrl entropy is an entropy associated to the Husimi quasi-probability distribution. We discuss how it can be used to formulate entropic uncertainty relations and for a quantification of entanglement in continuous variables. We show…
Entropies are fundamental measures of uncertainty with central importance in information theory and statistics and applications across all the quantitative sciences. Under a natural set of operational axioms, the most general form of…
We propose a compression-based version of the empirical entropy of a finite string over a finite alphabet. Whereas previously one considers the naked entropy of (possibly higher order) Markov processes, we consider the sum of the…
We consider a new orbit equivalence invariant for measure-preserving actions of groups on the probability space, $\sigma:G\to$ Aut$(X,\mu)$, denoted $\chi_0(\sigma;G)$ and defined as the "intersection" of the 1-cohomology group,…
Completing a strategy of Gou\"ezel and Lalley, we prove a local limit theorem for the random walk generated by any symmetric finitely supported probability measure on a non-elementary Gromov-hyperbolic group: denoting by $R$ the inverse of…
In the first part of this paper, we formulate a general setting in which to study the ergodic theory of differentiable $\mathbb{Z}^d$-actions preserving a Borel probability measure. This framework includes actions by $C^{1+\text{H\"older}}$…
The well known maximum-entropy principle due to Jaynes, which states that given mean parameters, the maximum entropy distribution matching them is in an exponential family, has been very popular in machine learning due to its "Occam's…
Entropic uncertainty relations for the position and momentum within the generalized uncertainty principle are examined. Studies of this principle are motivated by the existence of a minimal observable length. Then the position and momentum…
Maximum entropy (MAXENT) method has a large number of applications in theoretical and applied machine learning, since it provides a convenient non-parametric tool for estimating unknown probabilities. The method is a major contribution of…
Entropies must correspond to mean values for them to be measurable. The Shannon entropy corresponds to the weighted arithmetic mean, whereas the Renyi entropy corresponds to the exponential mean. These means refer to code lengths, which are…
Entanglement entropy of quantum fields in gravitational settings is a topic of growing importance. This entropy of entanglement is conventionally computed relative to Cauchy hypersurfaces where it is possible via a partial tracing to…
A variation of the Scott analysis of countable structures is applied to actions of non-Archimedean TSI Polish groups acting continuously on a Polish spaces. We give results on the potential Borel complexity spectrum of such groups, and…
Entropy is a measure of heterogeneity widely used in applied sciences, often when data are collected over space. Recently, a number of approaches has been proposed to include spatial information in entropy. The aim of entropy is to…
This article provides a completion to theories of information based on entropy, resolving a longstanding question in its axiomatization as proposed by Shannon and pursued by Jaynes. We show that Shannon's entropy function has a…
Entropy is a fundamental property of both classical and quantum systems, spanning myriad theoretical and practical applications in physics and computer science. We study the problem of obtaining estimates to within a multiplicative factor…
We study periodic points and finitely supported invariant measures for continuous semigroup actions. Introducing suitable notions of periodicity in both topological and measure-theoretical contexts, we analyze the space of invariant Borel…