Related papers: The Almost Sure Invariance Principle for Beta-Mixi…
While most useful information theoretic inequalities can be deduced from the basic properties of entropy or mutual information, up to now Shannon's entropy power inequality (EPI) is an exception: Existing information theoretic proofs of the…
In the study of non-equilibrium statistical mechanics, Ruelle derived explicit formulae for entropy production of smooth dynamical systems. The vanishing or strict positivity of entropy production is determined by the {\it entropy formula…
We describe a measurement device principle based on discrete iterations of Bayesian updating of system state probability distributions. Although purely classical by nature, these measurements are accompanied with a progressive collapse of…
The quality of image encryption is commonly measured by the Shannon entropy over the ciphertext image. However, this measurement does not consider to the randomness of local image blocks and is inappropriate for scrambling based image…
In the semi-classical limit, the quantum mechanics of a stationary beam of counter-streaming relativistic electrons and ions is described by a nonlinear system of finite-temperature Thomas-Fermi equations. In the high temperature / low…
We study a model of spatial random permutations over a discrete set of points. Formally, a permutation $\sigma$ is sampled proportionally to the weight $\exp\{-\alpha \sum_x V(\sigma(x)-x)\},$ where $\alpha>0$ is the temperature and $V$ is…
The principle of maximum entropy (Maxent) is often used to obtain prior probability distributions as a method to obtain a Gibbs measure under some restriction giving the probability that a system will be in a certain state compared to the…
We provide a stochastic extension of the Baez-Fritz-Leinster characterization of the Shannon information loss associated with a measure-preserving function. This recovers the conditional entropy and a closely related information-theoretic…
Strong invariance principles describe the error term of a Brownian approximation of the partial sums of a stochastic process. While these strong approximation results have many applications, the results for continuous-time settings have…
Given a countable discrete amenable virtually orderable group $G$ acting by translations on a $G$-subshift $X \subseteq S^G$ and an absolutely summable potential $\Phi$, we present a set of conditions to obtain a special integral…
We study the Bowen topological entropy of generic and irregular points for certain dynamical systems. We define the topological entropy of noncompact sets for flows, analogous to Bowen's definition. We show that this entropy coincides with…
Let $ X_1, \ldots, X_n $ be independent random variables taking values in the alphabet $ \{0, 1, \ldots, r\} $, and $ S_n = \sum_{i = 1}^n X_i $. The Shepp--Olkin theorem states that, in the binary case ($ r = 1 $), the Shannon entropy of $…
Entropy production in stochastic mechanical systems is examined here with strict bounds on its rate. Stochastic mechanical systems include pure diffusions in Euclidean space or on Lie groups, as well as systems evolving on phase space for…
We establish the existence and fundamental properties of the equilibrium measure in uniformly quasiregular dynamics. We show that a uniformly quasiregular endomorphism $f$ of degree at least 2 on a closed Riemannian manifold admits an…
We characterize the growth of the Sibson and Arimoto mutual informations and $\alpha$-maximal leakage, of any order that is at least unity, between a random variable and a growing set of noisy, conditionally independent and…
The chain rule for the Shannon and von Neumann entropy, which relates the total entropy of a system to the entropies of its parts, is of central importance to information theory. Here we consider the chain rule for the more general smooth…
Suppose $(f,\mathcal{X},\nu)$ is a measure preserving dynamical system and $\phi:\mathcal{X}\to\mathbb{R}$ is an observable with some degree of regularity. We investigate the maximum process $M_n:=\max\{X_1,\ldots,X_n\}$, where…
We consider an independently identically distributed random dynamical system generated by finitely many, non-uniformly expanding Markov interval maps with a finite number of branches. Assuming a topologically mixing condition and the…
We obtain a quenched vector-valued almost sure invariance principle (ASIP) for random expanding on average cocycles. This is achieved by combining the adapted version of Gou\"{e}zel's approach for establishing ASIP and the recent…
In this paper, unstable metric entropy, unstable topological entropy and unstable pressure for partially hyperbolic endomorphisms are introduced and investigated. A version of Shannon-McMillan-Breiman Theorem is established, and a…