Related papers: Shannon entropy for stationary processes and dynam…
In the present work we investigate phase correlations by recourse to the Shannon entropy. Using theoretical arguments we show that the entropy provides an accurate measure of phase correlations in any dynamical system, in particular when…
The Shannon entropy is used as a basis for applying different lemmas and conjectures concerning the set of gaps between prime numbers G_p , thus estimating several measures of it. The same procedures are applied to artificially created…
We propose a compression-based version of the empirical entropy of a finite string over a finite alphabet. Whereas previously one considers the naked entropy of (possibly higher order) Markov processes, we consider the sum of the…
We consider steady states for a class of mechanical systems with particle-disk interactions coupled to two, possibly unequal, heat baths. We show that any steady state that satisfies some natural assumptions is ergodic and absolutely…
The problem of Shannon entropy estimation in countable infinite alphabets is addressed from the study and use of convergence results of the entropy functional, which is known to be discontinuous with respect to the total variation distance…
We study the relations between the recently proposed machine-independent quantum complexity of P. Gacs~\cite{Gacs} and the entropy of classical and quantum systems. On one hand, by restricting Gacs complexity to ergodic classical dynamical…
Shannon's entropy and other entropy-based concepts are derived from the new, more general concept of relative divergence of one "grading' function on a linearly ordered set from another such function. The definition of relative divergence…
We establish strong invariance principles for sums of stationary and ergodic processes with nearly optimal bounds. Applications to linear and some nonlinear processes are discussed. Strong laws of large numbers and laws of the iterated…
We investigate ergodic theory of Poisson suspensions. In the process, we establish close connections between finite and infinite measure preserving ergodic theory. Poisson suspensions thus provide a new approach to infinite measure…
In the online prediction framework, we use generalized entropy of to study the loss rate of predictors when outcomes are drawn according to stationary ergodic distributions over the binary alphabet. We show that the notion of generalized…
Loosely speaking, the Shannon entropy rate is used to gauge a stochastic process' intrinsic randomness; the statistical complexity gives the cost of predicting the process. We calculate, for the first time, the entropy rate and statistical…
We introduce a novel entropy-related function, \textit{non-repeatability}, designed to capture dynamical behaviors in complex systems. Its normalized form, \textit{mutability}, has been previously applied in statistical physics as a…
Expressions for (EPI Shannon type) Divergence-Power Inequalities (DPI) in two cases (time-discrete and band-limited time-continuous) of stationary random processes are given. The new expressions connect the divergence rate of the sum of…
We prove the equivalence among symmetricity, time reversibility, and zero entropy production of the stationary solutions of linear stochastic differential equations. A sufficient and necessary reversibility condition expressed in terms of…
We focus our attention on dynamical processes characterized by an entropic index Q<1. According to the probabilistic arguments of Tsallis and Bukman [C.Tsallis, D.J. Bukman, Phys. Rev. E 54,R2197 (1996)] these processes are subdiffusional…
For dynamical systems satisfying the approximate $\mathbb{Z}^{d}$ or $\mathbb{Z}_+^{d}$-product property and asymptotically entropy expansiveness, we establish a precise description of the structure of their space of invariant measures. In…
The maximum entropy principle (MEP) is a method for obtaining the most likely distribution functions of observables from statistical systems, by maximizing entropy under constraints. The MEP has found hundreds of applications in ergodic and…
Let $\mathcal{F}$ be a $C^2$ random partially hyperbolic dynamical system. For the unstable foliation, the corresponding unstable metric entropy, unstable topological entropy and unstable pressure via the dynamics of $\mathcal{F}$ on the…
The Shannon entropy, one of the cornerstones of information theory, is widely used in physics, particularly in statistical mechanics. Yet its characterization and connection to physics remain vague, leaving ample room for misconceptions and…
The new estimates of the conditional Shannon entropy are introduced in the framework of the model describing a discrete response variable depending on a vector of d factors having a density w.r.t. the Lebesgue measure in R^d. Namely, the…