English
Related papers

Related papers: Possible generalized entropy convergence rates

200 papers

The problem of Shannon entropy estimation in countable infinite alphabets is addressed from the study and use of convergence results of the entropy functional, which is known to be discontinuous with respect to the total variation distance…

Information Theory · Computer Science 2018-04-03 Jorge F. Silva

Measure-theoretic and topological entropy are classical invariants in the theory of dynamical systems. There are several recently developed entropy type invariants for systems of sub-exponential growth: sequence entropy, slow entropy,…

Dynamical Systems · Mathematics 2020-04-10 Adam Kanigowski , Anatole Katok , Daren Wei

In a recent paper, Melbourne and Terhesiu [Operator renewal theory and mixing rates for dynamical systems with infinite measure, Invent. Math. 189 (2012), 61-110] obtained results on mixing and mixing rates for a large class of…

Dynamical Systems · Mathematics 2016-05-03 Ian Melbourne

We show that a certain type of quasi finite, conservative, ergodic, measure preserving transformation always has a maximal zero entropy factor, generated by predictable sets. We also construct a conservative, ergodic, measure preserving…

Dynamical Systems · Mathematics 2010-06-01 Jon Aaronson , Kyewon Koh Park

Shannon's entropy and other entropy-based concepts are derived from the new, more general concept of relative divergence of one "grading' function on a linearly ordered set from another such function. The definition of relative divergence…

Probability · Mathematics 2019-03-14 Alexander Dukhovny

We study how the Shannon entropy of sequences produced by an information source converges to the source's entropy rate. We synthesize several phenomenological approaches to applying information theoretic measures of randomness and memory to…

Statistical Mechanics · Physics 2007-05-23 James P. Crutchfield , David P. Feldman

We review a new form of entropy suggested by us, with origin in mixing of states of systems due to interactions and deformations of phase cells. It is demonstrated that this nonextensive form also leads to asymmetric maximal entropy…

Statistical Mechanics · Physics 2009-06-16 Fariel Shafee

We introduce a method for quantifying the inherent unpredictability of a continuous-valued time series via an extension of the differential Shannon entropy rate. Our extension, the specific entropy rate, quantifies the amount of predictive…

Machine Learning · Computer Science 2016-06-09 David Darmon

For a compact set of actions, an invariant of Kushnirenko's entropy type is chosen in such a way that on this set it is equal to zero, but will be infinity for typical actions. As a consequence, we show that typical measure-preserving…

Dynamical Systems · Mathematics 2021-02-12 Valery V. Ryzhikov

For dynamical systems with the shadowing property, we provide a method of approximation of invariant measures by ergodic measures supported on odometers and their almost 1-1 extensions. For a topologically transitive system with the…

Dynamical Systems · Mathematics 2019-08-15 Jian Li , Piotr Oprocha

For $C^{1+}$ maps, possibly non-invertible and with singularities, we prove that each homoclinic class of an ergodic adapted hyperbolic measure carries at most one adapted hyperbolic measure of maximal entropy. We then apply this to study…

Dynamical Systems · Mathematics 2025-12-30 Yuri Lima , Davi Obata , Mauricio Poletti

For dynamical systems satisfying the approximate $\mathbb{Z}^{d}$ or $\mathbb{Z}_+^{d}$-product property and asymptotically entropy expansiveness, we establish a precise description of the structure of their space of invariant measures. In…

Dynamical Systems · Mathematics 2026-05-21 Yage Liu , Ercai Chen , Xiaoyao Zhou

Information entropy and its extension, which are important generalization of entropy, have been applied in many research domains today. In this paper, a novel generalized relative entropy is constructed to avoid some defects of traditional…

Information Theory · Computer Science 2017-04-24 Shuai Liu , Mengye Lu , Gaocheng Liu , Zheng Pan

Answering an open question affirmatively it is shown that every ergodic invariant measure of a mean equicontinuous (i.e. mean-L-stable) system has discrete spectrum. Dichotomy results related to mean equicontinuity and mean sensitivity are…

Dynamical Systems · Mathematics 2016-11-18 Jian Li , Siming Tu , Xiangdong Ye

We consider the differential entropy of probability measures absolutely continuous with respect to a given $\sigma$-finite reference measure on an arbitrary measurable space. We state the asymptotic equipartition property in this general…

Information Theory · Computer Science 2021-07-12 Juan Pablo Vigneaux

We prove a model theorem for factor maps between ergodic, infinite measure-preserving systems.

Dynamical Systems · Mathematics 2018-03-12 Hisatoshi Yuasa

Measure-theoretic slow entropy is a more refined invariant than the classical measure-theoretic entropy to characterize the complexity of dynamical systems with subexponential growth rates of distinguishable orbit types. In this paper we…

Dynamical Systems · Mathematics 2021-09-20 Shilpak Banerjee , Philipp Kunde , Daren Wei

A consequence of Ornstein theory is that the infinite entropy flows associated with Poisson processes and continuous-time irreducible Markov chains on a finite number of states are isomorphic as measure-preserving systems. We give an…

Dynamical Systems · Mathematics 2018-10-09 Terry Soo

We analyse certain degenerate infinite dimensional sub-elliptic generators, and obtain estimates on the long-time behaviour of the corresponding Markov semigroups that describe a certain model of heat conduction. In particular, we establish…

Probability · Mathematics 2010-08-17 J. Inglis , M. Neklyudov , B. Zegarlinski

Let $(\xi_n)_{n=0}^\infty$ be a nonhomogeneous Markov chain taking values from finite state-space of $\mathbf{X}=\{1,2,\ldots,b\}$. In this paper, we will study the generalized entropy ergodic theorem with almost-everywhere and…

Probability · Mathematics 2015-01-19 Zhongzhi Wang , Weiguo Yang