English
Related papers

Related papers: Conditional entropy of ordinal patterns

200 papers

We study the entropy rate of pattern sequences of stochastic processes, and its relationship to the entropy rate of the original process. We give a complete characterization of this relationship for i.i.d. processes over arbitrary…

Information Theory · Computer Science 2007-07-13 George M. Gemelos , Tsachy Weissman

This work is an enquiry into the circumstances under which entropy methods can give an answer to the questions of both quantum separability and classical correlations of a composite state. Several entropy functionals are employed to examine…

Quantum Physics · Physics 2009-11-07 A. K. Rajagopal , R. W. Rendell

Permutation entropy and its associated frameworks are remarkable examples of physics-inspired techniques adept at processing complex and extensive datasets. Despite substantial progress in developing and applying these tools, their use has…

Data Analysis, Statistics and Probability · Physics 2024-08-14 Leonardo G. J. M. Voltarelli , Arthur A. B. Pessa , Luciano Zunino , Rafael S. Zola , Ervin K. Lenzi , Matjaz Perc , Haroldo V. Ribeiro

The ultimate purpose of the statistical analysis of ordinal patterns is to characterize the distribution of the features they induce. In particular, knowing the joint distribution of the pair Entropy-Statistical Complexity for a large class…

The Kolmogorov-Sinai (K-S) entropy is a central measure of complexity and chaos. Its calculation for many-body systems is an interesting and important challenge. In this paper, the evaluation is formulated by considering $N$-dimensional…

Chaotic Dynamics · Physics 2013-05-29 Arul Lakshminarayan , Steven Tomsovic

We consider the one-parameter family of interval maps arising from generalized continued fraction expansions known as alpha-continued fractions. For such maps, we perform a numerical study of the behaviour of metric entropy as a function of…

Dynamical Systems · Mathematics 2015-05-14 Carlo Carminati , Stefano Marmi , Alessandro Profeti , Giulio Tiozzo

Sofic entropy is an invariant for probability-preserving actions of sofic groups. It was introduced a few years ago by Lewis Bowen, and shown to extend the classical Kolmogorov-Sinai entropy from the setting of amenable groups. Some parts…

Dynamical Systems · Mathematics 2016-06-14 Tim Austin

A conditional entropic approach is discussed for nonequilibrium complex systems with a weak correlation between spatiotemporally fluctuating quantities on a large time scale. The weak correlation is found to constitute the fluctuation…

Statistical Mechanics · Physics 2023-04-04 Yuichi Itto

We define and investigate a notion of entropy for quantum error correcting codes. The entropy of a code for a given quantum channel has a number of equivalent realisations, such as through the coefficients associated with the Knill-Laflamme…

Quantum Physics · Physics 2009-02-24 David W. Kribs , Aron Pasieka , Karol Zyczkowski

A consecutive pattern in a permutation $\pi$ is another permutation $\sigma$ determined by the relative order of a subsequence of contiguous entries of $\pi$. Traditional notions such as descents, runs and peaks can be viewed as particular…

Combinatorics · Mathematics 2015-10-23 Sergi Elizalde

We consider the differential entropy of probability measures absolutely continuous with respect to a given $\sigma$-finite reference measure on an arbitrary measurable space. We state the asymptotic equipartition property in this general…

Information Theory · Computer Science 2021-07-12 Juan Pablo Vigneaux

In this paper, we investigate temporal clusters of extremes defined as subsequent exceedances of high thresholds in a stationary time series. Two meaningful features of these clusters are the probability distribution of the cluster size and…

Statistics Theory · Mathematics 2020-04-08 Marco Oesting , Alexander Schnurr

Conditional differential entropy provides an intuitive measure for relatively ranking time-series complexity by quantifying uncertainty in future observations given past context. However, its direct computation for high-dimensional…

Signal Processing · Electrical Eng. & Systems 2025-10-24 Jacob Ayers , Richard Hahnloser , Julia Ulrich , Lothar Sebastian Krapp , Remo Nitschke , Sabine Stoll , Balthasar Bickel , Reinhard Furrer

The present work is dedicated to searching parameters, alternative to entropy, applicable for description of highly organized systems. The general concept has been offered, in which the system complexity and order are functions of the order…

Information Theory · Computer Science 2010-09-03 V. I. Ilyevsky

We analyze the ordinal structure of long-range dependent time series. To this end, we use so called ordinal patterns which describe the relative position of consecutive data points. We provide two estimators for the probabilities of ordinal…

We study the N-step binary stationary ergodic Markov chain and analyze its differential entropy. Supposing that the correlations are weak we express the conditional probability function of the chain through the pair correlation function and…

Statistical Mechanics · Physics 2015-06-24 S. S. Melnik , O. V. Usatenko

One of the most popular and innovative methods to analyse signals is by using Ordinal Patterns (OPs). The OP encoding is based on transforming a (univariate) signal into a symbolic sequence of OPs, where each OP represents the number of…

Chaotic Dynamics · Physics 2026-01-27 Melvyn Tyloo , Joaquín González , Nicolás Rubido

Physical quantities obtained from the microcanonical entropy surfaces of classical spin systems show typical features of phase transitions already in finite systems. It is demonstrated that the singular behaviour of the microcanonically…

Statistical Mechanics · Physics 2009-11-10 Hans Behringer

A definition of entropy via the Kolmogorov algorithmic complexity is discussed. As examples, we show how the meanfield theory for the Ising model, and the entropy of a perfect gas can be recovered. The connection with computations are…

Statistical Mechanics · Physics 2007-05-23 Somendra M. Bhattacharjee

We define variational properties for dynamical systems with subexponential complexity, and study these properties in certain specific examples. By computing the value of slow entropy directly, we show that some subshifts are not…

Dynamical Systems · Mathematics 2024-10-22 Minhua Cheng , Carlos Ospina , Kurt Vinhage , Yibo Zhai