English
Related papers

Related papers: Entropic descriptor of a complex behaviour

200 papers

We derive the asymptotic distribution of ordinal-pattern frequencies under weak dependence conditions and investigate the long-run covariance matrix not only analytically for moving-average, Gaussian, and the novel generalized coin-tossing…

Statistics Theory · Mathematics 2025-07-24 Angelika Silbernagel , Christian Weiß

The constituents of a complex system exchange information to function properly. Their signalling dynamics often leads to the appearance of emergent phenomena, such as phase transitions and collective behaviors. While information exchange…

Physics and Society · Physics 2020-11-18 Arsham Ghavasieh , Carlo Nicolini , Manlio De Domenico

Many complex systems are characterized by non-Boltzmann distribution functions of their statistical variables. If one wants to -- justified or not -- hold on to the maximum entropy principle for complex statistical systems (non-Boltzmann)…

Statistical Mechanics · Physics 2009-11-13 Stefan Thurner , Rudolf Hanel

A measure of complexity based on a probabilistic description of physical systems is proposed. This measure incorporates the main features of the intuitive notion of such a magnitude. It can be applied to many physical situations and to…

Chaotic Dynamics · Physics 2009-11-07 Ricardo Lopez-Ruiz , Hector Mancini , Xavier Calbet

Configurational entropy is an important factor in the free energy change of many macromolecular recognition and binding processes, and has been intensively studied. Despite great progresses that have been made, the global sampling remains…

Biological Physics · Physics 2012-12-04 Wenzhao Li , Kai Wang , Suyan Tian , Pu Tian

This letter seeks to illuminate the profound connection between complexity, self-organization, emergent behaviour, pattern formation, and entropy concepts that are foundational to understanding our universe. By examining these ideas through…

Adaptation and Self-Organizing Systems · Physics 2025-03-25 Vinesh Vijayan , Karpagavalli K , Sandhiya Jenifer J , Prakash R

Transfer entropy is used to establish a measure of causal relationships between two variables. Symbolic transfer entropy, as an estimation method for transfer entropy, is widely applied due to its robustness against non-stationarity. This…

Computational Complexity · Computer Science 2024-09-24 Dian Jin

This work is an enquiry into the circumstances under which entropy methods can give an answer to the questions of both quantum separability and classical correlations of a composite state. Several entropy functionals are employed to examine…

Quantum Physics · Physics 2009-11-07 A. K. Rajagopal , R. W. Rendell

Nonequilibrium complex systems are often effectively described by the mixture of different dynamics on different time scales. Superstatistics, which is "statistics of statistics" with two largely separated time scales, offers a consistent…

Statistical Mechanics · Physics 2015-05-18 Sumiyoshi Abe

In nonlinear dynamics, basins of attraction link a given set of initial conditions to its corresponding final states. This notion appears in a broad range of applications where several outcomes are possible, which is a common situation in…

Entropy can signify different things: For instance, heat transfer in thermodynamics or a measure of information in data analysis. Many entropies have been introduced and it can be difficult to ascertain their different importance and…

Mathematical Physics · Physics 2025-07-10 Henrik Jeldtoft Jensen , Piergiulio Tempesta

Entropy measures have become increasingly popular as an evaluation metric for complexity in the analysis of time series data, especially in physiology and medicine. Entropy measures the rate of information gain, or degree of regularity in a…

Methodology · Statistics 2015-12-03 Chee Chun Gan , Gerard Learmonth

Measuring the complexity of high-dimensional data in physical systems becomes a critical factor in determining the information and quality of the systems. However, traditional metrics, such as Lyapunov exponent, fractal dimension, and…

Physics and Society · Physics 2026-03-03 Seong-Gyun Im , Taewoo Kang , S. Joon Kwon

We review several statistical complexity measures proposed over the last decade and a half as general indicators of structure or correlation. Recently, Lopez-Ruiz, Mancini, and Calbet [Phys. Lett. A 209 (1995) 321] introduced another…

Statistical Mechanics · Physics 2008-02-03 David P. Feldman , James P. Crutchfield

A new combinatorial-probabilistic diagnostic entropy has been introduced. It describes the pair-wise sum of probabilities of system conditions that have to be distinguished during the diagnosing process. The proposed measure describes the…

Information Theory · Computer Science 2009-09-29 Henryk Borowczyk

We develop information-theoretic measures of spatial structure and pattern in more than one dimension. As is well known, the entropy density of a two-dimensional configuration can be efficiently and accurately estimated via a converging…

Statistical Mechanics · Physics 2009-11-07 David P. Feldman , James P. Crutchfield

Information entropy is applied to the analysis of time series generated by dynamical systems. Complexity of a temporal or spatio-temporal signal is defined as the difference between the sum of entropies of the local linear regions of the…

Chaotic Dynamics · Physics 2009-11-10 Milan Rajkovic

The profile of a sample is the multiset of its symbol frequencies. We show that for samples of discrete distributions, profile entropy is a fundamental measure unifying the concepts of estimation, inference, and compression. Specifically,…

Machine Learning · Statistics 2020-02-27 Yi Hao , Alon Orlitsky

Measure-theoretic slow entropy is a more refined invariant than the classical measure-theoretic entropy to characterize the complexity of dynamical systems with subexponential growth rates of distinguishable orbit types. In this paper we…

Dynamical Systems · Mathematics 2021-09-20 Shilpak Banerjee , Philipp Kunde , Daren Wei

We consider the dynamical behavior of Martin-L\"of random points in dynamical systems over metric spaces with a computable dynamics and a computable invariant measure. We use computable partitions to define a sort of effective symbolic…

Dynamical Systems · Mathematics 2008-04-29 Stefano Galatolo , Mathieu Hoyrup , Cristobal Rojas