English
Related papers

Related papers: Complexity-Entropy Causality Plane as a Complexity…

200 papers

We define the complexity of a continuous-time linear system to be the minimum number of bits required to describe its forward increments to a desired level of fidelity, and compute this quantity using the rate distortion function of a…

Systems and Control · Electrical Eng. & Systems 2023-06-06 Eric Wendel , John Baillieul , Joseph Hollmann

Entropy measures have become increasingly popular as an evaluation metric for complexity in the analysis of time series data, especially in physiology and medicine. Entropy measures the rate of information gain, or degree of regularity in a…

Methodology · Statistics 2015-12-03 Chee Chun Gan , Gerard Learmonth

Complex systems have become a popular lens for analyzing cities and complexity theory has many implications for urban performance and resilience. This paper develops a typology of measures and indicators for assessing the physical…

Physics and Society · Physics 2018-10-05 Geoff Boeing

Complex patterns generated by the time evolution of a one-dimensional digitalized coupled map lattice are quantitatively analyzed. A method for discerning complexity among the different patterns is implemented. The quantitative results…

Pattern Formation and Solitons · Physics 2009-11-10 Juan Sanchez , Ricardo Lopez-Ruiz

We propose a metric to characterize the complex behavior of a dynamical system and to distinguish between organized and disorganized complexity. The approach combines two quantities that separately assess the degree of unpredictability of…

Physics and Society · Physics 2020-02-17 C. Letellier , I. Leyva , I. Sendiña-Nadal

We introduce a class of information measures based on group entropies, allowing us to describe the information-theoretical properties of complex systems. These entropic measures are nonadditive, and are mathematically deduced from a series…

Statistical Mechanics · Physics 2019-10-21 Piergiulio Tempesta , Henrik Jeldtoft Jensen

In this paper we examine the concept of complexity as it applies to generative art and design. Complexity has many different, discipline specific definitions, such as complexity in physical systems (entropy), algorithmic measures of…

Neural and Evolutionary Computing · Computer Science 2021-02-05 Jon McCormack , Camilo Cruz Gambardella , Andy Lomas

Complexity is a multi-faceted phenomenon, involving a variety of features including disorder, nonlinearity, and self-organisation. We use a recently developed rigorous framework for complexity to understand measures of complexity. We…

Adaptation and Self-Organizing Systems · Physics 2020-09-22 Karoline Wiesner , James Ladyman

Entropy is a central concept in physics, but can be challenging to calculate even for systems that are easily simulated. This is exacerbated out of equilibrium, where generally little is known about the distribution characterizing simulated…

Statistical Mechanics · Physics 2024-05-09 Samuel D. Gelman , Guy Cohen

The search for patterns in time series is a very common task when dealing with complex systems. This is usually accomplished by employing a complexity measure such as entropies and fractal dimensions. However, such measures usually only…

Data Analysis, Statistics and Probability · Physics 2017-06-13 Haroldo V. Ribeiro , Max Jauregui , Luciano Zunino , Ervin K. Lenzi

Neural networks have dramatically increased our capacity to learn from large, high-dimensional datasets across innumerable disciplines. However, their decisions are not easily interpretable, their computational costs are high, and building…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mackenzie J. Meni , Ryan T. White , Michael Mayo , Kevin Pilkiewicz

This is a paper in the intersection of time series analysis and complexity theory that presents new results on permutation complexity in general and permutation entropy in particular. In this context, permutation complexity refers to the…

Information Theory · Computer Science 2021-11-08 J. M. Amigó , R. Dale , P. Tempesta

To quantify the complexity of a system, entropy-based methods have received considerable critical attentions in real-world data analysis. Among numerous entropy algorithms, amplitude-based formulas, represented by Sample Entropy, suffer…

Signal Processing · Electrical Eng. & Systems 2022-01-12 Hongjian Xiao , Danilo P. Mandic

An accurate assessment of a model's complexity is crucial for topics such as interpretation, generalization, and model selection. However, most existing complexity measures either rely on heuristic assumptions or are computationally…

Machine Learning · Statistics 2026-05-21 Oskar Allerbo , Thomas B. Schön

Complex systems are characterised by a tight, nontrivial interplay of their constituents, which gives rise to a multi-scale spectrum of emergent properties. In this scenario, it is practically and conceptually difficult to identify those…

Statistical Mechanics · Physics 2022-10-19 Roi Holtzman , Marco Giulini , Raffaello Potestio

Understanding the structural complexity and predictability of complex networks is a central challenge in network science. Although recent studies have revealed a relationship between compression-based entropy and link prediction…

Social and Information Networks · Computer Science 2025-10-14 Sebastián Brzovic , Cristóbal Rojas , Andrés Abeliuk

Permutation entropy measures the complexity of deterministic time series via a data symbolic quantization consisting of rank vectors called ordinal patterns or just permutations. The reasons for the increasing popularity of this entropy in…

Data Analysis, Statistics and Probability · Physics 2021-03-08 José M. Amigó , Roberto Dale , Piergiulio Tempesta

This article presents a multiscale, non-linear and directional statistical characterization of images based on the estimation of the skewness, flatness, entropy and distance from Gaussianity of the spatial increments. These increments are…

Fluid Dynamics · Physics 2023-10-11 Carlos Granero-Belinchon , Stéphane G. Roux , Nicolas B. Garnier

Complexity of two-level systems, e.g. spins, qubits, magnetic moments etc, are analysed based on the so-called correlational entropy in the case of pure quantum systems and the thermal entropy in case of thermal equilibrium that are…

Quantum Physics · Physics 2025-01-24 Imre Varga

A central issue of the science of complex systems is the quantitative characterization of complexity. In the present work we address this issue by resorting to information geometry. Actually we propose a constructive way to associate to a -…

Mathematical Physics · Physics 2017-12-19 Roberto Franzosi , Domenico Felice , Stefano Mancini , Marco Pettini