English
Related papers

Related papers: Three Perspectives on Complexity $-$ Entropy, Comp…

200 papers

This is a paper in the intersection of time series analysis and complexity theory that presents new results on permutation complexity in general and permutation entropy in particular. In this context, permutation complexity refers to the…

Information Theory · Computer Science 2021-11-08 J. M. Amigó , R. Dale , P. Tempesta

We consider a simplified version of a solvable model by Mandal and Jarzynski, which constructively demonstrates the interplay between work extraction and the increase of the Shannon entropy of an information reservoir which is in contact…

Statistical Mechanics · Physics 2015-03-31 Neri Merhav

We review several statistical complexity measures proposed over the last decade and a half as general indicators of structure or correlation. Recently, Lopez-Ruiz, Mancini, and Calbet [Phys. Lett. A 209 (1995) 321] introduced another…

Statistical Mechanics · Physics 2008-02-03 David P. Feldman , James P. Crutchfield

There is no single definition of complexity (Edmonds 1999; Gershenson 2008; Mitchell 2009; De Domenico, et al., 2019), as it acquires different meanings in different contexts. A general notion is the amount of information required to…

Adaptation and Self-Organizing Systems · Physics 2021-02-26 Carlos Gershenson

The LMC complexity, an indicator of complexity based on a probabilistic description, is revisited. A straightforward approach allows us to establish the time evolution of this indicator in a near-equilibrium situation and gives us a new…

Adaptation and Self-Organizing Systems · Physics 2016-09-08 Ricardo Lopez-Ruiz

A new complexity measure named as Lattice Complexity is presented for finite symbolic sequences. This measure is based on the symbolic dynamics of one-dimensional iterative maps and Lempel-Ziv Complexity. To make Lattice Complexity…

Chaotic Dynamics · Physics 2008-04-05 Da-Guan Ke , Hong Zhang , Qin-Ye Tong

Pseudoentropy characterizations provide a quantitatively precise demonstration of the close relationship between computational hardness and computational randomness. We prove a unified pseudoentropy characterization that generalizes and…

Computational Complexity · Computer Science 2025-09-05 Lunjia Hu , Salil Vadhan

The notion of slow entropy, both upper and lower slow entropy, was defined by Katok and Thouvenot as a more refined measure of complexity for dynamical systems, than the classical Kolmogorov-Sinai entropy. For any subexponential rate…

Dynamical Systems · Mathematics 2020-07-17 Terry Adams

Network or graph structures are ubiquitous in the study of complex systems. Often, we are interested in complexity trends of these system as it evolves under some dynamic. An example might be looking at the complexity of a food web as…

Information Theory · Computer Science 2012-01-23 Russell K. Standish

The definition of complexity through Statistical Complexity Measures (SCM) has recently seen major improvements. Mostly, effort is concentrated in measures on time series. We propose a SCM definition for spatial dynamical systems. Our…

Statistical Mechanics · Physics 2015-06-17 A. Arbona , C. Bona , B. Miñano , A. Plastino

It is not obvious how to extend Shannon's original information entropy to higher dimensions, and many different approaches have been tried. We replace the English text symbol sequence originally used to illustrate the theory by a discrete,…

Information Theory · Computer Science 2016-09-06 Kieran G. Larkin

Shannon's entropy is a definitive lower bound for statistical compression. Unfortunately, no such clear measure exists for the compressibility of repetitive strings. Thus, ad hoc measures are employed to estimate the repetitiveness of…

Data Structures and Algorithms · Computer Science 2023-11-16 Giulia Bernardini , Gabriele Fici , Paweł Gawrychowski , Solon P. Pissis

Complex systems are found in most branches of science. It is still argued how to best quantify their complexity and to what end. One prominent measure of complexity (the statistical complexity) has an operational meaning in terms of the…

Data Analysis, Statistics and Probability · Physics 2011-10-24 Karoline Wiesner , Mile Gu , Elisabeth Rieper , Vlatko Vedral

We introduce and discuss the notion of monotonicity for the complexity measures of general probability distributions, patterned after the resource theory of quantum entanglement. Then, we explore whether this property is satisfied by the…

Data Analysis, Statistics and Probability · Physics 2016-01-20 Łukasz Rudnicki , Irene V. Toranzo , Pablo Sanchez-Moreno , Jesus S. Dehesa

Since human randomness production has been studied and widely used to assess executive functions (especially inhibition), many measures have been suggested to assess the degree to which a sequence is random-like. However, each of them…

Computational Complexity · Computer Science 2013-12-10 Nicolas Gauvrit , Hector Zenil , Jean-Paul Delahaye , Fernando Soler-Toscano

On account of a greater need for understanding the complexity of time series like physiological time series, financial time series, and many more that enter into picture for their inculpation with real-world problems, several complexity…

Chaotic Dynamics · Physics 2025-02-26 Ritik Roshan Giri , Suchandan Kayal

Complexity measures are essential to understand complex systems and there are numerous definitions to analyze one-dimensional data. However, extensions of these approaches to two or higher-dimensional data, such as images, are much less…

Data Analysis, Statistics and Probability · Physics 2012-12-27 H. V. Ribeiro , L. Zunino , E. K. Lenzi , P. A. Santoro , R. S. Mendes

In this paper, we present some results on information, complexity and entropy as defined below and we discuss their relations with the Kolmogorov-Sinai entropy which is the most important invariant of a dynamical system. These results have…

Dynamical Systems · Mathematics 2019-08-17 Vieri Benci , Claudio Bonanno , Stefano Galatolo , Giulia Menconi , Federico Ponchio

Complexity is a multi-faceted phenomenon, involving a variety of features including disorder, nonlinearity, and self-organisation. We use a recently developed rigorous framework for complexity to understand measures of complexity. We…

Adaptation and Self-Organizing Systems · Physics 2020-09-22 Karoline Wiesner , James Ladyman

Quantification of complexity in neurophysiological signals has been studied using different methods, especially those from information or dynamical system theory. These studies revealed the dependence on different states of consciousness,…

Neurons and Cognition · Quantitative Biology 2017-01-26 D. M. Mateos , R. Guevara Erra , R. Wennberg , J. L. Perez Velazquez