English
Related papers

Related papers: Statistical Measures of Complexity: Why?

200 papers

Concepts used in the scientific study of complex systems have become so widespread that their use and abuse has led to ambiguity and confusion in their meaning. In this paper we use information theory to provide abstract and concise…

Information Theory · Computer Science 2012-11-16 Carlos Gershenson , Nelson Fernandez

It is discussed how the superstatistical formulation of effective Boltzmann factors can be related to the concept of Kolmogorov complexity, generating an infinite set of complexity measures (CMs) for quantifying information. At this level,…

Computational Complexity · Computer Science 2021-01-25 Jesús Fuentes , Octavio Obregón

We study correlation measures for complex systems. First, we investigate some recently proposed measures based on information geometry. We show that these measures can increase under local transformations as well as under discarding…

Adaptation and Self-Organizing Systems · Physics 2012-04-20 Tobias Galla , Otfried Gühne

Recently it has been argued that entropy can be a direct measure of complexity, where the smaller value of entropy indicates lower system complexity, while its larger value indicates higher system complexity. We dispute this view and…

Statistical Mechanics · Physics 2020-08-26 Jarosław Klamut , Ryszard Kutner , Zbigniew R. Struzik

We investigate the role of a statistical complexity measure to assign equilibration in isolated quantum systems. While unitary dynamics preserve global purity, expectation values of observables often exhibit equilibration-like behavior,…

Quantum Physics · Physics 2025-08-14 Marcos G. Alpino , Tiago Debarba , Reinaldo O. Vianna , André T. Cesário

While we have intuitive notions of structure and complexity, the formalization of this intuition is non-trivial. The statistical complexity is a popular candidate. It is based on the idea that the complexity of a process can be quantified…

Quantum Physics · Physics 2014-09-24 Ryan Tan , Daniel R. Terno , Jayne Thompson , Vlatko Vedral , Mile Gu

This paper introduces a comprehensive framework for complex-valued probability measures and explores their novel applications in information theory and statistical analysis. We define a complex probability measure as a phase-modulated…

Information Theory · Computer Science 2026-03-16 Siang Cheng , Hejun Xu , Tianxiao Pang

Shannon Entropy has been extensively used for characterizing complexity of time series arising from chaotic dynamical systems and stochastic processes such as Markov chains. However, for short and noisy time series, Shannon entropy performs…

Chaotic Dynamics · Physics 2016-12-08 Nithin Nagaraj , Karthi Balasubramanian

Ensemble of initial conditions for nonlinear maps can be described in terms of entropy. This ensemble entropy shows an asymptotic linear growth with rate K. The rate K matches the logarithm of the corresponding asymptotic sensitivity to…

Statistical Mechanics · Physics 2011-01-04 Massmimo Coraddu , Marcello Lissia , Roberto Tonelli

A constraint satisfaction problem (CSP) is a computational problem where the input consists of a finite set of variables and a finite set of constraints, and where the task is to decide whether there exists a satisfying assignment of values…

Computational Complexity · Computer Science 2019-04-23 Manuel Bodirsky

In contrast to entropy, which increases monotonically, the "complexity" or "interestingness" of closed systems seems intuitively to increase at first and then decrease as equilibrium is approached. For example, our universe lacked complex…

Statistical Mechanics · Physics 2014-05-28 Scott Aaronson , Sean M. Carroll , Lauren Ouellette

Complexity is an important metric for appropriate characterization of different classes of irregular signals, observed in the laboratory or in nature. The literature is already rich in the description of such measures using a variety of…

Several well-known statistical measures similar to \emph{LMC} and \emph{Fisher-Shannon} complexity have been computed for confined hydrogen atom in both position ($r$) and momentum ($p$) spaces. Further, a more generalized form of these…

Quantum Physics · Physics 2019-04-05 Sangita Majumdar , Neetik Mukherjee , Amlan K. Roy

On account of a greater need for understanding the complexity of time series like physiological time series, financial time series, and many more that enter into picture for their inculpation with real-world problems, several complexity…

Chaotic Dynamics · Physics 2025-02-26 Ritik Roshan Giri , Suchandan Kayal

We present a novel notion of complexity that interpolates between and generalizes some classic existing complexity notions in learning theory: for estimators like empirical risk minimization (ERM) with arbitrary bounded losses, it is upper…

Machine Learning · Computer Science 2017-10-24 Peter D. Grünwald , Nishant A. Mehta

It is not obvious what fraction of all the potential information residing in the molecules and structures of living systems is significant or meaningful to the system. Sets of random sequences or identically repeated sequences, for example,…

Information Theory · Computer Science 2008-01-28 David J. Galas , Matti Nykter , Gregory W. Carter , Nathan D. Price , Ilya Shmulevich

We propose a metric to characterize the complex behavior of a dynamical system and to distinguish between organized and disorganized complexity. The approach combines two quantities that separately assess the degree of unpredictability of…

Physics and Society · Physics 2020-02-17 C. Letellier , I. Leyva , I. Sendiña-Nadal

Despite broad interest in self-organizing systems, there are few quantitative, experimentally-applicable criteria for self-organization. The existing criteria all give counter-intuitive results for important cases. In this Letter, we…

Adaptation and Self-Organizing Systems · Physics 2011-11-10 Cosma Rohilla Shalizi , Kristina Lisa Shalizi , Robert Haslinger

Complex systems have become a popular lens for analyzing cities and complexity theory has many implications for urban performance and resilience. This paper develops a typology of measures and indicators for assessing the physical…

Physics and Society · Physics 2018-10-05 Geoff Boeing

A practical measure for the complexity of sequences of symbols (``strings'') is introduced that is rooted in automata theory but avoids the problems of Kolmogorov-Chaitin complexity. This physical complexity can be estimated for ensembles…

adap-org · Physics 2009-10-28 C. Adami , N. J. Cerf