English
Related papers

Related papers: Measuring the Complexity of Continuous Distributio…

200 papers

Nature is full of random networks of complex topology describing such apparently disparate systems as biological, economical or informatical ones. Their most characteristic feature is the apparent scale-free character of interconnections…

Condensed Matter · Physics 2007-05-23 G. Wilk , Z. Wlodarczyk

In this paper, we provide the R\'enyi entropy and complexity measure for a novel, flexible class of skew-gaussian distributions and their related families, as a characteristic form of the skew-gaussian Shannon entropy. We give closed…

Data Analysis, Statistics and Probability · Physics 2016-05-10 Javier E. Contreras-Reyes

We present a statistical mechanics approach for the description of complex networks. We first define an energy and an entropy associated to a degree distribution which have a geometrical interpretation. Next we evaluate the distribution…

Disordered Systems and Neural Networks · Physics 2009-11-13 Ginestra Bianconi

Numerical experiments support the interesting conjecture that statistical methods be applicable not only to fully-chaotic systems, but also at the edge of chaos by using Tsallis' generalizations of the standard exponential and entropy. In…

Statistical Mechanics · Physics 2017-08-23 Marcello Lissia , Massimo Coraddu , Roberto Tonelli

Depth is a complexity measure for natural systems of the kind studied in statistical physics and is defined in terms of computational complexity. Depth quantifies the length of the shortest parallel computation required to construct a…

Popular Physics · Physics 2011-11-14 Jon Machta

This paper proposes that the mathematical relationship between an entropy distribution and its limit offers some new insight into system performance. This relationship is used to quantify variation among the entities of a system, where…

Information Theory · Computer Science 2007-07-16 Ken Krechmer

We discuss some aspects of the extension to continuous systems of a statistical measure of complexity introduced by Lopez-Ruiz, Mancini and Calbet (LMC) [Phys. Lett. A 209 (1995) 321]. In general, the extension of a magnitude from the…

Chaotic Dynamics · Physics 2009-11-07 Raquel G. Catalan , Jose Garay , Ricardo Lopez-Ruiz

We derive a composite centrality measure for general weighted and directed complex networks, based on measure standardisation and invariant statistical inheritance schemes. Different schemes generate different intermediate abstract measures…

Methodology · Statistics 2014-01-21 Andreas Joseph , Guanrong Chen

Most entropy measures depend on the spread of the probability distribution over the sample space $\mathcal{X}$, and the maximum entropy achievable scales proportionately with the sample space cardinality $|\mathcal{X}|$. For a finite…

Machine Learning · Computer Science 2023-05-25 Rohan Ghosh , Mehul Motani

Permutation entropy quantifies the diversity of possible orderings of the values a random or deterministic system can take, as Shannon entropy quantifies the diversity of values. We show that the metric and permutation entropy…

Chaotic Dynamics · Physics 2016-08-16 Jose M. Amigo , Matthew B. Kennel , Ljupco Kocarev

Statistical system models provide the basis for the examination of various sorts of distributions. Classification distributions are a very common and versatile form of statistics in e.g. real economic, social, and IT systems. The…

Computation · Statistics 2019-12-20 Uwe Petersohn , Thomas Dedek , Sandra Zimmer , Hans Biskupski

In recent studies, new measures of complexity for nonlinear systems have been proposed based on probabilistic grounds, as the LMC measure (Phys. Lett. A {\bf 209} (1995) 321) or the SDL measure (Phys. Rev. E {\bf 59} (1999) 2). All these…

adap-org · Physics 2015-06-30 Ricard V. Sole , Bartolo Luque

It is known that statistical model selection as well as identification of dynamical equations from available data are both very challenging tasks. Physical systems behave according to their underlying dynamical equations which, in turn, can…

Mathematical Physics · Physics 2017-10-11 Sean Alan Ali , Carlo Cafaro

The use of correntropy as a similarity measure has been increasing in different scenarios due to the well-known ability to extract high-order statistic information from data. Recently, a new similarity measure between complex random…

Information Theory · Computer Science 2017-10-03 João Guimarães

The paper describes an approach to measuring convergence of an algorithm to its result in terms of an entropy-like function of partitions of its inputs of a given length. The goal is to look at the algorithmic data processing from the…

Computational Complexity · Computer Science 2016-05-06 Anatol Slissenko

We consider some classes of piecewise expanding maps in finite dimensional spaces having invariant probability measures which are absolutely continuous with respect to Lebesgue measure. We derive an entropy formula for such measures and,…

Dynamical Systems · Mathematics 2018-06-05 Jose F. Alves , Antonio Pumarino

In sustained growth with random dynamics stationary distributions can exist without detailed balance. This suggests thermodynamical behavior in fast growing complex systems. In order to model such phenomena we apply both a discrete and a…

Statistical Mechanics · Physics 2017-03-22 Tamás Biró , Zoltán Néda

The generalized entropic measure, which is optimized by a given arbitrary distribution under the constraints on normalization of the distribution and the finite ordinary expectation value of a physical random quantity, is considered and its…

Statistical Mechanics · Physics 2009-11-10 Sumiyoshi Abe , G. Kaniadakis , A. M. Scarfone

The definition of complexity through Statistical Complexity Measures (SCM) has recently seen major improvements. Mostly, effort is concentrated in measures on time series. We propose a SCM definition for spatial dynamical systems. Our…

Statistical Mechanics · Physics 2015-06-17 A. Arbona , C. Bona , B. Miñano , A. Plastino

If the prior probability distributions of all possible hypothetical true means and all possible observed means of a continuous variable are conditional on the universal set of all numbers (i.e., before the nature of a study is known and a…

Methodology · Statistics 2025-06-05 Huw Llewelyn