English
Related papers

Related papers: Information-related complexity: a problem-oriented…

200 papers

Algorithmic efficiency is essential to reducing energy and time usage for computational problems. Optimizing efficiency is important for tasks involving multiple resources, for example in stochastic calculations where the size of the random…

Computational Physics · Physics 2025-07-09 Run Yan Teh , Manushan Thenabadu , Peter D Drummond

Entropy always increases monotonically in a closed system but complexity increases at first and then decreases as equilibrium is approached. Commonsense information-related definitions for entropy and complexity demonstrate that complexity…

Physics and Society · Physics 2025-03-26 Theodore Modis

Information theory and the framework of information dynamics have been used to provide tools to characterise complex systems. In particular, we are interested in quantifying information storage, information modification and information…

Information Theory · Computer Science 2013-03-25 Oliver Obst , Joschka Boedecker , Benedikt Schmidt , Minoru Asada

Self-organization in complex systems is a process in which randomness is reduced and emergent structures appear that allow the system to function in a more competitive way with other states of the system or with other systems. It occurs…

Adaptation and Self-Organizing Systems · Physics 2025-06-02 Matthew J Brouillet , Georgi Yordanov Georgiev

In designing an intelligent system that must be able to explain its reasoning to a human user, or to provide generalizations that the human user finds reasonable, it may be useful to take into consideration psychological data on what types…

Artificial Intelligence · Computer Science 2013-04-15 James E. Corter , Mark A. Gluck

A basic information theoretic model for summarization is formulated. Here summarization is considered as the process of taking a report of $v$ binary objects, and producing from it a $j$ element subset that captures most of the important…

Information Theory · Computer Science 2019-01-21 Eric Graves , Qiang Ning , Prithwish Basu

Considering electronic implications in the Information Society (IS) as a complex system, complexity science tools are used to describe the processes that are seen to be taking place. The sometimes troublesome relationship between the…

Physics and Society · Physics 2015-03-19 Noemi L. Olivera , Araceli N. Proto , Marcel Ausloos

Complex systems, from the human brain to the global economy, are made of multiple elements that interact in such ways that the behaviour of the `whole' often seems to be more than what is readily explainable in terms of the `sum of the…

Neurons and Cognition · Quantitative Biology 2021-09-28 Pedro A. M. Mediano , Fernando E. Rosas , Andrea I Luppi , Robin L. Carhart-Harris , Daniel Bor , Anil K. Seth , Adam B. Barrett

We characterize information as risk reduction between knowledge states represented by partitions of the underlying probability space. Entropy corresponds to risk reduction from no (or partial) knowledge to full knowledge about a random…

Information Theory · Computer Science 2026-02-24 Sebastian Gottwald , Daniel A. Braun

Given the constant rise in quantity and quality of data obtained from neural systems on many scales ranging from molecular to systems', information-theoretic analyses became increasingly necessary during the past few decades in the…

Information Theory · Computer Science 2013-10-08 Felix Effenberger

We introduce a class of information measures based on group entropies, allowing us to describe the information-theoretical properties of complex systems. These entropic measures are nonadditive, and are mathematically deduced from a series…

Statistical Mechanics · Physics 2019-10-21 Piergiulio Tempesta , Henrik Jeldtoft Jensen

Quantum complexity is emerging as a key property of many-body systems, including black holes, topological materials, and early quantum computers. A state's complexity quantifies the number of computational gates required to prepare the…

This work builds on a rich discourse surrounding the social brain hypothesis as well as the definition and quantification of social complexity. We believe this manuscript provides a new perspective on the topic by pairing a conceptual…

Physics and Society · Physics 2025-03-25 Etienne Lein , Cécile Aprili , Jayaditya Deep , Isaac Kazuo Uyehara

Globalised-civilisation interaction intensity grows exponentially, involving all dimensions and regions of planetary environment. The resulting dynamics of critically high, exploding complexity urgently needs consistent understanding and…

General Physics · Physics 2009-10-30 Andrei Kirilyuk , Mihaela Ulieru

The paper considers a new quantitative-qualitative proximity measure for the features of information objects, where data enters a common information resource from several sources independently. The goal is to determine the possibility of…

Artificial Intelligence · Computer Science 2026-04-08 Volodymyr Yuzefovych

Using the theory of Kolmogorov complexity the notion of facticity {\phi}(x) of a string is defined as the amount of self-descriptive information it contains. It is proved that (under reasonable assumptions: the existence of an empty machine…

Information Theory · Computer Science 2012-03-13 Pieter Adriaans

The work is devoted to study of the following problem: can we use any qualitative criteria for realization of such universal phenomenon as self-organization in open systems? We have defined values of information at fixed points of…

Adaptation and Self-Organizing Systems · Physics 2016-10-04 Zeinulla Zh. Zhanabaev , Yeldos T. Kozhagulov , Serik A. Khokhlov

Shannon information theory provides various measures of so-called "syntactic information", which reflect the amount of statistical correlation between systems. In contrast, the concept of "semantic information" refers to those correlations…

Statistical Mechanics · Physics 2022-11-22 Artemy Kolchinsky , David H. Wolpert

A measure for the complexity of a differentiable function f(x) on an interval is introduced. It is based on approximations of the function by piecewise constant functions. The measure takes into account the quality of the approximation and…

Information Theory · Computer Science 2026-05-19 Matthijs Ruijgrok

Algorithmic information theory studies description complexity and randomness and is now a well known field of theoretical computer science and mathematical logic. There are several textbooks and monographs devoted to this theory where one…

Information Theory · Computer Science 2015-04-21 Alexander Shen