English
Related papers

Related papers: A scalable estimator of higher-order information i…

200 papers

Despite broad interest in self-organizing systems, there are few quantitative, experimentally-applicable criteria for self-organization. The existing criteria all give counter-intuitive results for important cases. In this Letter, we…

Adaptation and Self-Organizing Systems · Physics 2011-11-10 Cosma Rohilla Shalizi , Kristina Lisa Shalizi , Robert Haslinger

The apparent dichotomy between information-processing and dynamical approaches to complexity science forces researchers to choose between two diverging sets of tools and explanations, creating conflict and often hindering scientific…

Neurons and Cognition · Quantitative Biology 2022-01-26 Pedro A. M. Mediano , Fernando E. Rosas , Juan Carlos Farah , Murray Shanahan , Daniel Bor , Adam B. Barrett

Mutual Information (MI) is a powerful statistical measure that quantifies shared information between random variables, particularly valuable in high-dimensional data analysis across fields like genomics, natural language processing, and…

Machine Learning · Computer Science 2024-12-02 Andre O. Falcao

We address the problem of efficiently and informatively quantifying how multiplets of variables carry information about the future of the dynamical system they belong to. In particular we want to identify groups of variables carrying…

Neurons and Cognition · Quantitative Biology 2020-08-03 Sebastiano Stramaglia , Tomas Scagliarini , Bryan C. Daniels , Daniele Marinazzo

Extracting higher-order structures from multivariate data has become an area of intensive study in complex systems science, as these multipartite interactions can reveal insights into fundamental features of complex systems like emergent…

Information Theory · Computer Science 2026-01-14 Thomas F. Varley

Information theory is an outstanding framework to measure uncertainty, dependence and relevance in data and systems. It has several desirable properties for real world applications: it naturally deals with multivariate data, it can handle…

Machine Learning · Statistics 2024-10-30 Valero Laparra , J. Emmanuel Johnson , Gustau Camps-Valls , Raul Santos-Rodríguez , Jesus Malo

The development of next-generation networking systems has inherently shifted from throughput-based paradigms towards intelligent, information-aware designs that emphasize the quality, relevance, and utility of transmitted information,…

Networking and Internet Architecture · Computer Science 2025-07-29 Beining Wu , Jun Huang , Shui Yu

Mutual information (MI) is a fundamental measure of statistical dependence between two variables, yet accurate estimation from finite data remains notoriously difficult. No estimator is universally reliable, and common approaches fail in…

Data Analysis, Statistics and Probability · Physics 2025-10-02 Eslam Abdelaleem , K. Michael Martini , Ilya Nemenman

Here, we leverage recent advances in information theory to develop a novel method to characterise the dominant character of the high-order dependencies of quantum systems. To this end, we introduce the Q-information: an…

High-order, beyond-pairwise interdependencies are at the core of biological, economic, and social complex systems, and their adequate analysis is paramount to understand, engineer, and control such systems. This paper presents a framework…

Data Analysis, Statistics and Probability · Physics 2022-06-06 Tomas Scagliarini , Daniele Marinazzo , Yike Guo , Sebastiano Stramaglia , Fernando E. Rosas

Information theory and the framework of information dynamics have been used to provide tools to characterise complex systems. In particular, we are interested in quantifying information storage, information modification and information…

Information Theory · Computer Science 2013-03-25 Oliver Obst , Joschka Boedecker , Benedikt Schmidt , Minoru Asada

One of the hallmarks of biological organisms is their ability to integrate disparate information sources to optimize their behavior in complex environments. How this capability can be quantified and related to the functional complexity of…

Populations and Evolution · Quantitative Biology 2011-11-08 Jeffrey Edlund , Nicolas Chaumont , Arend Hintze , Christof Koch , Giulio Tononi , Christoph Adami

Quantifying the dependence between high-dimensional random variables is central to statistical learning and inference. Two classical methods are canonical correlation analysis (CCA), which identifies maximally correlated projected versions…

Machine Learning · Computer Science 2023-09-29 Dor Tsur , Ziv Goldfeld , Kristjan Greenewald

We propose a novel measure to assess the presence of meso-scale structures in complex networks. This measure is based on the identification of regular patterns in the adjacency matrix of the network, and on the calculation of the quantity…

Physics and Society · Physics 2015-06-18 Massimiliano Zanin , Pedro A. Sousa , Ernestina Menasalvas

One of the most complex tasks of decision making and planning is to gather information. This task becomes even more complex when the state is high-dimensional and its belief cannot be expressed with a parametric distribution. Although the…

Artificial Intelligence · Computer Science 2022-09-26 Gilad Rotman , Vadim Indelman

Recent research has provided a wealth of evidence highlighting the pivotal role of high-order interdependencies in supporting the information-processing capabilities of distributed complex systems. These findings may suggest that high-order…

Adaptation and Self-Organizing Systems · Physics 2023-05-24 Patricio Orio , Pedro A. M. Mediano , Fernando E. Rosas

A steadily growing computational power is employed to perform molecular dynamics simulations of biological macromolecules, which represents at the same time an immense opportunity and a formidable challenge. In fact, large amounts of data…

Soft Condensed Matter · Physics 2022-05-18 Margherita Mele , Roberto Covino , Raffaello Potestio

The maximal information coefficient (MIC), which measures the amount of dependence between two variables, is able to detect both linear and non-linear associations. However, computational cost grows rapidly as a function of the dataset…

Information Theory · Computer Science 2015-08-18 Ali Mousavi , Richard G. Baraniuk

It is a challenge to manage complex systems efficiently without confronting NP-hard problems. To address the situation we suggest to use self-organization processes of prime integer relations for information processing. Self-organization…

Computational Complexity · Computer Science 2007-10-23 Victor Korotkikh , Galina Korotkikh

Context dependence is central to the description of complexity. Keying on the pairwise definition of "set complexity" we use an information theory approach to formulate general measures of systems complexity. We examine the properties of…

Information Theory · Computer Science 2013-08-21 David J. Galas , Nikita A. Sakhanenko , Alexander Skupin , Tomasz Ignac