English
Related papers

Related papers: Quantifying high-order interdependencies on indivi…

200 papers

This article introduces a model-agnostic approach to study statistical synergy, a form of emergence in which patterns at large scales are not traceable from lower scales. Our framework leverages various multivariate extensions of Shannon's…

Information Theory · Computer Science 2019-09-18 Fernando Rosas , Pedro A. M. Mediano , Michael Gastpar , Henrik J. Jensen

O-information is an information-theoretic metric that captures the overall balance between redundant and synergistic information shared by groups of three or more variables. To complement the global assessment provided by this metric, here…

We address the problem of efficiently and informatively quantifying how multiplets of variables carry information about the future of the dynamical system they belong to. In particular we want to identify groups of variables carrying…

Neurons and Cognition · Quantitative Biology 2020-08-03 Sebastiano Stramaglia , Tomas Scagliarini , Bryan C. Daniels , Daniele Marinazzo

The analysis of scientific data and complex multivariate systems requires information quantities that capture relationships among multiple random variables. Recently, new information-theoretic measures have been developed to overcome the…

Machine Learning · Computer Science 2024-06-10 Mustapha Bounoua , Giulio Franzese , Pietro Michiardi

Higher-order information theory has become a rapidly growing toolkit in computational neuroscience, motivated by the idea that multivariate dependencies can reveal aspects of neural computation and communication that are invisible to…

Neurons and Cognition · Quantitative Biology 2025-12-03 D. Rebbin , K. J. A. Down , T. F. Varley , R. Ince , A. Canales-Johnson

Time series analysis has proven to be a powerful method to characterize several phenomena in biology, neuroscience and economics, and to understand some of their underlying dynamical features. Despite a plethora of methods have been…

Physics and Society · Physics 2023-03-01 Andrea Santoro , Federico Battiston , Giovanni Petri , Enrico Amico

Systems of interest for theoretical or experimental work often exhibit high-order interactions, corresponding to statistical interdependencies in groups of variables that cannot be reduced to dependencies in subsets of them. While still…

Information Theory · Computer Science 2024-04-11 Fernando E. Rosas , Pedro A. M. Mediano , Michael Gastpar

Battiston et al. (arXiv:2110.06023) provide a comprehensive overview of how investigations of complex systems should take into account interactions between more than two elements, which can be modelled by hypergraphs and studied via…

Our understanding of complex systems rests on our ability to characterise how they perform distributed computation and integrate information. Advances in information theory have introduced several quantities to describe complex information…

Information Theory · Computer Science 2026-04-13 Alberto Liardi , George Blackburne , Hardik Rajpal , Fernando E. Rosas , Pedro A. M. Mediano

Identifying patterns of relations among the units of a complex system from measurements of their activities in time is a fundamental problem with many practical applications. Here, we introduce a method that detects dependencies of any…

Physics and Society · Physics 2026-03-09 Andrea Civilini , Fabrizio de Vico Fallani , Vito Latora

Ordinal pattern dependence is a multivariate dependence measure based on the co-movement of two time series. In strong connection to ordinal time series analysis, the ordinal information is taken into account to derive robust results on the…

Statistics Theory · Mathematics 2021-06-09 Ines Nüßgen , Alexander Schnurr

Here, we leverage recent advances in information theory to develop a novel method to characterise the dominant character of the high-order dependencies of quantum systems. To this end, we introduce the Q-information: an…

Recent research has provided a wealth of evidence highlighting the pivotal role of high-order interdependencies in supporting the information-processing capabilities of distributed complex systems. These findings may suggest that high-order…

Adaptation and Self-Organizing Systems · Physics 2023-05-24 Patricio Orio , Pedro A. M. Mediano , Fernando E. Rosas

Information-theoretic quantities reveal dependencies among variables in the structure of joint, marginal, and conditional entropies, but leave some fundamentally different systems indistinguishable. Furthermore, there is no consensus on how…

Information Theory · Computer Science 2023-05-09 Abel Jansma

High-order phenomena play crucial roles in many systems of interest, but their analysis is often highly nontrivial. There is a rich literature providing a number of alternative information-theoretic quantities capturing high-order…

Information Theory · Computer Science 2024-10-15 Fernando E. Rosas , Aaron Gutknecht , Pedro A. M. Mediano , Michael Gastpar

While the standard network description of complex systems is based on quantifying links between pairs of system units, higher-order interactions (HOIs) involving three or more units play a major role in governing the collective network…

High-order interdependencies are central features of complex systems, yet a mechanistic explanation for their emergence remains elusive. Currently, it is unknown under what conditions high-order interdependencies, quantified by the…

Physics and Society · Physics 2026-03-03 Enrico Caprioglio , Pedro A. M. Mediano , Luc Berthouze

Extracting higher-order structures from multivariate data has become an area of intensive study in complex systems science, as these multipartite interactions can reveal insights into fundamental features of complex systems like emergent…

Information Theory · Computer Science 2026-01-14 Thomas F. Varley

Many complex systems often contain interactions between more than two nodes, known as higher-order interactions, which can change the structure of these systems in significant ways. Researchers often assume that all interactions paint a…

Physics and Society · Physics 2024-02-16 Nicholas W. Landry , Ilya Amburg , Mirah Shi , Sinan G. Aksoy

Distributed systems, such as biological and artificial neural networks, process information via complex interactions engaging multiple subsystems, resulting in high-order patterns with distinct properties across scales. Investigating how…

Information Theory · Computer Science 2025-04-23 Aaron J. Gutknecht , Fernando E. Rosas , David A. Ehrlich , Abdullah Makkeh , Pedro A. M. Mediano , Michael Wibral
‹ Prev 1 2 3 10 Next ›