English
Related papers

Related papers: A unified framework for information integration ba…

200 papers

The entropy is a measure of uncertainty that plays a central role in information theory. When the distribution of the data is unknown, an estimate of the entropy needs be obtained from the data sample itself. We propose a semi-parametric…

Methodology · Statistics 2022-01-06 Stéphane Robin , Luca Scrucca

We develop a general formalism for representing and understanding structure in complex systems. In our view, structure is the totality of relationships among a system's components, and these relationships can be quantified using information…

Statistical Mechanics · Physics 2014-09-17 Benjamin Allen , Blake C. Stacey , Yaneer Bar-Yam

Describing and understanding the essence of quantum entanglement and its connection to dynamical chaos is of great scientific interest. In this work, using information geometric (IG) techniques, we investigate the effects of…

Mathematical Physics · Physics 2015-05-27 D. -H. Kim , S. A. Ali , C. Cafaro , S. Mancini

After discussing the significance of interactions to understand complex multiscale stochastic systems (CMSS), we turn our attention to the construction of a Generalised Theory of Interactions (GToI). We define interactions as discrete,…

Physics and Society · Physics 2024-03-06 Santiago Núñez-Corrales , Eric Jakobsson

A core feature of complex systems is that the interactions between elements in the present causally constrain each-other as the system evolves through time. To fully model all of these interactions (between elements, as well as ensembles of…

Neurons and Cognition · Quantitative Biology 2023-04-26 Thomas F. Varley

In this work, we study generalized entropies and information geometry in a group-theoretical framework. We explore the conditions that ensure the existence of some natural properties and at the same time of a group-theoretical structure for…

Mathematical Physics · Physics 2021-08-03 Miguel A. Rodríguez , Álvaro Romaniega , Piergiulio Tempesta

In this paper, we report our latest research on a novel theoretical information-geometric framework suitable to characterize chaotic dynamical behavior of arbitrary complex systems on curved statistical manifolds. Specifically, an…

Mathematical Physics · Physics 2009-11-13 Carlo Cafaro

A central issue of the science of complex systems is the quantitative characterization of complexity. In the present work we address this issue by resorting to information geometry. Actually we propose a constructive way to associate to a -…

Mathematical Physics · Physics 2017-12-19 Roberto Franzosi , Domenico Felice , Stefano Mancini , Marco Pettini

The entropy of a pair of random variables is commonly depicted using a Venn diagram. This representation is potentially misleading, however, since the multivariate mutual information can be negative. This paper presents new measures of…

Information Theory · Computer Science 2020-04-22 Conor Finn , Joseph T. Lizier

I review recent works showing that information geometry is a useful framework to characterize quantum coherence and entanglement. Quantum systems exhibit peculiar properties which cannot be justified by classical physics, e.g. quantum…

Quantum Physics · Physics 2018-10-08 Davide Girolami

A well-interpretable measure of information has been recently proposed based on a partition obtained by intersecting a random sequence with its moving average. The partition yields disjoint sets of the sequence, which are then ranked…

Statistical Finance · Quantitative Finance 2018-08-01 Linda Ponta , Anna Carbone

An important issue during an engineering design process is to develop an understanding which design parameters have the most influence on the performance. Especially in the context of optimization approaches this knowledge is crucial in…

Information Theory · Computer Science 2024-10-28 Patricia Wollstadt , Sebastian Schmitt

I present a framework based on the concepts of diversity and coherence for the analysis of knowledge integration and diffusion. Visualisations that help understand insights gained are also introduced. The key novelty offered by this…

Physics and Society · Physics 2014-12-23 Ismael Rafols

We consider a collection of distributed units that interact with one another through the sending of messages. Each message carries a positive ($+1$) or negative ($-1$) tag and causes the receiving unit to send out messages as a function of…

Neurons and Cognition · Quantitative Biology 2017-01-12 Valmir C. Barbosa

Effective analysis in neuroscience benefits significantly from robust conceptual frameworks. Traditional metrics of interbrain synchrony in social neuroscience typically depend on fixed, correlation-based approaches, restricting their…

Neurons and Cognition · Quantitative Biology 2025-12-01 Nicolás Hinrichs , Noah Guzmán , Melanie Weber

Originally conceived as a theory of consciousness, integrated information theory (IIT) provides a theoretical framework intended to characterize the compositional causal information that a system, in its current state, specifies about…

Quantum Physics · Physics 2023-03-22 Larissa Albantakis , Robert Prentner , Ian Durham

Appealing to several multivariate information measures---some familiar, some new here---we analyze the information embedded in discrete-valued stochastic time series. We dissect the uncertainty of a single observation to demonstrate how the…

Information Theory · Computer Science 2015-05-28 Ryan G. James , Christopher J. Ellison , James P. Crutchfield

Psychological network approaches propose to see symptoms or questionnaire items as interconnected nodes, with links between them reflecting pairwise statistical dependencies evaluated cross-sectional, time-series, or panel data. These…

The apparent dichotomy between information-processing and dynamical approaches to complexity science forces researchers to choose between two diverging sets of tools and explanations, creating conflict and often hindering scientific…

Neurons and Cognition · Quantitative Biology 2022-01-26 Pedro A. M. Mediano , Fernando E. Rosas , Juan Carlos Farah , Murray Shanahan , Daniel Bor , Adam B. Barrett

Finding interdependency relations between (possibly multivariate) time series provides valuable knowledge about the processes that generate the signals. Information theory sets a natural framework for non-parametric measures of several…

Information Theory · Computer Science 2016-02-09 German Gomez-Herrero , Wei Wu , Kalle Rutanen , Miguel C. Soriano , Gordon Pipa , Raul Vicente