English
Related papers

Related papers: Quantifying 'causality' in complex systems: Unders…

200 papers

Uncovering causal relationships in data is a major objective of data analytics. Causal relationships are normally discovered with designed experiments, e.g. randomised controlled trials, which, however are expensive or infeasible to be…

Artificial Intelligence · Computer Science 2016-11-01 Jiuyong Li , Saisai Ma , Thuc Duy Le , Lin Liu , Jixue Liu

Many dynamical phenomena in complex systems concern spreading that plays out on top of networks with changing architecture over time -- commonly known as temporal networks. A complex system's proneness to facilitate spreading phenomena,…

Physics and Society · Physics 2022-05-06 Mark M. Dekker , Raoul D. Schram , Jiamin Ou , Debabrata Panja

Transient phenomena play a key role in coordinating brain activity at multiple scales, however,their underlying mechanisms remain largely unknown. A key challenge for neural data science is thus to characterize the network interactions at…

Neurons and Cognition · Quantitative Biology 2022-09-16 Kaidi Shao , Nikos K. Logothetis , Michel Besserve

We deal here with the issue of determinism versus randomness in time series. One wishes to identify their relative weights in a given time series. Two different tools have been advanced in the literature to such effect, namely, i) the…

Transfer entropy measures directed information flow in time series, and it has become a fundamental quantity in applications spanning neuroscience, finance, and complex systems analysis. However, existing estimation methods suffer from the…

Machine Learning · Computer Science 2026-04-10 Simon Pedro Galeano Munoz , Mustapha Bounoua , Giulio Franzese , Pietro Michiardi , Maurizio Filippone

Transfer entropy (TE) is a powerful tool for measuring causal relationships within interaction networks. Traditionally, TE and its conditional variants are applied pairwise between dynamic variables to infer these causal relationships.…

Statistical Mechanics · Physics 2024-10-02 Julian Lee

We propose utilizing entropy as a diagnostic tool to distinguish between constant and dynamical dark energy models. Entropy, a measure of the system's disorder or information content, captures the complexity and evolution of the universe.…

General Relativity and Quantum Cosmology · Physics 2025-07-16 Tanisha Joshi

Recent research has explored the increasingly important role of social media by examining the dynamics of individual and group behavior, characterizing patterns of information diffusion, and identifying influential individuals. In this…

Social and Information Networks · Computer Science 2011-10-13 Greg Ver Steeg , Aram Galstyan

Complex systems are found in most branches of science. It is still argued how to best quantify their complexity and to what end. One prominent measure of complexity (the statistical complexity) has an operational meaning in terms of the…

Data Analysis, Statistics and Probability · Physics 2011-10-24 Karoline Wiesner , Mile Gu , Elisabeth Rieper , Vlatko Vedral

Discovery of causal relations is fundamental for understanding the dynamics of complex systems. While causal interactions are well defined for acyclic systems that can be separated into causally effective subsystems, a mathematical…

Data Analysis, Statistics and Probability · Physics 2017-10-11 Daniel Harnack , Erik Laminski , Klaus Richard Pawelzik

When dealing with control systems, it is useful and even necessary to assess the performance of underlying transfer functions. The functions may or may not be linear, may or may not be even monotonic. In addition, they may have structural…

Statistics Theory · Mathematics 2018-06-28 Nadezhda Gribkova , Ričardas Zitikis

Determining and measuring cause-effect relationships is fundamental to most scientific studies of natural phenomena. The notion of causation is distinctly different from correlation which only looks at association of trends or patterns in…

Methodology · Statistics 2019-10-22 Aditi Kathpalia , Nithin Nagaraj

Complex systems are characterised by a tight, nontrivial interplay of their constituents, which gives rise to a multi-scale spectrum of emergent properties. In this scenario, it is practically and conceptually difficult to identify those…

Statistical Mechanics · Physics 2022-10-19 Roi Holtzman , Marco Giulini , Raffaello Potestio

We propose a novel tensor-based formalism for inferring causal structures from time series. An information theoretical analysis of transfer entropy, shows that transfer entropy results from transmission of information over a set of…

Information Theory · Computer Science 2020-04-22 David Sigtermans

The accurate estimation of human activity in cities is one of the first steps towards understanding the structure of the urban environment. Human activities are highly granular and dynamic in spatial and temporal dimensions. Estimating…

Information Theory · Computer Science 2025-01-14 Roberto Murcio , Balamurugan Soundararaj

A central challenge in the study of complex systems is the quantification of emergence -- understood as the ability of the system to exhibit collective behaviours that cannot be traced down to the individual components. While recent work…

Beneficial to advanced computing devices, models with massive parameters are increasingly employed to extract more information to enhance the precision in describing and predicting the patterns of objective systems. This phenomenon is…

Information Theory · Computer Science 2024-03-08 Liye Jia , Fengyufan Yang , Ka Lok Man , Erick Purwanto , Sheng-Uei Guan , Jeremy Smith , Yutao Yue

Accurately determining dependency structure is critical to discovering a system's causal organization. We recently showed that the transfer entropy fails in a key aspect of this---measuring information flow---due to its conflation of dyadic…

Information Theory · Computer Science 2017-11-22 Ryan G. James , James P. Crutchfield

We extend previously proposed measures of complexity, emergence, and self-organization to continuous distributions using differential entropy. This allows us to calculate the complexity of phenomena for which distributions are known. We…

Adaptation and Self-Organizing Systems · Physics 2016-04-01 Guillermo Santamaría-Bonfil , Nelson Fernández , Carlos Gershenson

Transfer entropy (TE) captures the directed relationships between two variables. Partial transfer entropy (PTE) accounts for the presence of all confounding variables of a multivariate system and infers only about direct causality. However,…

Methodology · Statistics 2021-02-03 Angeliki Papana , Ariadni Papana-Dagiasis , Elsa Siggiridou