English
Related papers

Related papers: Quantifying 'causality' in complex systems: Unders…

200 papers

A measure is derived to quantify directed information transfer between pairs of vertices in a weighted network, over paths of a specified maximal length. Our approach employs a general, probabilistic model of network traffic, from which the…

Disordered Systems and Neural Networks · Physics 2013-11-05 Christopher R. S. Banerji , Simone Severini , Andrew E. Teschendorff

An information theoretic measure is derived that quantifies the statistical coherence between systems evolving in time. The standard time delayed mutual information fails to distinguish information that is actually exchanged from shared…

Chaotic Dynamics · Physics 2009-10-31 Thomas Schreiber

Using symmetric boundary conditions at separated times, I show analytically that both the time ordering of (macroscopic) causality and the direction of entropy increase follow from these boundary conditions. In particular, when the…

Statistical Mechanics · Physics 2007-05-23 L. S. Schulman

While it is an important problem to identify the existence of causal associations between two components of a multivariate time series, a topic addressed in Runge et al. (2012), it is even more important to assess the strength of their…

Data Analysis, Statistics and Probability · Physics 2015-07-15 Jakob Runge , Jobst Heitzig , Norbert Marwan , Jürgen Kurths

The intuition of causation is so fundamental that almost every research study in life sciences refers to this concept. However a widely accepted formal definition of causal influence between observables is still missing. In the framework of…

Other Statistics · Statistics 2017-04-26 Andrea Auconi , Andrea Giansanti , Edda Klipp

We introduce an approach which allows detecting causal relationships between variables for which the time evolution is available. Causality is assessed by a variational scheme based on the Information Imbalance of distance ranks, a…

Methodology · Statistics 2024-05-07 Vittorio Del Tatto , Gianfranco Fortunato , Domenica Bueti , Alessandro Laio

This study addresses the problem of learning a summary causal graph on time series with potentially different sampling rates. To do so, we first propose a new causal temporal mutual information measure for time series. We then show how this…

Artificial Intelligence · Computer Science 2023-11-03 Charles K. Assaad , Emilie Devijver , Eric Gaussier

In this article we present a methodology to estimate the Transfer Entropy Rate between two systems through the Lempel-Ziv complexity. This methodology carries a set of practical advantages: it can be estimated from two single discrete…

Applications · Statistics 2020-05-20 Juan F. Restrepo , Diego M. Mateos , Gastón Schlotthauer

To quantify the complexity of a system, entropy-based methods have received considerable critical attentions in real-world data analysis. Among numerous entropy algorithms, amplitude-based formulas, represented by Sample Entropy, suffer…

Signal Processing · Electrical Eng. & Systems 2022-01-12 Hongjian Xiao , Danilo P. Mandic

Bell's theorem shows that our intuitive understanding of causation must be overturned in light of quantum correlations. Nevertheless, quantum mechanics does not permit signalling and hence a notion of cause remains. Understanding this…

Quantum Physics · Physics 2016-10-19 Mirjam Weilenmann , Roger Colbeck

In statistical physics, if we successively divide an equilibrium system into two parts, we will face a situation that, within a certain length $\xi$, the physics of a subsystem is no longer the same as the original system. Then the…

Quantum Physics · Physics 2009-11-13 Shi-Jian Gu , Chang-Pu Sun , Hai-Qing Lin

Neural networks have dramatically increased our capacity to learn from large, high-dimensional datasets across innumerable disciplines. However, their decisions are not easily interpretable, their computational costs are high, and building…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mackenzie J. Meni , Ryan T. White , Michael Mayo , Kevin Pilkiewicz

Intrinsic computation refers to how dynamical systems store, structure, and transform historical and spatial information. By graphing a measure of structural complexity against a measure of randomness, complexity-entropy diagrams display…

Chaotic Dynamics · Physics 2009-11-13 David P. Feldman , Carl S. McTague , James P. Crutchfield

A novel heuristic approach is proposed here for time series data analysis, dubbed Generalized weighted permutation entropy, which amalgamates and generalizes beyond their original scope two well established data analysis methods:…

Statistical Mechanics · Physics 2022-10-19 Darko Stosic , Dusan Stosic , Tatijana Stosic , Borko Stosic

Inferring nonlinear and asymmetric causal relationships between multivariate longitudinal data is a challenging task with wide-ranging application areas including clinical medicine, mathematical biology, economics and environmental…

Methodology · Statistics 2021-08-25 Tom Edinburgh , Stephen J. Eglen , Ari Ercole

The broad concept of emergence is instrumental in various of the most challenging open scientific questions -- yet, few quantitative theories of what constitutes emergent phenomena have been proposed. This article introduces a formal theory…

Neurons and Cognition · Quantitative Biology 2021-01-27 Fernando E. Rosas , Pedro A. M. Mediano , Henrik J. Jensen , Anil K. Seth , Adam B. Barrett , Robin L. Carhart-Harris , Daniel Bor

Causal structures give us a way to understand the origin of observed correlations. These were developed for classical scenarios, but quantum mechanical experiments necessitate their generalisation. Here we study causal structures in a broad…

Quantum Physics · Physics 2021-06-30 Mirjam Weilenmann , Roger Colbeck

We derive a functional for the entropy contributed by any microscopic degrees of freedom as arising from their measurable pair correlations. Applicable both in and out of equilibrium, this functional yields the maximum entropy which a…

Statistical Mechanics · Physics 2023-02-17 Benjamin Sorkin , Joshua Ricouvier , Haim Diamant , Gil Ariel

Causality defines the relationship between cause and effect. In multivariate time series field, this notion allows to characterize the links between several time series considering temporal lags. These phenomena are particularly important…

Methodology · Statistics 2023-06-01 Antonin Arsac , Aurore Lomet , Jean-Philippe Poli

Entropic causal inference is a recent framework for learning the causal graph between two variables from observational data by finding the information-theoretically simplest structural explanation of the data, i.e., the model with smallest…

Machine Learning · Computer Science 2025-09-23 Spencer Compton , Kristjan Greenewald , Dmitriy Katz , Murat Kocaoglu