English
Related papers

Related papers: Quantifying Causal Coupling Strength: A Lag-specif…

200 papers

The present paper is devoted to investigation of the entropy reduction and entanglement-assisted classical capacity (information gain) of continuous variable quantum measurements. These quantities are computed explicitly for multimode…

Quantum Physics · Physics 2020-08-31 A. S. Holevo , A. A. Kuznetsova

The paper investigates the link between Granger causality graphs recently formalized by Eichler and directed information theory developed by Massey and Kramer. We particularly insist on the implication of two notions of causality that may…

Information Theory · Computer Science 2012-03-27 Pierre-Olivier Amblard , Olivier J. J. Michel

Complex systems are large collections of entities that organize themselves into non-trivial structures that can be represented by networks. A key emergent property of such systems is robustness against random failures or targeted attacks…

Physics and Society · Physics 2021-06-14 Arsham Ghavasieh , Massimo Stella , Jacob Biamonte , Manlio De Domenico

We define a metric, mutual information in frequency (MI-in-frequency), to detect and quantify the statistical dependence between different frequency components in the data, referred to as cross-frequency coupling and apply it to…

Neurons and Cognition · Quantitative Biology 2018-05-23 Rakesh Malladi , Don H Johnson , Giridhar P Kalamangalam , Nitin Tandon , Behnaam Aazhang

Originally conceived as a theory of consciousness, integrated information theory (IIT) provides a theoretical framework intended to characterize the compositional causal information that a system, in its current state, specifies about…

Quantum Physics · Physics 2023-03-22 Larissa Albantakis , Robert Prentner , Ian Durham

Complexity measures in the context of the Integrated Information Theory of consciousness try to quantify the strength of the causal connections between different neurons. This is done by minimizing the KL-divergence between a full system…

Methodology · Statistics 2021-02-09 Carlotta Langer , Nihat Ay

This study addresses the problem of learning a summary causal graph on time series with potentially different sampling rates. To do so, we first propose a new causal temporal mutual information measure for time series. We then show how this…

Artificial Intelligence · Computer Science 2023-11-03 Charles K. Assaad , Emilie Devijver , Eric Gaussier

Measurement-induced phase transitions (MIPT) give rise to novel dynamical states of quantum matter realized by balancing unitary evolution and measurements. We present large-scale numerical simulations of a trapped-ion native MIPT, argued…

Quantum Physics · Physics 2026-02-06 Liuke Lyu , James Allen , Yi Hong Teoh , Roger G Melko , William Witczak-Krempa

Entropy governs molecular self-assembly, phase transitions, and material stability, yet remains challenging to quantify and directly control in molecular systems. Here, we demonstrate that the computable information density (CID), a data…

Statistical Mechanics · Physics 2026-02-27 Ashley Z. Guo , Kaelyn Chang , Nicholas J. Corrente

In this work, we are interested in structure learning for a set of spatially distributed dynamical systems, where individual subsystems are coupled via latent variables and observed through a filter. We represent this model as a directed…

Artificial Intelligence · Computer Science 2016-11-03 Oliver M. Cliff , Mikhail Prokopenko , Robert Fitch

Multiple metrics have been developed to detect causality relations between data describing the elements constituting complex systems, all of them considering their evolution through time. Here we propose a metric able to detect causality…

Data Analysis, Statistics and Probability · Physics 2016-05-20 Massimiliano Zanin

Functional and effective networks inferred from time series are at the core of network neuroscience. Interpreting their properties requires inferred network models to reflect key underlying structural features; however, even a few spurious…

Neurons and Cognition · Quantitative Biology 2022-09-22 Leonardo Novelli , Joseph T. Lizier

We discuss the connection between information and copula theories by showing that a copula can be employed to decompose the information content of a multivariate distribution into marginal and dependence components, with the latter…

Statistical Finance · Quantitative Finance 2011-10-26 Rafael S. Calsaverini , Renato Vicente

Entropy metrics are nonlinear measures to quantify the complexity of time series. Among them, permutation entropy is a common metric due to its robustness and fast computation. Multivariate entropy metrics techniques are needed to analyse…

Combinatorics · Mathematics 2022-03-02 John Stewart Fabila-Carrasco , Chao Tan , Javier Escudero

Measures of dependence among variables, and measures of information content and shared information have become valuable tools of multi-variable data analysis. Information measures, like marginal entropies, mutual and multi-information, have…

Information Theory · Computer Science 2013-08-02 David J. Galas , Nikita A. Sakhanenko , Benjamin Keller

Causal discovery is a fundamental problem in statistics and has wide applications in different fields. Transfer Entropy (TE) is a important notion defined for measuring causality, which is essentially conditional Mutual Information (MI).…

Machine Learning · Computer Science 2021-03-09 Jian Ma

The aim of this paper is to investigate various information-theoretic measures, including entropy, mutual information, and some systematic measures that based on mutual information, for a class of structured spiking neuronal network. In…

Neurons and Cognition · Quantitative Biology 2019-12-04 Wenjie Li , Yao Li

Time lags are ubiquitous in biophysiological processes and more generally in real-world complex networks. It has been recently proposed to use information-theoretic tools such as transfer entropy to detect and estimate a possible delay in…

Statistical Mechanics · Physics 2018-10-03 M. L. Rosinberg , G. Tarjus , T. Munakata

Discovering causal relationships in complex multivariate time series is a fundamental scientific challenge. Traditional methods often falter, either by relying on restrictive linear assumptions or on conditional independence tests that…

Machine Learning · Computer Science 2025-08-05 Gian Marco Paldino , Gianluca Bontempi

We investigate the concept of entropy in probabilistic theories more general than quantum mechanics, with particular reference to the notion of information causality recently proposed by Pawlowski et. al. (arXiv:0905.2992). We consider two…