English
Related papers

Related papers: Which bits went where? Past and future transfer en…

200 papers

It is generally accepted that, when moving in groups, animals process information to coordinate their motion. Recent studies have begun to apply rigorous methods based on Information Theory to quantify such distributed computation.…

Quantitative Methods · Quantitative Biology 2017-05-05 Emanuele Crosato , Li Jiang , Valentin Lecheval , Joseph T. Lizier , X. Rosalind Wang , Pierre Tichit , Guy Theraulaz , Mikhail Prokopenko

The interactions between three or more random variables are often nontrivial, poorly understood, and yet, are paramount for future advances in fields such as network information theory, neuroscience, genetics and many others. In this work,…

Information Theory · Computer Science 2016-04-20 Fernando Rosas , Vasilis Ntranos , Christopher J. Ellison , Sofie Pollin , Marian Verhelst

We study a distributed learning problem in which Alice sends a compressed distillation of a set of training data to Bob, who uses the distilled version to best solve an associated learning problem. We formalize this as a rate-distortion…

Information Theory · Computer Science 2018-10-30 Parinaz Farajiparvar , Ahmad Beirami , Matthew Nokleby

Transfer entropy (TE) is an information theoretic measure that reveals the directional flow of information between processes, providing valuable insights for a wide range of real-world applications. This work proposes Transfer Entropy…

Information Theory · Computer Science 2025-07-22 Omer Luxembourg , Dor Tsur , Haim Permuter

Inferring the directionality of interactions between cellular processes is a major challenge in systems biology. Time-lagged correlations allow to discriminate between alternative models, but they still rely on assumed underlying…

Quantitative Methods · Quantitative Biology 2017-11-15 Sourabh Lahiri , Philippe Nghe , Sander J. Tans , Martin Luc Rosinberg , David Lacoste

We introduce an ambidextrous view of stochastic dynamical systems, comparing their forward-time and reverse-time representations and then integrating them into a single time-symmetric representation. The perspective is useful theoretically,…

Statistical Mechanics · Physics 2015-05-13 Christopher J. Ellison , John R. Mahoney , James P. Crutchfield

We propose a formal expansion of the transfer entropy to put in evidence irreducible sets of variables which provide information for the future state of each assigned target. Multiplets characterized by a large contribution to the expansion…

Quantitative Methods · Quantitative Biology 2015-06-04 S. Stramaglia , Guo-Rong Wu , M. Pellicoro , D. Marinazzo

We show how the shared information between the past and future---the excess entropy---derives from the components of directional information stored in the present---the predictive and retrodictive causal states. A detailed proof allows us…

Chaotic Dynamics · Physics 2010-12-03 James P. Crutchfield , Christopher J. Ellison

Time lags are ubiquitous in biophysiological processes and more generally in real-world complex networks. It has been recently proposed to use information-theoretic tools such as transfer entropy to detect and estimate a possible delay in…

Statistical Mechanics · Physics 2018-10-03 M. L. Rosinberg , G. Tarjus , T. Munakata

The deep connection between entropy and information is discussed in terms of both classical and quantum physics. The mechanism of information transfer between systems via entanglement is explored in the context of decoherence theory. The…

Quantum Physics · Physics 2021-01-05 Martin Paul Vaughan

One of the crucial steps in scientific studies is to specify dependent relationships among factors in a system of interest. Given little knowledge of a system, can we characterize the underlying dependent relationships through observation…

Information Theory · Computer Science 2012-12-24 Shohei Hidaka

Transfer entropy provides a general tool for analyzing the magnitudes and directions---but not the \emph{kinds}---of information transfer in a system. We extend transfer entropy in two complementary ways. First, we distinguish…

Data Analysis, Statistics and Probability · Physics 2011-02-09 Paul L. Williams , Randall D. Beer

Information bottleneck (IB) is a technique for extracting information in one random variable $X$ that is relevant for predicting another random variable $Y$. IB works by encoding $X$ in a compressed "bottleneck" random variable $M$ from…

Information Theory · Computer Science 2022-11-22 Artemy Kolchinsky , Brendan D. Tracey , David H. Wolpert

Living entities in a group communicate and transfer information to one another for a variety of reasons. It might be for foraging food, migration, or escaping threats and obstacles, etc. They do so by interacting with each other and also…

Biological Physics · Physics 2024-04-03 Md. Samsuzzaman , Mohammad Hasanuzzaman , Ahmed Sayeed , Arnab Saha

We show why the amount of information communicated between the past and future--the excess entropy--is not in general the amount of information stored in the present--the statistical complexity. This is a puzzle, and a long-standing one,…

Statistical Mechanics · Physics 2013-05-29 James P. Crutchfield , Christopher J. Ellison , John R. Mahoney

Phase transitions abound in nature and society, and, from species extinction to stock market collapse, their prediction is of widespread importance. In earlier work we showed that Global Transfer Entropy, a general measure of information…

Statistical Mechanics · Physics 2021-04-12 Joshua Brown , Terry Bossomaier , Lionel Barnett

In a feedforward network, Transfer Entropy (TE) can be used to measure the influence that one layer has on another by quantifying the information transfer between them during training. According to the Information Bottleneck principle, a…

Machine Learning · Computer Science 2024-04-03 Adrian Moldovan , Angel Cataron , Razvan Andonie

Estimating the entropy of a discrete random variable is a fundamental problem in information theory and related fields. This problem has many applications in various domains, including machine learning, statistics and data compression. Over…

Information Theory · Computer Science 2020-12-22 Yuval Shalev , Amichai Painsky , Irad Ben-Gal

Causal inference seeks to identify cause-and-effect interactions in coupled systems. A recently proposed method by Liang detects causal relations by quantifying the direction and magnitude of information flow between time series. The…

Data Analysis, Statistics and Probability · Physics 2024-03-20 Dionissios T. Hristopulos

With the help of transfer entropy, we analyze information flows between communities of complex networks. We show that the transfer entropy provides a coherent description of interactions between communities, including non-linear…

Statistical Finance · Quantitative Finance 2019-11-18 Jan Korbel , Xiongfei Jiang , Bo Zheng