English
Related papers

Related papers: Interaction Information for Causal Inference: The …

200 papers

Recent approaches to causal inference have focused on causal effects defined as contrasts between the distribution of counterfactual outcomes under hypothetical interventions on the nodes of a graphical model. In this article we develop…

Methodology · Statistics 2023-04-26 Iván Díaz

We consider the problem of decomposing the total mutual information conveyed by a pair of predictor random variables about a target random variable into redundant, unique and synergistic contributions. We focus on the relationship between…

Information Theory · Computer Science 2015-09-15 Pradeep Kr. Banerjee , Virgil Griffith

Interactions between pieces of information (entities) play a substantial role in the way an individual acts on them: adoption of a product, the spread of news, strategy choice, etc. However, the underlying interaction mechanisms are often…

Machine Learning · Computer Science 2022-02-02 Gaël Poux-Médard , Julien Velcin , Sabine Loudcher

We study a driven system in which interaction between particles causes their directional, coupled movement. In that model system, two particles move alternatingly in time on two coupled chains. Without interaction, both particles diffuse…

Computational Physics · Physics 2023-08-10 Helena Drüeke , Dieter Bauer

The characterisation of neuronal connectivity is one of the most important matters in neuroscience. In this work, we show that a recently proposed informational quantity, the causal mutual information, employed with an appropriate…

Neurons and Cognition · Quantitative Biology 2018-02-14 F. S. Borges , E. L. Lameu , K. C. Iarosz , P. R. Protachevicz , I. L. Caldas , R. L. Viana , E. E. N. Macau , A. M. Batista , M. S. Baptista

Mutual information is commonly used as a measure of similarity between competing labelings of a given set of objects, for example to quantify performance in classification and community detection tasks. As argued recently, however, the…

Social and Information Networks · Computer Science 2025-07-17 Maximilian Jerdee , Alec Kirkley , M. E. J. Newman

Observations on the past provide some hints about what will happen in the future, and this can be quantified using information theory. The ``predictive information'' defined in this way has connections to measures of complexity that have…

Statistical Mechanics · Physics 2007-05-23 William Bialek , Naftali Tishby

Reconstructing the structural connectivity between interacting units from observed activity is a challenge across many different disciplines. The fundamental first step is to establish whether or to what extent the interactions between the…

Neurons and Cognition · Quantitative Biology 2016-11-02 Elliot A. Martin , Jaroslav Hlinka , Jörn Davidsen

Information diffusion on social networks has been described as a collective outcome of threshold behaviors in the framework of threshold models. However, since the existing models do not take into account individuals' optimization problem,…

Physics and Society · Physics 2022-09-08 Teruyoshi Kobayashi

Conversational information seeking (CIS) is concerned with a sequence of interactions between one or more users and an information system. Interactions in CIS are primarily based on natural language dialogue, while they may include other…

Information Retrieval · Computer Science 2023-01-27 Hamed Zamani , Johanne R. Trippas , Jeff Dalton , Filip Radlinski

We study the principle of information causality for the set of extremal correlations in the tripartite scenario. We show that all but one nonlocal extremal correlations in this scenario violate information causality. This undetected…

Quantum Physics · Physics 2012-02-01 Tzyh Haur Yang , Daniel Cavalcanti , Mafalda Almeida , Colin Teo , Valerio Scarani

We offer a new approach to the information decomposition problem in information theory: given a 'target' random variable co-distributed with multiple 'source' variables, how can we decompose the mutual information into a sum of non-negative…

Information Theory · Computer Science 2019-10-15 Nihat Ay , Daniel Polani , Nathaniel Virgo

We address the problem of integrating data from multiple, possibly biased, observational and interventional studies, to eventually compute counterfactuals in structural causal models. We start from the case of a single observational dataset…

Artificial Intelligence · Computer Science 2023-03-17 Marco Zaffalon , Alessandro Antonucci , David Huber , Rafael Cabañas

We study a setting where Bayesian agents with a common prior have private information related to an event's outcome and sequentially make public announcements relating to their information. Our main result shows that when agents' private…

Computer Science and Game Theory · Computer Science 2022-11-28 Yuqing Kong , Grant Schoenebeck

Information theory gives rise to a novel method for causal skeleton discovery by expressing associations between variables as tensors. This tensor-based approach reduces the dimensionality of the data needed to test for conditional…

Machine Learning · Statistics 2020-11-10 David Sigtermans

Living cells encode and transmit information in the temporal dynamics of biochemical components. Gaining a detailed understanding of the input-output relationship in biological systems therefore requires quantitative measures that capture…

Molecular Networks · Quantitative Biology 2019-04-04 Lorenzo Duso , Christoph Zechner

Mutual information is an important measure of the dependence among variables. It has become widely used in statistics, machine learning, biology, etc. However, the standard techniques for estimating it often perform poorly in higher…

Data Analysis, Statistics and Probability · Physics 2023-09-18 Nick Carrara , Jesse Ernst

Opinion dynamics concerns social processes through which populations or groups of individuals agree or disagree on specific issues. As such, modelling opinion dynamics represents an important research area that has been progressively…

Physics and Society · Physics 2013-09-06 Alina Sîrbu , Vittorio Loreto , Vito D. P. Servedio , Francesca Tria

Recently, the partial information decomposition emerged as a promising framework for identifying the meaningful components of the information contained in a joint distribution. Its adoption and practical application, however, have been…

Information Theory · Computer Science 2018-08-28 Ryan G. James , Jeffrey Emenheiser , James P. Crutchfield

Data from spectrophotometers form vectors of a large number of exploitable variables. Building quantitative models using these variables most often requires using a smaller set of variables than the initial one. Indeed, a too large number…

Machine Learning · Computer Science 2007-09-26 Fabrice Rossi , Amaury Lendasse , Damien François , Vincent Wertz , Michel Verleysen