English
Related papers

Related papers: Generalized Decomposition of Multivariate Informat…

200 papers

The study of multimodality has garnered significant interest in fields where the analysis of interactions among multiple information sources can enhance predictive modeling, data fusion, and interpretability. Partial information…

Machine Learning · Computer Science 2025-10-07 Wenyuan Zhao , Adithya Balachandran , Chao Tian , Paul Pu Liang

The Partial Information Decomposition (PID) framework has emerged as a powerful tool for analyzing high-order interdependencies in complex network systems. However, its application to dynamic processes remains challenging due to the…

In many neural systems anatomical motifs are present repeatedly, but despite their structural similarity they can serve very different tasks. A prime example for such a motif is the canonical microcircuit of six-layered neo-cortex, which is…

Neurons and Cognition · Quantitative Biology 2015-10-07 Michael Wibral , Viola Priesemann , Jim W. Kay , Joseph T. Lizier , William A. Phillips

Bivariate Partial Information Decomposition (PID) describes how the mutual information between a random variable M and two random variables Y and Z is decomposed into unique, redundant, and synergistic terms. Recently, PID has shown promise…

Information Theory · Computer Science 2023-05-12 Chaitanya Goswami , Amanda Merkley , Pulkit Grover

Partial information decomposition (PID) seeks to decompose the multivariate mutual information that a set of source variables contains about a target variable into basic pieces, the so called "atoms of information". Each atom describes a…

Artificial Intelligence · Computer Science 2022-03-08 Aaron J. Gutknecht , Michael Wibral , Abdullah Makkeh

Complex systems, from the human brain to the global economy, are made of multiple elements that interact in such ways that the behaviour of the `whole' often seems to be more than what is readily explainable in terms of the `sum of the…

Neurons and Cognition · Quantitative Biology 2021-09-28 Pedro A. M. Mediano , Fernando E. Rosas , Andrea I Luppi , Robin L. Carhart-Harris , Daniel Bor , Anil K. Seth , Adam B. Barrett

Partial Information Decomposition (PID) represents multivariate mutual information via antichain-lattice that aims to specify which source groups can recover which informational components of a target. For three or more sources, widely…

Information Theory · Computer Science 2026-04-15 Aobo Lyu , Andrew Clark , Netanel Raviv

The Partial Information Decomposition (PID) [arXiv:1004.2515] provides a theoretical framework to characterize and quantify the structure of multivariate information sharing. A new method (Idep) has recently been proposed for computing a…

Statistical Mechanics · Physics 2018-04-03 James W. Kay , Robin A. A. Ince

The partial information decomposition (PID) is a promising framework for decomposing a joint random variable into the amount of influence each source variable Xi has on a target variable Y, relative to the other sources. For two sources,…

Information Theory · Computer Science 2019-01-30 Ryan G. James , Jeffrey Emenheiser , James P. Crutchfield

To fully characterize the information that two `source' variables carry about a third `target' variable, one must decompose the total information into redundant, unique and synergistic components, i.e. obtain a partial information…

Information Theory · Computer Science 2015-05-13 Adam B. Barrett

A central challenge in analyzing multivariate interactions within complex systems is to decompose how multiple inputs jointly determine an output. Existing approaches generally operate on observed probability distributions and can conflate…

Information Theory · Computer Science 2026-03-19 Clifford Bohm , Vincent R. Ragusa , Arend Hintze , Charles Ofria , Emily Dolson , Christoph Adami

Bivariate partial information decompositions (PIDs) characterize how the information in a "message" random variable is decomposed between two "constituent" random variables in terms of unique, redundant and synergistic information…

Information Theory · Computer Science 2023-07-21 Praveen Venkatesh , Gabriel Schamberg

Describing statistical dependencies is foundational to empirical scientific research. For uncovering intricate and possibly non-linear dependencies between a single target variable and several source variables within a system, a principled…

Information Theory · Computer Science 2024-03-28 David A. Ehrlich , Kyle Schick-Poland , Abdullah Makkeh , Felix Lanfermann , Patricia Wollstadt , Michael Wibral

Partial Information Decomposition (PID) was proposed by Williams and Beer in 2010 as a tool for analyzing fine-grained interactions between multiple random variables, and has since found numerous applications ranging from neuroscience to…

Information Theory · Computer Science 2025-10-23 Aobo Lyu , Andrew Clark , Netanel Raviv

Notwithstanding various attempts to construct a Partial Information Decomposition (PID) for multiple variables by defining synergistic, redundant, and unique information, there is no consensus on how one ought to precisely define either of…

Data Analysis, Statistics and Probability · Physics 2023-06-07 Steven J. van Enk

A reaction-coordinate--resolved information-theoretic analysis of chemical reactivity is developed using mutual information and partial information decomposition (PID). Along an intrinsic reaction coordinate (IRC), a local empirical…

Chemical Physics · Physics 2026-03-09 Kyunghoon Han , Miguel Gallegos

Partial information decomposition (PID) partitions the information that a set of sources has about a target variable into synergistic, unique, and redundant contributions. This information-theoretic tool has recently attracted attention due…

Information Theory · Computer Science 2020-10-15 Abdullah Makkeh , Dirk Oliver Theis , Raul Vicente

In a system of three stochastic variables, the Partial Information Decomposition (PID) of Williams and Beer dissects the information that two variables (sources) carry about a third variable (target) into nonnegative information atoms that…

Information Theory · Computer Science 2017-08-30 Giuseppe Pica , Eugenio Piasini , Daniel Chicharro , Stefano Panzeri

Spuriousness arises when there is an association between two or more variables in a dataset that are not causally related. In this work, we propose an explainability framework to preemptively disentangle the nature of such spurious…

Machine Learning · Computer Science 2025-11-17 Barproda Halder , Faisal Hamman , Pasan Dissanayake , Qiuyi Zhang , Ilia Sucholutsky , Sanghamitra Dutta

Partial information decompositions (PIDs), which quantify information interactions between three or more variables in terms of uniqueness, redundancy and synergy, are gaining traction in many application domains. However, our understanding…

Information Theory · Computer Science 2023-02-24 Praveen Venkatesh , Keerthana Gurushankar , Gabriel Schamberg