English
Related papers

Related papers: Partial information decomposition for mixed discre…

200 papers

Conceptually, partial information decomposition (PID) is concerned with separating the information contributions several sources hold about a certain target by decomposing the corresponding joint mutual information into contributions such…

Information Theory · Computer Science 2021-06-25 Kyle Schick-Poland , Abdullah Makkeh , Aaron J. Gutknecht , Patricia Wollstadt , Anja Sturm , Michael Wibral

Partial Information Decomposition (PID) is a principled and flexible method to unveil complex high-order interactions in multi-unit network systems. Though being defined exclusively for random variables, PID is ubiquitously applied to…

The Partial Information Decomposition (PID) framework has emerged as a powerful tool for analyzing high-order interdependencies in complex network systems. However, its application to dynamic processes remains challenging due to the…

Since its introduction, the partial information decomposition (PID) has emerged as a powerful, information-theoretic technique useful for studying the structure of (potentially higher-order) interactions in complex systems. Despite its…

Information Theory · Computer Science 2023-12-11 Thomas F. Varley

While mutual information effectively quantifies dependence between two variables, it does not by itself reveal the complex, fine-grained interactions among variables, i.e., how multiple sources contribute redundantly, uniquely, or…

Information Theory · Computer Science 2026-05-05 Aobo Lyu , Andrew Clark , Netanel Raviv

Describing statistical dependencies is foundational to empirical scientific research. For uncovering intricate and possibly non-linear dependencies between a single target variable and several source variables within a system, a principled…

Information Theory · Computer Science 2024-03-28 David A. Ehrlich , Kyle Schick-Poland , Abdullah Makkeh , Felix Lanfermann , Patricia Wollstadt , Michael Wibral

We consider the "partial information decomposition" (PID) problem, which aims to decompose the information that a set of source random variables provide about a target random variable into separate redundant, synergistic, union, and unique…

Information Theory · Computer Science 2022-11-22 Artemy Kolchinsky

Obtaining meaningful quantitative descriptions of the statistical dependence within multivariate systems is a difficult open problem. Recently, the Partial Information Decomposition (PID) was proposed to decompose mutual information (MI)…

Information Theory · Computer Science 2017-02-21 Robin A. A. Ince

Partial information decomposition (PID) of the multivariate mutual information describes the distinct ways in which a set of source variables contains information about a target variable. The groundbreaking work of Williams and Beer has…

Information Theory · Computer Science 2021-03-31 Abdullah Makkeh , Aaron J. Gutknecht , Michael Wibral

The partial information decomposition (PID) is perhaps the leading proposal for resolving information shared between a set of sources and a target into redundant, synergistic, and unique constituents. Unfortunately, the PID framework has…

Statistical Mechanics · Physics 2018-10-30 Ryan G. James , Jeffrey Emenheiser , James P. Crutchfield

The integration and transfer of information from multiple sources to multiple targets is a core motive of neural systems. The emerging field of partial information decomposition (PID) provides a novel information-theoretic lens into these…

Information Theory · Computer Science 2021-10-28 Ari Pakman , Amin Nejatbakhsh , Dar Gilboa , Abdullah Makkeh , Luca Mazzucato , Michael Wibral , Elad Schneidman

We investigate the partial information decomposition (PID) framework as a tool for edge nomination. We consider both the $I_{\cap}^{\text{min}}$ and $I_{\cap}^{\text{PM}}$ PIDs, from arXiv:1004.2515 and arXiv:1801.09010 respectively, and we…

Information Theory · Computer Science 2021-12-24 Jesse Milzman , Vince Lyzinski

Bivariate Partial Information Decomposition (PID) describes how the mutual information between a random variable M and two random variables Y and Z is decomposed into unique, redundant, and synergistic terms. Recently, PID has shown promise…

Information Theory · Computer Science 2023-05-12 Chaitanya Goswami , Amanda Merkley , Pulkit Grover

The Partial Information Decomposition (PID) takes one step beyond Shannon's theory in decomposing the information two variables $A,B$ possess about a third variable $T$ into distinct parts: unique, shared (or redundant) and synergistic…

Quantum Physics · Physics 2023-11-27 S. J. van Enk

Recent advances in neuroscientific experimental techniques have enabled us to simultaneously record the activity of thousands of neurons across multiple brain regions. This has led to a growing need for computational tools capable of…

Partial information decomposition (PID) seeks to decompose the multivariate mutual information that a set of source variables contains about a target variable into basic pieces, the so called "atoms of information". Each atom describes a…

Artificial Intelligence · Computer Science 2022-03-08 Aaron J. Gutknecht , Michael Wibral , Abdullah Makkeh

Partial Information Decomposition (PID) has become one of the most prominent information-theoretic frameworks for describing the structure and quality of information in complex systems. Despite its widespread utility, there exists no unique…

Information Theory · Computer Science 2026-03-10 Alberto Liardi , Keenan J. A. Down , George Blackburne , Matteo Neri , Pedro A. M. Mediano

The partial information decomposition (PID) is a promising framework for decomposing a joint random variable into the amount of influence each source variable Xi has on a target variable Y, relative to the other sources. For two sources,…

Information Theory · Computer Science 2019-01-30 Ryan G. James , Jeffrey Emenheiser , James P. Crutchfield

Partial information decomposition (PID) partitions the information that a set of sources has about a target variable into synergistic, unique, and redundant contributions. This information-theoretic tool has recently attracted attention due…

Information Theory · Computer Science 2020-10-15 Abdullah Makkeh , Dirk Oliver Theis , Raul Vicente

Multimodal regression aims to predict a continuous target from heterogeneous input sources and typically relies on fusion strategies such as early or late fusion. However, existing methods lack principled tools to disentangle and quantify…

Machine Learning · Computer Science 2025-12-29 Zhaozhao Ma , Shujian Yu
‹ Prev 1 2 3 10 Next ›