English
Related papers

Related papers: Partial Information Decomposition via Deficiency f…

200 papers

The study of multimodality has garnered significant interest in fields where the analysis of interactions among multiple information sources can enhance predictive modeling, data fusion, and interpretability. Partial information…

Machine Learning · Computer Science 2025-10-07 Wenyuan Zhao , Adithya Balachandran , Chao Tian , Paul Pu Liang

Recent advances in neuroscientific experimental techniques have enabled us to simultaneously record the activity of thousands of neurons across multiple brain regions. This has led to a growing need for computational tools capable of…

Bivariate Partial Information Decomposition (PID) describes how the mutual information between a random variable M and two random variables Y and Z is decomposed into unique, redundant, and synergistic terms. Recently, PID has shown promise…

Information Theory · Computer Science 2023-05-12 Chaitanya Goswami , Amanda Merkley , Pulkit Grover

The Partial Information Decomposition (PID) [arXiv:1004.2515] provides a theoretical framework to characterize and quantify the structure of multivariate information sharing. A new method (Idep) has recently been proposed for computing a…

Statistical Mechanics · Physics 2018-04-03 James W. Kay , Robin A. A. Ince

Partial Information Decomposition (PID) is a principled and flexible method to unveil complex high-order interactions in multi-unit network systems. Though being defined exclusively for random variables, PID is ubiquitously applied to…

Conceptually, partial information decomposition (PID) is concerned with separating the information contributions several sources hold about a certain target by decomposing the corresponding joint mutual information into contributions such…

Information Theory · Computer Science 2021-06-25 Kyle Schick-Poland , Abdullah Makkeh , Aaron J. Gutknecht , Patricia Wollstadt , Anja Sturm , Michael Wibral

The framework of Partial Information Decomposition (PID) unveils complex nonlinear interactions in network systems by dissecting the mutual information (MI) between a target variable and several source variables. While PID measures have…

Data Analysis, Statistics and Probability · Physics 2024-09-23 Chiara Barà , Yuri Antonacci , Marta Iovino , Ivan Lazic , Luca Faes

We consider the "partial information decomposition" (PID) problem, which aims to decompose the information that a set of source random variables provide about a target random variable into separate redundant, synergistic, union, and unique…

Information Theory · Computer Science 2022-11-22 Artemy Kolchinsky

While mutual information effectively quantifies dependence between two variables, it does not by itself reveal the complex, fine-grained interactions among variables, i.e., how multiple sources contribute redundantly, uniquely, or…

Information Theory · Computer Science 2026-05-05 Aobo Lyu , Andrew Clark , Netanel Raviv

To fully characterize the information that two `source' variables carry about a third `target' variable, one must decompose the total information into redundant, unique and synergistic components, i.e. obtain a partial information…

Information Theory · Computer Science 2015-05-13 Adam B. Barrett

The Partial Information Decomposition (PID) takes one step beyond Shannon's theory in decomposing the information two variables $A,B$ possess about a third variable $T$ into distinct parts: unique, shared (or redundant) and synergistic…

Quantum Physics · Physics 2023-11-27 S. J. van Enk

The integration and transfer of information from multiple sources to multiple targets is a core motive of neural systems. The emerging field of partial information decomposition (PID) provides a novel information-theoretic lens into these…

Information Theory · Computer Science 2021-10-28 Ari Pakman , Amin Nejatbakhsh , Dar Gilboa , Abdullah Makkeh , Luca Mazzucato , Michael Wibral , Elad Schneidman

Partial information decomposition (PID) of the multivariate mutual information describes the distinct ways in which a set of source variables contains information about a target variable. The groundbreaking work of Williams and Beer has…

Information Theory · Computer Science 2021-03-31 Abdullah Makkeh , Aaron J. Gutknecht , Michael Wibral

Computing multi-source partial information decomposition (PID) for continuous data is hard: existing closed-form Gaussian estimators are restricted to two source variables, while continuous arbitrary-source estimators are typically…

Information Theory · Computer Science 2026-05-12 Aobo Lyu , Andrew Clark , Netanel Raviv

Partial Information Decomposition (PID) was proposed by Williams and Beer in 2010 as a tool for analyzing fine-grained interactions between multiple random variables, and has since found numerous applications ranging from neuroscience to…

Information Theory · Computer Science 2025-10-23 Aobo Lyu , Andrew Clark , Netanel Raviv

Obtaining meaningful quantitative descriptions of the statistical dependence within multivariate systems is a difficult open problem. Recently, the Partial Information Decomposition (PID) was proposed to decompose mutual information (MI)…

Information Theory · Computer Science 2017-02-21 Robin A. A. Ince

The partial information decomposition (PID) is a promising framework for decomposing a joint random variable into the amount of influence each source variable Xi has on a target variable Y, relative to the other sources. For two sources,…

Information Theory · Computer Science 2019-01-30 Ryan G. James , Jeffrey Emenheiser , James P. Crutchfield

The partial information decomposition (PID) framework is concerned with decomposing the information that a set of random variables has with respect to a target variable into three types of components: redundant, synergistic, and unique.…

Information Theory · Computer Science 2025-02-28 André F. C. Gomes , Mário A. T. Figueiredo

Partial information decomposition (PID) seeks to decompose the multivariate mutual information that a set of source variables contains about a target variable into basic pieces, the so called "atoms of information". Each atom describes a…

Artificial Intelligence · Computer Science 2022-03-08 Aaron J. Gutknecht , Michael Wibral , Abdullah Makkeh

The Partial Information Decomposition (PID) framework has emerged as a powerful tool for analyzing high-order interdependencies in complex network systems. However, its application to dynamic processes remains challenging due to the…

‹ Prev 1 2 3 10 Next ›