English
Related papers

Related papers: Sifting Common Information from Many Variables

200 papers

The framework of Partial Information Decomposition (PID) unveils complex nonlinear interactions in network systems by dissecting the mutual information (MI) between a target variable and several source variables. While PID measures have…

Data Analysis, Statistics and Probability · Physics 2024-09-23 Chiara Barà , Yuri Antonacci , Marta Iovino , Ivan Lazic , Luca Faes

The information that two random variables $Y$, $Z$ contain about a third random variable $X$ can have aspects of shared information (contained in both $Y$ and $Z$), of complementary information (only available from $(Y,Z)$ together) and of…

Information Theory · Computer Science 2015-03-05 Johannes Rauh , Nils Bertschinger , Eckehard Olbrich , Jürgen Jost

Many computer vision tasks share substantial overlapping information, yet conventional codecs tend to ignore this, leading to redundant and inefficient representations. The Gray-Wyner network, a classical concept from information theory,…

Machine Learning · Computer Science 2026-05-11 Anderson de Andrade , Alon Harell , Ivan V. Bajić

We derive a well-defined renormalized version of mutual information that allows to estimate the dependence between continuous random variables in the important case when one is deterministically dependent on the other. This is the situation…

Machine Learning · Computer Science 2021-05-26 Leopoldo Sarra , Andrea Aiello , Florian Marquardt

The partial information decomposition (PID) is perhaps the leading proposal for resolving information shared between a set of sources and a target into redundant, synergistic, and unique constituents. Unfortunately, the PID framework has…

Statistical Mechanics · Physics 2018-10-30 Ryan G. James , Jeffrey Emenheiser , James P. Crutchfield

To characterize the complex higher-order interactions among variables within a system, this study introduces a novel framework, termed System Information Decomposition (SID), aimed at decomposing the information entropy of variables into…

Information Theory · Computer Science 2024-11-12 Aobo Lyu , Bing Yuan , Ou Deng , Mingzhe Yang , Jiang Zhang

We consider lossy compression of an information source when the decoder has lossless access to a correlated one. This setup, also known as the Wyner-Ziv problem, is a special case of distributed source coding. To this day, practical…

Information Theory · Computer Science 2024-05-22 Ezgi Ozyilkan , Johannes Ballé , Elza Erkip

In inverse problems, one attempts to infer spatially variable functions from indirect measurements of a system. To practitioners of inverse problems, the concept of "information" is familiar when discussing key questions such as which parts…

Numerical Analysis · Mathematics 2025-02-12 Wolfgang Bangerth , Chris R. Johnson , Dennis K. Njeru , Bart van Bloemen Waanders

The information bottleneck (IB) method seeks a compressed representation of data that preserves information relevant to a target variable for prediction while discarding irrelevant information from the original data. In its classical…

Information Theory · Computer Science 2026-02-23 Akira Kamatsuka , Takahiro Yoshida

In linear inverse problems, we have data derived from a noisy linear transformation of some unknown parameters, and we wish to estimate these unknowns from the data. Separable inverse problems are a powerful generalization in which the…

Optimization and Control · Mathematics 2015-06-12 Paul Shearer , Anna C. Gilbert

How can the information that a set ${X_{1},...,X_{n}}$ of random variables contains about another random variable $S$ be decomposed? To what extent do different subgroups provide the same, i.e. shared or redundant, information, carry unique…

Information Theory · Computer Science 2014-06-18 Nils Bertschinger , Johannes Rauh , Eckehard Olbrich , Jürgen Jost

A central challenge in analyzing multivariate interactions within complex systems is to decompose how multiple inputs jointly determine an output. Existing approaches generally operate on observed probability distributions and can conflate…

Information Theory · Computer Science 2026-03-19 Clifford Bohm , Vincent R. Ragusa , Arend Hintze , Charles Ofria , Emily Dolson , Christoph Adami

The problem of how to properly quantify redundant information is an open question that has been the subject of much recent research. Redundant information refers to information about a target variable S that is common to two or more…

Information Theory · Computer Science 2017-07-14 Robin A. A. Ince

The partial information decomposition (PID) framework is concerned with decomposing the information that a set of (two or more) random variables (the sources) has about another variable (the target) into three types of information: unique,…

Information Theory · Computer Science 2025-02-28 André F. C. Gomes , Mário A. T. Figueiredo

We address three outstanding problems in information theory. Problem one is the definition of a non-negative decomposition of the information conveyed by two or more sources about a target variable into the specific contribution of each…

Information Theory · Computer Science 2022-06-28 Cesare Magri

Obtaining meaningful quantitative descriptions of the statistical dependence within multivariate systems is a difficult open problem. Recently, the Partial Information Decomposition (PID) was proposed to decompose mutual information (MI)…

Information Theory · Computer Science 2017-02-21 Robin A. A. Ince

The integration and transfer of information from multiple sources to multiple targets is a core motive of neural systems. The emerging field of partial information decomposition (PID) provides a novel information-theoretic lens into these…

Information Theory · Computer Science 2021-10-28 Ari Pakman , Amin Nejatbakhsh , Dar Gilboa , Abdullah Makkeh , Luca Mazzucato , Michael Wibral , Elad Schneidman

Communication efficient distributed mean estimation is an important primitive that arises in many distributed learning and optimization scenarios such as federated learning. Without any probabilistic assumptions on the underlying data, we…

Information Theory · Computer Science 2022-11-15 Prathamesh Mayekar , Shubham Jha , Ananda Theertha Suresh , Himanshu Tyagi

We consider lossy compression of an information source when the decoder has lossless access to a correlated one. This setup, also known as the Wyner-Ziv problem, is a special case of distributed source coding. To this day, real-world…

Information Theory · Computer Science 2023-05-09 Ezgi Ozyilkan , Johannes Ballé , Elza Erkip

Conceptually, partial information decomposition (PID) is concerned with separating the information contributions several sources hold about a certain target by decomposing the corresponding joint mutual information into contributions such…

Information Theory · Computer Science 2021-06-25 Kyle Schick-Poland , Abdullah Makkeh , Aaron J. Gutknecht , Patricia Wollstadt , Anja Sturm , Michael Wibral