English
Related papers

Related papers: Generalized Decomposition of Multivariate Informat…

200 papers

The apparent dichotomy between information-processing and dynamical approaches to complexity science forces researchers to choose between two diverging sets of tools and explanations, creating conflict and often hindering scientific…

Neurons and Cognition · Quantitative Biology 2022-01-26 Pedro A. M. Mediano , Fernando E. Rosas , Juan Carlos Farah , Murray Shanahan , Daniel Bor , Adam B. Barrett

Information theoretic measures (e.g. the Kullback Liebler divergence and Shannon mutual information) have been used for exploring possibly nonlinear multivariate dependencies in high dimension. If these dependencies are assumed to follow a…

Information Theory · Computer Science 2017-07-12 Kevin R. Moon , Morteza Noshad , Salimeh Yasaei Sekeh , Alfred O. Hero

How can the information that a set ${X_{1},...,X_{n}}$ of random variables contains about another random variable $S$ be decomposed? To what extent do different subgroups provide the same, i.e. shared or redundant, information, carry unique…

Information Theory · Computer Science 2014-06-18 Nils Bertschinger , Johannes Rauh , Eckehard Olbrich , Jürgen Jost

Deep nonlinear models pose a challenge for fitting parameters due to lack of knowledge of the hidden layer and the potentially non-affine relation of the initial and observed layers. In the present work we investigate the use of information…

Optimization and Control · Mathematics 2016-12-20 Jacob S. Hunter , Nathan O. Hodas

We decompose the Kullback--Leibler generalization error (GE) -- the expected KL divergence from the data distribution to the trained model -- of unsupervised learning into three non-negative components: model error, data bias, and variance.…

Machine Learning · Statistics 2026-04-15 Gilhan Kim

Partial information decomposition allows the joint mutual information between an output and a set of inputs to be divided into components that are synergistic or shared or unique to each input. We consider five different decompositions and…

Information Theory · Computer Science 2022-08-10 Jim W. Kay , Jan M. Schulz , W. A. Phillips

Segregation is a multi-scale phenomenon that requires careful measurement. A segregation index implicitly defines how the demographic compositions of locations are compared. We identify two properties -- mean-minimisation and invariance --…

Physics and Society · Physics 2026-03-17 Rohit Sahasrabuddhe , Renaud Lambiotte

Selecting a minimal feature set that is maximally informative about a target variable is a central task in machine learning and statistics. Information theory provides a powerful framework for formulating feature selection algorithms --…

Information Theory · Computer Science 2023-05-05 Patricia Wollstadt , Sebastian Schmitt , Michael Wibral

Complex systems often exhibit multiple levels of organization covering a wide range of physical scales, so the study of the hierarchical decomposition of their structure and function is frequently convenient. To better understand this…

Information Theory · Computer Science 2020-07-08 Juan I. Perotti , Nahuel Almeira , Fabio Saracco

The integrated information theory is thought to be a key clue towards the theoretical understanding of consciousness. In this study, we propose a simple numerical model comprising a set of coupled double quantum dots, where the…

Quantum Physics · Physics 2020-09-30 Katsuaki Tanabe

Computing multi-source partial information decomposition (PID) for continuous data is hard: existing closed-form Gaussian estimators are restricted to two source variables, while continuous arbitrary-source estimators are typically…

Information Theory · Computer Science 2026-05-12 Aobo Lyu , Andrew Clark , Netanel Raviv

We consider the problem of decomposing the total mutual information conveyed by a pair of predictor random variables about a target random variable into redundant, unique and synergistic contributions. We focus on the relationship between…

Information Theory · Computer Science 2015-09-15 Pradeep Kr. Banerjee , Virgil Griffith

We build information geometry for a partially ordered set of variables and define the orthogonal decomposition of information theoretic quantities. The natural connection between information geometry and order theory leads to efficient…

Information Theory · Computer Science 2016-11-18 Mahito Sugiyama , Hiroyuki Nakahara , Koji Tsuda

Learning invariant graph representations for out-of-distribution (OOD) generalization remains challenging because the learned representations often retain spurious components. To address this challenge, this work introduces a new tool from…

Machine Learning · Computer Science 2025-12-09 Barproda Halder , Pasan Dissanayake , Sanghamitra Dutta

A key feature of information theory is its universality, as it can be applied to study a broad variety of complex systems. However, many information-theoretic measures can vary significantly even across systems with similar properties,…

Information Theory · Computer Science 2024-10-16 Alberto Liardi , Fernando E. Rosas , Robin L. Carhart-Harris , George Blackburne , Daniel Bor , Pedro A. M. Mediano

Our understanding of complex systems rests on our ability to characterise how they perform distributed computation and integrate information. Advances in information theory have introduced several quantities to describe complex information…

Information Theory · Computer Science 2026-04-13 Alberto Liardi , George Blackburne , Hardik Rajpal , Fernando E. Rosas , Pedro A. M. Mediano

Knowledge distillation deploys complex machine learning models in resource-constrained environments by training a smaller student model to emulate internal representations of a complex teacher model. However, the teacher's representations…

Williams and Beer (2010) proposed a nonnegative mutual information decomposition, based on the construction of information gain lattices, which allows separating the information that a set of variables contains about another into components…

Data Analysis, Statistics and Probability · Physics 2017-04-05 Daniel Chicharro , Stefano Panzeri

Complex networks often exhibit emergent behaviors, where simple dyadic interactions yield collective dynamics that cannot be explained by examining the system's units individually or in pairs. Understanding how redundant and synergistic…

In recent research, Tensor Product Representation (TPR) is applied for the systematic generalization task of deep neural networks by learning the compositional structure of data. However, such prior works show limited performance in…

Machine Learning · Computer Science 2024-06-04 Taewon Park , Inchul Choi , Minho Lee