English
Related papers

Related papers: Quantifying multivariate redundancy with maximum e…

200 papers

Determining the strength of non-linear statistical dependencies between two variables is a crucial matter in many research fields. The established measure for quantifying such relations is the mutual information. However, estimating mutual…

Data Analysis, Statistics and Probability · Physics 2019-07-24 Damián G. Hernández , Inés Samengo

The formalism of partial information decomposition provides independent or non-overlapping components constituting total information content provided by a set of source variables about the target variable. These components are recognised as…

Molecular Networks · Quantitative Biology 2018-10-09 Ayan Biswas , Suman K Banik

Associative memory, traditionally modeled by Hopfield networks, enables the retrieval of previously stored patterns from partial or noisy cues. Yet, the local computational principles which are required to enable this function remain…

Partial Information Decomposition (PID) represents multivariate mutual information via antichain-lattice that aims to specify which source groups can recover which informational components of a target. For three or more sources, widely…

Information Theory · Computer Science 2026-04-15 Aobo Lyu , Andrew Clark , Netanel Raviv

Multivariate datasets are common in various real-world applications. Recently, copulas have received significant attention for modeling dependencies among random variables. A copula-based information measure is required to quantify the…

Methodology · Statistics 2024-08-06 Mohd. Arshad , Swaroop Georgy Zachariah , Ashok Kumar Pathak

Information-theoretic quantities like entropy and mutual information have found numerous uses in machine learning. It is well known that there is a strong connection between these entropic quantities and submodularity since entropy over a…

Machine Learning · Computer Science 2021-03-04 Rishabh Iyer , Ninad Khargonkar , Jeff Bilmes , Himanshu Asnani

During a spontaneous change, a macroscopic physical system will evolve towards a macro-state with more realizations. This observation is at the basis of the Statistical Mechanical version of the Second Law of Thermodynamics, and it provides…

Statistical Mechanics · Physics 2020-04-22 Mengjie Zu , Arunkumar Bupathy , Daan Frenkel , Srikanth Sastry

Reconstructing the structural connectivity between interacting units from observed activity is a challenge across many different disciplines. The fundamental first step is to establish whether or to what extent the interactions between the…

Neurons and Cognition · Quantitative Biology 2016-11-02 Elliot A. Martin , Jaroslav Hlinka , Jörn Davidsen

Mutual information between two random variables is a well-studied notion, whose understanding is fairly complete. Mutual information between one random variable and a pair of other random variables, however, is a far more involved notion.…

Information Theory · Computer Science 2026-05-05 Aobo Lyu , Andrew Clark , Netanel Raviv

Although the deep structure guarantees the powerful expressivity of deep networks (DNNs), it also triggers serious overfitting problem. To improve the generalization capacity of DNNs, many strategies were developed to improve the diversity…

Machine Learning · Computer Science 2021-04-06 Chenguang Zhang , Yuexian Hou , Dawei Song , Liangzhu Ge , Yaoshuai Yao

The study of inter-human communication requires a more complex framework than Shannon's (1948) mathematical theory of communication because "information" is defined in the latter case as meaningless uncertainty. Assuming that meaning cannot…

Digital Libraries · Computer Science 2013-03-15 Loet Leydesdorff , Inga A. Ivanova

How can the information that a set ${X_{1},...,X_{n}}$ of random variables contains about another random variable $S$ be decomposed? To what extent do different subgroups provide the same, i.e. shared or redundant, information, carry unique…

Information Theory · Computer Science 2014-06-18 Nils Bertschinger , Johannes Rauh , Eckehard Olbrich , Jürgen Jost

The matrix-based R\'enyi's entropy allows us to directly quantify information measures from given data, without explicit estimation of the underlying probability distribution. This intriguing property makes it widely applied in statistical…

Machine Learning · Computer Science 2022-12-01 Yuxin Dong , Tieliang Gong , Shujian Yu , Hong Chen , Chen Li

In this paper, we present a novel framework for data redundancy measurement based on probabilistic modeling of datasets, and a new criterion for redundancy detection that is resilient to noise. We also develop new methods for data…

Machine Learning · Computer Science 2024-01-17 Chunxu Cao , Qiang Zhang

We define the concept of dependence among multiple variables using maximum entropy techniques and introduce a graphical notation to denote the dependencies. Direct inference of information theoretic quantities from data uncovers…

Quantitative Methods · Quantitative Biology 2007-07-13 Ilya Nemenman

We propose new measures of shared information, unique information and synergistic information that can be used to decompose the multi-information of a pair of random variables $(Y,Z)$ with a third random variable $X$. Our measures are…

Information Theory · Computer Science 2014-06-18 Nils Bertschinger , Johannes Rauh , Eckehard Olbrich , Jürgen Jost , Nihat Ay

Spuriousness arises when there is an association between two or more variables in a dataset that are not causally related. In this work, we propose an explainability framework to preemptively disentangle the nature of such spurious…

Machine Learning · Computer Science 2025-11-17 Barproda Halder , Faisal Hamman , Pasan Dissanayake , Qiuyi Zhang , Ilia Sucholutsky , Sanghamitra Dutta

Firstly, assuming Gaussianity, equations for the following information theory measures are presented: total correlation/coherence (TC), dual total correlation/coherence (DTC), O-information, TSE complexity, and redundancy-synergy index…

Methodology · Statistics 2025-07-18 Roberto D. Pascual-Marqui , Kieko Kochi , Toshihiko Kinoshita

Large statically indeterminate truss and frame structures exhibit complex load-bearing behavior, and redundancy matrices are helpful for their analysis and design. Depending on the task, the full redundancy matrix or only its diagonal…

Computational Engineering, Finance, and Science · Computer Science 2024-02-14 Anton Tkachuk , Tim Krake , Jan Gade , Malte von Scheven

We offer a new approach to the information decomposition problem in information theory: given a 'target' random variable co-distributed with multiple 'source' variables, how can we decompose the mutual information into a sum of non-negative…

Information Theory · Computer Science 2019-10-15 Nihat Ay , Daniel Polani , Nathaniel Virgo