English
Related papers

Related papers: Renormalized Mutual Information for Artificial Sci…

200 papers

We offer a new approach to the information decomposition problem in information theory: given a 'target' random variable co-distributed with multiple 'source' variables, how can we decompose the mutual information into a sum of non-negative…

Information Theory · Computer Science 2019-10-15 Nihat Ay , Daniel Polani , Nathaniel Virgo

While the linear Pearson correlation coefficient represents a well-established normalized measure to quantify the interrelation of two stochastic variables $X$ and $Y$, it fails for multidimensional variables such as Cartesian coordinates.…

Data Analysis, Statistics and Probability · Physics 2024-09-19 Daniel Nagel , Georg Diez , Gerhard Stock

We investigate the sets of joint probability distributions that maximize the average multi-information over a collection of margins. These functionals serve as proxies for maximizing the multi-information of a set of variables or the mutual…

Information Theory · Computer Science 2019-06-14 Thomas Merkh , Guido Montúfar

Normalizing flows are powerful non-parametric statistical models that function as a hybrid between density estimators and generative models. Current learning algorithms for normalizing flows assume that data points are sampled…

Machine Learning · Computer Science 2023-05-31 Matthias Kirchler , Christoph Lippert , Marius Kloft

A recent article proposed reduced mutual information for evaluation of clustering, classification and community detection. The motivation is that the standard normalized mutual information (NMI) may give counter-intuitive answers under…

Social and Information Networks · Computer Science 2020-05-15 Zhong-Yuan Zhang

Revealing physical interactions in complex systems from observed collective dynamics constitutes a fundamental inverse problem in science. Current reconstruction methods require access to a system's model or dynamical data at a level of…

Physics and Society · Physics 2018-01-18 Mor Nitzan , Jose Casadiego , Marc Timme

Sequence-to-sequence neural translation models learn semantic and syntactic relations between sentence pairs by optimizing the likelihood of the target given the source, i.e., $p(y|x)$, an objective that ignores other potentially useful…

Computation and Language · Computer Science 2016-03-24 Jiwei Li , Dan Jurafsky

Mutual information is commonly used as a measure of similarity between competing labelings of a given set of objects, for example to quantify performance in classification and community detection tasks. As argued recently, however, the…

Social and Information Networks · Computer Science 2025-07-17 Maximilian Jerdee , Alec Kirkley , M. E. J. Newman

Finding interdependency relations between (possibly multivariate) time series provides valuable knowledge about the processes that generate the signals. Information theory sets a natural framework for non-parametric measures of several…

Information Theory · Computer Science 2016-02-09 German Gomez-Herrero , Wei Wu , Kalle Rutanen , Miguel C. Soriano , Gordon Pipa , Raul Vicente

We develop improved rearrangement algorithms to find the dependence structure that minimizes a convex function of the sum of dependent variables with given margins. We propose a new multivariate dependence measure, which can assess the…

Computation · Statistics 2016-07-14 Carole Bernard , Don McLeish

The maximal information coefficient (MIC), which measures the amount of dependence between two variables, is able to detect both linear and non-linear associations. However, computational cost grows rapidly as a function of the dataset…

Information Theory · Computer Science 2015-08-18 Ali Mousavi , Richard G. Baraniuk

The mutual information (MI) between two random variables is an important correlation measure in data analysis. The Shannon entropy of a joint probability distribution is the variable part under fixed marginals. We aim to minimize and…

Optimization and Control · Mathematics 2025-09-08 Paula Franke , Kay Hamacher , Paul Manns

The use of mutual information as a similarity measure in agglomerative hierarchical clustering (AHC) raises an important issue: some correction needs to be applied for the dimensionality of variables. In this work, we formulate the decision…

Machine Learning · Statistics 2016-08-07 Guillaume Marrelec , Arnaud Messé , Pierre Bellec

As a fundamental concept in information theory, mutual information ($MI$) has been commonly applied to quantify association between random vectors. Most existing nonparametric estimators of $MI$ have unstable statistical performance since…

Applications · Statistics 2025-02-19 Soumik Purkayastha , Peter X. K. Song

The mutual information characterizes correlations between spatially separated regions of a system. Yet, in experiments we often measure dynamical correlations, which involve probing operators that are also separated in time. Here, we…

Quantum Physics · Physics 2025-10-07 Paolo Glorioso , Xiao-Liang Qi , Zhenbin Yang

The quest for simplification in physics drives the exploration of concise mathematical representations for complex systems. This Dissertation focuses on the concept of dimensionality reduction as a means to obtain low-dimensional…

Machine Learning · Computer Science 2024-10-31 Eslam Abdelaleem

This paper generalises dynamic factor models for multidimensional dependent data. In doing so, it develops an interpretable technique to study complex information sources ranging from repeated surveys with a varying number of respondents to…

Econometrics · Economics 2023-01-31 Matteo Barigozzi , Filippo Pellegrino

In social science, formal and quantitative models, such as ones describing economic growth and collective action, are used to formulate mechanistic explanations, provide predictions, and uncover questions about observed phenomena. Here, we…

Symbolic Computation · Computer Science 2023-08-17 Julia Balla , Sihao Huang , Owen Dugan , Rumen Dangovski , Marin Soljacic

Artificial intelligence (AI) has been increasingly applied in scientific activities for decades; however, it is still far from an insightful and trustworthy collaborator in the scientific process. Most existing AI methods are either too…

Artificial Intelligence · Computer Science 2022-02-08 Morad Behandish , John Maxwell , Johan de Kleer

Given the growth in the variety and precision of astronomical datasets of interest for cosmology, the best cosmological constraints are invariably obtained by combining data from different experiments. At the likelihood level, one…

Cosmology and Nongalactic Astrophysics · Physics 2024-09-04 Arrykrishna Mootoovaloo , Carlos García-García , David Alonso , Jaime Ruiz-Zapatero