English
Related papers

Related papers: Data-Driven Estimation Of Mutual Information Betwe…

200 papers

Since its inception, the neural estimation of mutual information (MI) has demonstrated the empirical success of modeling expected dependency between high-dimensional random variables. However, MI is an aggregate statistic and cannot be used…

Machine Learning · Computer Science 2020-10-16 Yao-Hung Hubert Tsai , Han Zhao , Makoto Yamada , Louis-Philippe Morency , Ruslan Salakhutdinov

Mutual Information (MI) is an useful tool for the recognition of mutual dependence berween data sets. Differen methods for the estimation of MI have been developed when both data sets are discrete or when both data sets are continuous. The…

Applications · Statistics 2017-08-30 Miguel A. Ré , Guillermo G. Aguirre Varela

The conditional mutual information I(X;Y|Z) measures the average information that X and Y contain about each other given Z. This is an important primitive in many learning problems including conditional independence testing, graphical model…

Information Theory · Computer Science 2017-10-16 Arman Rahimzamani , Sreeram Kannan

Mutual information is widely used in artificial intelligence, in a descriptive way, to measure the stochastic dependence of discrete random variables. In order to address questions such as the reliability of the empirical value, one must…

Artificial Intelligence · Computer Science 2008-06-26 Marco Zaffalon , Marcus Hutter

Mutual information is widely used in artificial intelligence, in a descriptive way, to measure the stochastic dependence of discrete random variables. In order to address questions such as the reliability of the empirical value, one must…

Artificial Intelligence · Computer Science 2014-08-08 Marco Zaffalon , Marcus Hutter

A method to estimate the time-dependent correlation via an empirical bias estimate of the time-delayed mutual information for a time-series is proposed. In particular, the bias of the time-delayed mutual information is shown to often be…

Chaotic Dynamics · Physics 2016-01-20 DJ Albers , George Hripcsak

This paper compares and evaluates a set of non-parametric mutual information estimators with the goal of providing a novel toolset to progress in the analysis of the capacity of the nonlinear optical channel, which is currently an open…

Information Theory · Computer Science 2018-01-25 Tommaso Catuogno , Menelaos Ralli Camara , Marco Secondini

Estimating the mutual information from samples from a joint distribution is a challenging problem in both science and engineering. In this work, we realize a variational bound that generalizes both discriminative and generative approaches.…

Machine Learning · Statistics 2023-06-05 Marco Federici , David Ruhe , Patrick Forré

Mutual information is an important measure of the dependence among variables. It has become widely used in statistics, machine learning, biology, etc. However, the standard techniques for estimating it often perform poorly in higher…

Data Analysis, Statistics and Probability · Physics 2023-09-18 Nick Carrara , Jesse Ernst

Mutual information is widely used, in a descriptive way, to measure the stochastic dependence of categorical random variables. In order to address questions such as the reliability of the descriptive value, one must consider…

Machine Learning · Computer Science 2007-07-13 Marcus Hutter , Marco Zaffalon

One of the crucial steps in scientific studies is to specify dependent relationships among factors in a system of interest. Given little knowledge of a system, can we characterize the underlying dependent relationships through observation…

Information Theory · Computer Science 2012-12-24 Shohei Hidaka

We define a measure of redundant information based on projections in the space of probability distributions. Redundant information between random variables is information that is shared between those variables. But in contrast to mutual…

Information Theory · Computer Science 2013-05-30 Malte Harder , Christoph Salge , Daniel Polani

Estimating conditional mutual information (CMI) is an essential yet challenging step in many machine learning and data mining tasks. Estimating CMI from data that contains both discrete and continuous variables, or even discrete-continuous…

Information Theory · Computer Science 2021-01-14 Alexander Marx , Lincen Yang , Matthijs van Leeuwen

Mutual Information (MI) is a powerful statistical measure that quantifies shared information between random variables, particularly valuable in high-dimensional data analysis across fields like genomics, natural language processing, and…

Machine Learning · Computer Science 2024-12-02 Andre O. Falcao

The identification of relevant features, i.e., the driving variables that determine a process or the properties of a system, is an essential part of the analysis of data sets with a large number of variables. A mathematical rigorous…

Machine Learning · Statistics 2022-08-02 Benjamin Regler , Matthias Scheffler , Luca M. Ghiringhelli

A new method to measure nonlinear dependence between two variables is described using mutual information to analyze the separate linear and nonlinear components of dependence. This technique, which gives an exact value for the proportion of…

Information Theory · Computer Science 2015-12-17 Reginald D. Smith

In this paper we use a well know method in statistics, the $\delta$-method, to provide an asymptotic distribution for the Mutual Information, and construct and independence test based on it. Interesting connections are found with the…

Methodology · Statistics 2025-02-26 Marius Marinescu , Costel Balcau

In this paper we focus on the estimation of mutual information from finite samples $(\mathcal{X}\times\mathcal{Y})$. The main concern with estimations of mutual information is their robustness under the class of transformations for which it…

Data Analysis, Statistics and Probability · Physics 2020-02-04 Nicholas Carrara , Jesse Ernst

We use a well known model (T. Vicsek et al. Phys Rev Lett 15, 1226 (1995)) for flocking to test mutual information as a tool for detecting order-disorder transitions, in particular when observations of the system are limited. We show that…

Data Analysis, Statistics and Probability · Physics 2009-11-13 R. T. Wicks , S. C. Chapman , R. O. Dendy

Recent advances in statistical learning theory have revealed profound connections between mutual information (MI) bounds, PAC-Bayesian theory, and Bayesian nonparametrics. This work introduces a novel mutual information bound for…

Machine Learning · Statistics 2025-08-18 El Mahdi Khribch , Pierre Alquier