English
Related papers

Related papers: Partial Information Decomposition for Continuous V…

200 papers

We develop the information-theoretical concepts required to study the statistical dependencies among three variables. Some of such dependencies are pure triple interactions, in the sense that they cannot be explained in terms of a…

Computation and Language · Computer Science 2015-09-02 Damián G. Hernández , Damián H. Zanette , Inés Samengo

We study an information analogue of infinitely divisible probability distributions, where the i.i.d. sum is replaced by the joint distribution of an i.i.d. sequence. A random variable $X$ is called informationally infinitely divisible if,…

Information Theory · Computer Science 2023-07-19 Cheuk Ting Li

Estimating the mutual information from samples from a joint distribution is a challenging problem in both science and engineering. In this work, we realize a variational bound that generalizes both discriminative and generative approaches.…

Machine Learning · Statistics 2023-06-05 Marco Federici , David Ruhe , Patrick Forré

Sliced Mutual Information (SMI) is widely used as a scalable alternative to mutual information for measuring non-linear statistical dependence. Despite its advantages, such as faster convergence, robustness to high dimensionality, and…

Machine Learning · Computer Science 2025-12-10 Alexander Semenenko , Ivan Butakov , Alexey Frolov , Ivan Oseledets

In this paper, we present a novel framework for data redundancy measurement based on probabilistic modeling of datasets, and a new criterion for redundancy detection that is resilient to noise. We also develop new methods for data…

Machine Learning · Computer Science 2024-01-17 Chunxu Cao , Qiang Zhang

Pearson's correlation coefficient is a popular statistical measure to summarize the strength of association between two continuous variables. It is usually interpreted via its square as percentage of variance of one variable predicted by…

Methodology · Statistics 2024-05-09 Romain Piaget-Rossel , Valentin Rousson

We present a novel approach to estimating discrete distributions with (potentially) infinite support in the total variation metric. In a departure from the established paradigm, we make no structural assumptions whatsoever on the sampling…

Statistics Theory · Mathematics 2020-10-16 Doron Cohen , Aryeh Kontorovich , Geoffrey Wolfer

We develop a data-driven information-theoretic framework for sharp partial identification of causal effects under unmeasured confounding. Existing approaches often rely on restrictive assumptions, such as bounded or discrete outcomes;…

Machine Learning · Statistics 2026-02-24 Yonghan Jung , Bogyeong Kang

Reshef & Reshef recently published a paper in which they present a method called the Maximal Information Coefficient (MIC) that can detect all forms of statistical dependence between pairs of variables as sample size goes to infinity. While…

Machine Learning · Statistics 2013-08-28 Alexander Luedtke , Linh Tran

In this paper, we obtain general representations for the joint distributions and copulas of arbitrary dependent random variables absolutely continuous with respect to the product of given one-dimensional marginal distributions. The…

Statistics Theory · Mathematics 2016-08-16 Victor H. de la Peña , Rustam Ibragimov , Shaturgun Sharakhmetov

The assumption that data samples are independent and identically distributed (iid) is standard in many areas of statistics and machine learning. Nevertheless, in some settings, such as social networks, infectious disease modeling, and…

Methodology · Statistics 2019-02-06 Eli Sherman , Ilya Shpitser

Measuring conditional dependencies among the variables of a network is of great interest to many disciplines. This paper studies some shortcomings of the existing dependency measures in detecting direct causal influences or their lack of…

Machine Learning · Statistics 2017-06-05 Jalal Etesami , Kun Zhang , Negar Kiyavash

Observations on the past provide some hints about what will happen in the future, and this can be quantified using information theory. The ``predictive information'' defined in this way has connections to measures of complexity that have…

Statistical Mechanics · Physics 2007-05-23 William Bialek , Naftali Tishby

The mutual information between two jointly distributed random variables $X$ and $Y$ is a functional of the joint distribution $P_{XY},$ which is sometimes difficult to handle or estimate. A coarser description of the statistical behavior of…

Information Theory · Computer Science 2016-11-17 Yanjun Han , Or Ordentlich , Ofer Shayevitz

Mutual information (MI) is a fundamental quantity in information theory and machine learning. However, direct estimation of MI is intractable, even if the true joint probability density for the variables of interest is known, as it involves…

Machine Learning · Computer Science 2024-04-29 Rob Brekelmans , Sicong Huang , Marzyeh Ghassemi , Greg Ver Steeg , Roger Grosse , Alireza Makhzani

We consider independent component analysis of binary data. While fundamental in practice, this case has been much less developed than ICA for continuous data. We start by assuming a linear mixing model in a continuous-valued latent space,…

Machine Learning · Computer Science 2022-08-03 Antti Hyttinen , Vitória Barin-Pacela , Aapo Hyvärinen

The concept of entropy, firstly introduced in information theory, rapidly became popular in many applied sciences via Shannon's formula to measure the degree of heterogeneity among observations. A rather recent research field aims at…

Methodology · Statistics 2017-03-20 Linda Altieri , Daniela Cocchi , Giulia Roli

For many optimization problems it is possible to define a distance metric between problem variables that correlates with the likelihood and strength of interactions between the variables. For example, one may define a metric so that the…

Neural and Evolutionary Computing · Computer Science 2012-01-12 Martin Pelikan , Mark W. Hauschild

Estimation of mutual information between random variables has become crucial in a range of fields, from physics to neuroscience to finance. Estimating information accurately over a wide range of conditions relies on the development of…

Methodology · Statistics 2018-11-14 Houman Safaai , Arno Onken , Christopher D. Harvey , Stefano Panzeri

The analysis of scientific data and complex multivariate systems requires information quantities that capture relationships among multiple random variables. Recently, new information-theoretic measures have been developed to overcome the…

Machine Learning · Computer Science 2024-06-10 Mustapha Bounoua , Giulio Franzese , Pietro Michiardi