English
Related papers

Related papers: Evaluating Summary Statistics with Mutual Informat…

200 papers

We develop the use of mutual information (MI), a well-established metric in information theory, to interpret the inner workings of deep learning models. To accurately estimate MI from a finite number of samples, we present GMM-MI…

Data Analysis, Statistics and Probability · Physics 2023-04-12 Davide Piras , Hiranya V. Peiris , Andrew Pontzen , Luisa Lucie-Smith , Ningyuan Guo , Brian Nord

Sliced mutual information (SMI) is defined as an average of mutual information (MI) terms between one-dimensional random projections of the random variables. It serves as a surrogate measure of dependence to classic MI that preserves many…

Information Theory · Computer Science 2022-10-18 Ziv Goldfeld , Kristjan Greenewald , Theshani Nuradha , Galen Reeves

The influx of massive amounts of data from current and upcoming cosmological surveys necessitates compression schemes that can efficiently summarize the data with minimal loss of information. We introduce a method that leverages the…

Cosmology and Nongalactic Astrophysics · Physics 2023-12-18 Aizhan Akhmetzhanova , Siddharth Mishra-Sharma , Cora Dvorkin

Estimating mutual information (MI) is a fundamental task in data science and machine learning. Existing estimators mainly rely on either highly flexible models (e.g., neural networks), which require large amounts of data, or overly…

Machine Learning · Computer Science 2025-10-27 Yanzhi Chen , Zijing Ou , Adrian Weller , Michael U. Gutmann

Recently, the importance of analysing data and collecting valuable insight efficiently has been increasing in various fields. Estimating mutual information (MI) plays a critical role to investigate the relationship among multiple random…

Quantum Physics · Physics 2025-03-10 Yota Maeda , Hideaki Kawaguchi , Hiroyuki Tezuka

Estimation of information theoretic quantities such as mutual information and its conditional variant has drawn interest in recent times owing to their multifaceted applications. Newly proposed neural estimators for these quantities have…

Machine Learning · Computer Science 2020-07-24 Arnab Kumar Mondal , Arnab Bhattacharya , Sudipto Mukherjee , Prathosh AP , Sreeram Kannan , Himanshu Asnani

I present several new relations between mutual information (MI) and statistical estimation error for a system that can be regarded simultaneously as a communication channel and as an estimator of an input parameter. I first derive a…

Applications · Statistics 2010-10-08 Sudhakar Prasad

In this work we present a new method for the estimation of Mutual Information (MI) between random variables. Our approach is based on an original interpretation of the Girsanov theorem, which allows us to use score-based diffusion models to…

Machine Learning · Computer Science 2024-05-16 Giulio Franzese , Mustapha Bounoua , Pietro Michiardi

Estimating mutual information (MI) between two continuous random variables $X$ and $Y$ allows to capture non-linear dependencies between them, non-parametrically. As such, MI estimation lies at the core of many data science applications.…

Information Theory · Computer Science 2022-01-19 Alexander Marx , Jonas Fischer

We propose a novel approach to the problem of mutual information (MI) estimation via introducing a family of estimators based on normalizing flows. The estimator maps original data to the target distribution, for which MI is easier to…

Machine Learning · Computer Science 2024-05-28 Ivan Butakov , Alexander Tolmachev , Sofia Malanchuk , Anna Neopryatnaya , Alexey Frolov

The quality of a summarization evaluation metric is quantified by calculating the correlation between its scores and human annotations across a large number of summaries. Currently, it is unclear how precise these correlation estimates are,…

Computation and Language · Computer Science 2021-07-28 Daniel Deutsch , Rotem Dror , Dan Roth

To provide an efficient approach to characterize the input-output mutual information (MI) under additive white Gaussian noise (AWGN) channel, this short report fits the curves of exact MI under multilevel quadrature amplitude modulation…

Information Theory · Computer Science 2019-08-27 Chongjun Ouyang , Sheng Wu , Hongwen Yang

We consider the estimation of a signal from the knowledge of its noisy linear random Gaussian projections, a problem relevant in compressed sensing, sparse superposition codes or code division multiple access just to cite few. There has…

Information Theory · Computer Science 2017-03-24 Jean Barbier , Mohamad Dia , Nicolas Macris , Florent Krzakala

Simulation-based inference enables learning the parameters of a model even when its likelihood cannot be computed in practice. One class of methods uses data simulated with different parameters to infer models of the likelihood-to-evidence…

Machine Learning · Computer Science 2022-06-08 Giulio Isacchini , Natanael Spisak , Armita Nourmohammad , Thierry Mora , Aleksandra M. Walczak

Recent contrastive representation learning methods rely on estimating mutual information (MI) between multiple views of an underlying context. E.g., we can derive multiple views of a given image by applying data augmentation, or we can…

Machine Learning · Computer Science 2021-06-28 Alessandro Sordoni , Nouha Dziri , Hannes Schulz , Geoff Gordon , Phil Bachman , Remi Tachet

We study submodular information measures as a rich framework for generic, query-focused, privacy sensitive, and update summarization tasks. While past work generally treats these problems differently ({\em e.g.}, different models are often…

Machine Learning · Computer Science 2020-10-13 Vishal Kaushal , Suraj Kothawade , Ganesh Ramakrishnan , Jeff Bilmes , Himanshu Asnani , Rishabh Iyer

We define a metric, mutual information in frequency (MI-in-frequency), to detect and quantify the statistical dependence between different frequency components in the data, referred to as cross-frequency coupling and apply it to…

Neurons and Cognition · Quantitative Biology 2018-05-23 Rakesh Malladi , Don H Johnson , Giridhar P Kalamangalam , Nitin Tandon , Behnaam Aazhang

The cosmic 21-cm signal will bring data-driven advances to studies of the Cosmic Dawn (CD) and Epoch of Reionization (EoR). Radio telescopes such as the SKA will eventually map the HI fluctuations over the first billion years - the majority…

Cosmology and Nongalactic Astrophysics · Physics 2024-10-08 David Prelogović , Andrei Mesinger

One of the most complex tasks of decision making and planning is to gather information. This task becomes even more complex when the state is high-dimensional and its belief cannot be expressed with a parametric distribution. Although the…

Artificial Intelligence · Computer Science 2022-09-26 Gilad Rotman , Vadim Indelman

Sliced Mutual Information (SMI) is widely used as a scalable alternative to mutual information for measuring non-linear statistical dependence. Despite its advantages, such as faster convergence, robustness to high dimensionality, and…

Machine Learning · Computer Science 2025-12-10 Alexander Semenenko , Ivan Butakov , Alexey Frolov , Ivan Oseledets