English
Related papers

Related papers: Mutual Information Multinomial Estimation

200 papers

We address the practical problems of estimating the information relations that characterize large networks. Building on methods developed for analysis of the neural code, we show that reliable estimates of mutual information can be obtained…

Information Theory · Computer Science 2007-07-13 Noam Slonim , Gurinder S. Atwal , Gasper Tkacik , William Bialek

Mutual information (MI) is a fundamental measure of statistical dependence, with a myriad of applications to information theory, statistics, and machine learning. While it possesses many desirable structural properties, the estimation of…

Information Theory · Computer Science 2021-10-19 Ziv Goldfeld , Kristjan Greenewald

Mutual information is commonly used as a measure of similarity between competing labelings of a given set of objects, for example to quantify performance in classification and community detection tasks. As argued recently, however, the…

Social and Information Networks · Computer Science 2025-07-17 Maximilian Jerdee , Alec Kirkley , M. E. J. Newman

We present a numerical method to evaluate mutual information (MI) in nonlinear Gaussian noise channels by using denoising score matching (DSM) learning for estimating the score function of channel output. Via de Bruijn's identity, Fisher…

Information Theory · Computer Science 2026-01-06 Tadashi Wadayama

In this paper we focus on the estimation of mutual information from finite samples $(\mathcal{X}\times\mathcal{Y})$. The main concern with estimations of mutual information is their robustness under the class of transformations for which it…

Data Analysis, Statistics and Probability · Physics 2020-02-04 Nicholas Carrara , Jesse Ernst

We investigate the sets of joint probability distributions that maximize the average multi-information over a collection of margins. These functionals serve as proxies for maximizing the multi-information of a set of variables or the mutual…

Information Theory · Computer Science 2019-06-14 Thomas Merkh , Guido Montúfar

By combining a bound on the absolute value of the difference of mutual information between two joint probablity distributions with a fixed variational distance, and a bound on the probability of a maximal deviation in variational distance…

Information Theory · Computer Science 2013-01-29 A. G. Stefani , J. B. Huber , C. Jardin , H. Sticht

Mutual Information (MI) is a fundamental metric for quantifying dependency between two random variables. When we can access only the samples, but not the underlying distribution functions, we can evaluate MI using sample-based estimators.…

Machine Learning · Statistics 2024-10-16 Kyungeun Lee , Wonjong Rhee

I present several new relations between mutual information (MI) and statistical estimation error for a system that can be regarded simultaneously as a communication channel and as an estimator of an input parameter. I first derive a…

Applications · Statistics 2010-10-08 Sudhakar Prasad

Multivariate pattern analyses approaches in neuroimaging are fundamentally concerned with investigating the quantity and type of information processed by various regions of the human brain; typically, estimates of classification accuracy…

Machine Learning · Statistics 2016-10-11 Charles Y. Zheng , Yuval Benjamini

Mutual information (MI) is a general measure of statistical dependence with widespread application across the sciences. However, estimating MI between multi-dimensional variables is challenging because the number of samples necessary to…

Quantitative Methods · Quantitative Biology 2025-03-06 Gokul Gowri , Xiao-Kang Lun , Allon M. Klein , Peng Yin

This paper presents expression of mutual information that defines the information gain in planning of sensing resources, when the goal is to reduce the forecast uncertainty of some quantities of interest and the system dynamics is described…

Systems and Control · Computer Science 2013-08-02 Han-Lim Choi

We introduce an information-theoretic quantity with similar properties to mutual information that can be estimated from data without making explicit assumptions on the underlying distribution. This quantity is based on a recently proposed…

Machine Learning · Computer Science 2023-07-31 Oscar Skean , Jhoan Keider Hoyos Osorio , Austin J. Brockmeier , Luis Gonzalo Sanchez Giraldo

As a fundamental concept in information theory, mutual information ($MI$) has been commonly applied to quantify association between random vectors. Most existing nonparametric estimators of $MI$ have unstable statistical performance since…

Applications · Statistics 2025-02-19 Soumik Purkayastha , Peter X. K. Song

We introduce the Mutual Information Machine (MIM), a probabilistic auto-encoder for learning joint distributions over observations and latent variables. MIM reflects three design principles: 1) low divergence, to encourage the encoder and…

Machine Learning · Computer Science 2020-02-24 Micha Livne , Kevin Swersky , David J. Fleet

Forecasting techniques for assessing the power of future experiments to discriminate between theories or discover new laws of nature are of great interest in many areas of science. In this paper, we introduce a Bayesian forecasting method…

Data Analysis, Statistics and Probability · Physics 2024-09-24 Mohammad Hossein Namjoo

Mutual information $I(X;Y)$ is a useful definition in information theory to estimate how much information the random variable $Y$ holds about the random variable $X$. One way to define the mutual information is by comparing the joint…

Information Theory · Computer Science 2022-04-14 Bulut Kuskonmaz , Jaron Skovsted Gundersen , Rafal Wisniewski

Pimentel et al. (2020) recently analysed probing from an information-theoretic perspective. They argue that probing should be seen as approximating a mutual information. This led to the rather unintuitive conclusion that representations…

Computation and Language · Computer Science 2021-09-10 Tiago Pimentel , Ryan Cotterell

Text-to-image generation and image captioning are recently emerged as a new experimental paradigm to assess machine intelligence. They predict continuous quantity accompanied by their sampling techniques in the generation, making evaluation…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Jin-Hwa Kim , Yunji Kim , Jiyoung Lee , Kang Min Yoo , Sang-Woo Lee

The ability to compress observational data and accurately estimate physical parameters relies heavily on informative summary statistics. In this paper, we introduce the use of mutual information (MI) as a means of evaluating the quality of…

Cosmology and Nongalactic Astrophysics · Physics 2023-07-12 Ce Sui , Xiaosheng Zhao , Tao Jing , Yi Mao