English
Related papers

Related papers: The Mutual Information in Random Linear Estimation

200 papers

Estimating mutual information from observed samples is a basic primitive, useful in several machine learning tasks including correlation mining, information bottleneck clustering, learning a Chow-Liu tree, and conditional independence…

Information Theory · Computer Science 2018-10-11 Weihao Gao , Sreeram Kannan , Sewoong Oh , Pramod Viswanath

This paper considers the problem of recovering a structured signal from a relatively small number of noisy measurements with the aid of a similar signal which is known beforehand. We propose a new approach to integrate prior information…

Information Theory · Computer Science 2018-08-06 Xu Zhang , Wei Cui , Yulong Liu

We analyze the asymptotic performance of sparse signal recovery from noisy measurements. In particular, we generalize some of the existing results for the Gaussian case to subgaussian and other ensembles. An achievable result is presented…

Information Theory · Computer Science 2009-04-30 Paul Tune , Sibiraj Bhaskaran Pillai , Stephen Hanly

With the success of self-supervised representations, researchers seek a better understanding of the information encapsulated within a representation. Among various interpretability methods, we focus on classification-based linear probing.…

Information Theory · Computer Science 2023-12-18 Kwanghee Choi , Jee-weon Jung , Shinji Watanabe

We consider the high-dimensional inference problem where the signal is a low-rank symmetric matrix which is corrupted by an additive Gaussian noise. Given a probabilistic model for the low-rank matrix, we compute the limit in the large…

Probability · Mathematics 2017-03-31 Marc Lelarge , Léo Miolane

We assume the direct sum <A> o <B> for the signal subspace. As a result of post- measurement, a number of operational contexts presuppose the a priori knowledge of the LB -dimensional "interfering" subspace <B> and the goal is to estimate…

Applications · Statistics 2017-04-17 Guillaume Bouleux , Rémy Boyer

We calculate the mutual information (MI) of a two-layered neural network with noiseless, continuous inputs and binary, stochastic outputs under several assumptions on the synaptic efficiencies. The interesting regime corresponds to the…

Disordered Systems and Neural Networks · Physics 2009-10-31 Antonio Turiel , Elka Korutcheva , Nestor Parga

Estimating mutual information between continuous random variables is often intractable and extremely challenging for high-dimensional data. Recent progress has leveraged neural networks to optimize variational lower bounds on mutual…

Machine Learning · Computer Science 2020-12-01 Ruizhi Liao , Daniel Moyer , Polina Golland , William M. Wells

Weakly supervised question answering usually has only the final answers as supervision signals while the correct solutions to derive the answers are not provided. This setting gives rise to the spurious solution problem: there may exist…

Computation and Language · Computer Science 2021-06-15 Zhihong Shao , Lifeng Shang , Qun Liu , Minlie Huang

Sensor placement approaches in networks often involve using information-theoretic measures such as entropy and mutual information. We prove that mutual information abides by submodularity and is non-decreasing when considering the mutual…

Information Theory · Computer Science 2024-09-06 George Crowley , Inaki Esnaola

Minimum mean square error (MMSE) estimation of block sparse signals from noisy linear measurements is considered. Unlike in the standard compressive sensing setup where the non-zero entries of the signal are independently and uniformly…

Information Theory · Computer Science 2012-04-26 Mikko Vehkaperä , Saikat Chatterjee , Mikael Skoglund

In continuation to a recent work on the statistical--mechanical analysis of minimum mean square error (MMSE) estimation in Gaussian noise via its relation to the mutual information (the I-MMSE relation), here we propose a simple and more…

Information Theory · Computer Science 2016-11-17 Neri Merhav

While the linear Pearson correlation coefficient represents a well-established normalized measure to quantify the interrelation of two stochastic variables $X$ and $Y$, it fails for multidimensional variables such as Cartesian coordinates.…

Data Analysis, Statistics and Probability · Physics 2024-09-19 Daniel Nagel , Georg Diez , Gerhard Stock

The I-MMSE formula connects two important quantities in information theory and estimation theory: the mutual information and the minimum mean-squared error (MMSE). It states that in a scalar Gaussian channel, the derivative of the mutual…

Information Theory · Computer Science 2024-08-27 Minh-Toan Nguyen

In this paper we focus on the estimation of mutual information from finite samples $(\mathcal{X}\times\mathcal{Y})$. The main concern with estimations of mutual information is their robustness under the class of transformations for which it…

Data Analysis, Statistics and Probability · Physics 2020-02-04 Nicholas Carrara , Jesse Ernst

We consider the information fiber optical channel modeled by the nonlinear Schrodinger equation with additive Gaussian noise. Using path-integral approach and perturbation theory for the small dimensionless parameter of the second…

Information Theory · Computer Science 2023-08-03 A. V. Reznichenko , V. O. Guba

Multivariate pattern analyses approaches in neuroimaging are fundamentally concerned with investigating the quantity and type of information processed by various regions of the human brain; typically, estimates of classification accuracy…

Machine Learning · Statistics 2016-10-11 Charles Y. Zheng , Yuval Benjamini

We address the practical problems of estimating the information relations that characterize large networks. Building on methods developed for analysis of the neural code, we show that reliable estimates of mutual information can be obtained…

Information Theory · Computer Science 2007-07-13 Noam Slonim , Gurinder S. Atwal , Gasper Tkacik , William Bialek

When recovering a sparse signal from noisy compressive linear measurements, the distribution of the signal's non-zero coefficients can have a profound effect on recovery mean-squared error (MSE). If this distribution was apriori known, then…

Information Theory · Computer Science 2015-06-05 Jeremy P. Vila , Philip Schniter

We derive a tight lower bound on equivocation (conditional entropy), or equivalently a tight upper bound on mutual information between a signal variable and channel outputs. The bound is in terms of the joint distribution of the signals and…

Information Theory · Computer Science 2019-01-14 Michal Hledík , Thomas R. Sokolowski , Gašper Tkačik