English
Related papers

Related papers: The Mutual Information in Random Linear Estimation…

200 papers

Inverse Reinforcement Learning (IRL) learns an optimal policy, given some expert demonstrations, thus avoiding the need for the tedious process of specifying a suitable reward function. However, current methods are constrained by at least…

Machine Learning · Computer Science 2023-11-16 Pierre Le Pelletier de Woillemont , Rémi Labory , Vincent Corruble

We argue that the estimation of mutual information between high dimensional continuous random variables can be achieved by gradient descent over neural networks. We present a Mutual Information Neural Estimator (MINE) that is linearly…

We introduce a flexible framework for high-dimensional matrix estimation to incorporate side information for both rows and columns. Existing approaches, such as inductive matrix completion, often impose restrictive structure-for example, an…

Methodology · Statistics 2026-03-27 Anish Agarwal , Jungjun Choi , Ming Yuan

The pointwise mutual information profile, or simply profile, is the distribution of pointwise mutual information for a given pair of random variables. One of its important properties is that its expected value is precisely the mutual…

Machine Learning · Statistics 2024-05-30 Paweł Czyż , Frederic Grabowski , Julia E. Vogt , Niko Beerenwinkel , Alexander Marx

We develop a supervised deep-learning approach to estimate mutual information between two continuous random variables. As labels, we use the Linfoot informational correlation, a transformation of mutual information that has many important…

In this paper, we present an approach to enhance interpolation and approximation error estimates. Based on a previously derived first-order Taylor-like formula, we demonstrate its applicability in improving the $P_1$-interpolation error…

Numerical Analysis · Mathematics 2023-10-31 Joel Chaskalovic , Franck Assous

Mutual Information (MI) plays an important role in representation learning. However, MI is unfortunately intractable in continuous and high-dimensional settings. Recent advances establish tractable and scalable MI estimators to discover…

Machine Learning · Statistics 2020-05-05 Liangjian Wen , Yiji Zhou , Lirong He , Mingyuan Zhou , Zenglin Xu

In this work, we investigate data fitting problems with random noises. A randomized progressive iterative regularization method is proposed. It works well for large-scale matrix computations and converges in expectation to the least-squares…

Numerical Analysis · Mathematics 2025-06-05 Dakang Cen , Wenlong Zhang , Junbin Zhong

We introduce an information-theoretic quantity with similar properties to mutual information that can be estimated from data without making explicit assumptions on the underlying distribution. This quantity is based on a recently proposed…

Machine Learning · Computer Science 2023-07-31 Oscar Skean , Jhoan Keider Hoyos Osorio , Austin J. Brockmeier , Luis Gonzalo Sanchez Giraldo

The Heuristic Ratio Estimation (HRE) approach proposes a new way of using the pairwise comparisons matrix. It allows the assumption that the weights of some alternatives (herein referred to as concepts) are known and fixed, hence the weight…

Discrete Mathematics · Computer Science 2015-09-25 Konrad Kułakowski

Information theoretical measures, such as entropy, mutual information, and various divergences, exhibit robust characteristics in image registration applications. However, the estimation of these quantities is computationally intensive in…

Information Theory · Computer Science 2012-10-03 Zoltan Szabo , Andras Lorincz

The i.i.d. assumption is a useful idealization that underpins many successful approaches to supervised machine learning. However, its violation can lead to models that learn to exploit spurious correlations in the training data, rendering…

Machine Learning · Computer Science 2020-06-15 Daniel Pace , Alessandra Russo , Murray Shanahan

Mutual information has many applications in image alignment and matching, mainly due to its ability to measure the statistical dependence between two images, even if the two images are from different modalities (e.g., CT and MRI). It…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Jiecheng Liao , Junhao Lu , Jeff Ji , Jiacheng He

We consider sparse matrix estimation where the goal is to estimate an $n\times n$ matrix from noisy observations of a small subset of its entries. We analyze the estimation error of the popularly utilized collaborative filtering algorithm…

Statistics Theory · Mathematics 2025-07-29 Christian Borgs , Jennifer Chayes , Devavrat Shah , Christina Lee Yu

Mutual information (MI) is one of the most general ways to measure relationships between random variables, but estimating this quantity for complex systems is challenging. Denoising diffusion models have recently set a new bar for density…

Machine Learning · Computer Science 2025-11-20 Longxuan Yu , Xing Shi , Xianghao Kong , Tong Jia , Greg Ver Steeg

We consider the problem of estimating a rank-one nonsymmetric matrix under additive white Gaussian noise. The matrix to estimate can be written as the outer product of two vectors and we look at the special case in which both vectors are…

Probability · Mathematics 2020-10-12 Clément Luneau , Nicolas Macris , Jean Barbier

Discrete inverse problems correspond to solving a system of equations in a stable way with respect to noise in the data. A typical approach to enforce uniqueness and select a meaningful solution is to introduce a regularizer. While for most…

Optimization and Control · Mathematics 2022-04-22 Cristian Vega , Cesare Molinari , Lorenzo Rosasco , Silvia Villa

Several methods of estimating the mutual information of random variables have been developed in recent years. They can prove valuable for novel approaches to learning statistically independent features. In this paper, we use one of these…

Machine Learning · Computer Science 2019-04-23 Hlynur Davíð Hlynsson , Laurenz Wiskott

Recent advances in metareasoning for search has shown its usefulness in improving numerous search algorithms. This paper applies rational metareasoning to IDA* when several admissible heuristics are available. The obvious basic approach of…

Artificial Intelligence · Computer Science 2014-11-25 David Tolpin , Oded Betzalel , Ariel Felner , Solomon Eyal Shimony

Relying on recent advances in statistical estimation of covariance distances based on random matrix theory, this article proposes an improved covariance and precision matrix estimation for a wide family of metrics. The method is shown to…

Machine Learning · Statistics 2021-02-03 Malik Tiomoko , Florent Bouchard , Guillaume Ginholac , Romain Couillet