English
Related papers

Related papers: A robust estimator of mutual information for deep …

200 papers

We provide an information-theoretic framework for studying the generalization properties of machine learning algorithms. Our framework ties together existing approaches, including uniform convergence bounds and recent methods for adaptive…

Machine Learning · Computer Science 2020-06-22 Thomas Steinke , Lydia Zakynthinou

The concepts of conditional mutual information (CMI) and normalized conditional mutual information (NCMI) are introduced to measure the concentration and separation performance of a classification deep neural network (DNN) in the output…

Machine Learning · Computer Science 2023-09-19 En-Hui Yang , Shayan Mohajer Hamidi , Linfeng Ye , Renhao Tan , Beverly Yang

Modelling highly multi-modal data is a challenging problem in machine learning. Most algorithms are based on maximizing the likelihood, which corresponds to the M(oment)-projection of the data distribution to the model distribution. The…

Machine Learning · Computer Science 2020-01-24 Philipp Becker , Oleg Arenz , Gerhard Neumann

Mutual information is a nonlinear measure used in time series analysis in order to measure the linear and non-linear correlations at any lag $\tau$. The aim of this study is to evaluate some of the most commonly used mutual information…

Chaotic Dynamics · Physics 2008-09-15 A. Papana , D. Kugiumtzis

Quantifying the dependence between high-dimensional random variables is central to statistical learning and inference. Two classical methods are canonical correlation analysis (CCA), which identifies maximally correlated projected versions…

Machine Learning · Computer Science 2023-09-29 Dor Tsur , Ziv Goldfeld , Kristjan Greenewald

We derive closed-form expressions for the Bayes optimal decision boundaries in binary classification of high dimensional overlapping Gaussian mixture model (GMM) data, and show how they depend on the eigenstructure of the class covariances,…

Machine Learning · Statistics 2024-05-29 Khen Cohen , Noam Levi , Yaron Oz

The Maximum Mutual Information (MMI) criterion is different from the Least Error Rate (LER) criterion. It can reduce failing to report small probability events. This paper introduces the Channels Matching (CM) algorithm for the MMI…

Machine Learning · Computer Science 2019-01-30 Chenguang Lu

We show that a collection of Gaussian mixture models (GMMs) in $R^{n}$ can be optimally classified using $O(n)$ neurons in a neural network with two hidden layers (deep neural network), whereas in contrast, a neural network with a single…

Machine Learning · Computer Science 2019-02-18 Shirin Jalali , Carl Nuzman , Iraj Saniee

Generalized mutual information (GMI) is used to compute achievable rates for fading channels with various types of channel state information at the transmitter (CSIT) and receiver (CSIR). The GMI is based on variations of auxiliary channel…

Information Theory · Computer Science 2023-05-23 Gerhard Kramer

We consider the estimation of a signal from the knowledge of its noisy linear random Gaussian projections, a problem relevant in compressed sensing, sparse superposition codes or code division multiple access just to cite few. There has…

Information Theory · Computer Science 2017-03-24 Jean Barbier , Mohamad Dia , Nicolas Macris , Florent Krzakala

Quantifying predictive uncertainty is essential for real world machine learning applications, especially in scenarios requiring reliable and interpretable predictions. Many common parametric approaches rely on neural networks to estimate…

Machine Learning · Statistics 2026-03-31 Yang Yang , Chunlin Ji , Haoyang Li , Ke Deng

Masked Image Modeling (MIM) techniques have redefined the landscape of computer vision, enabling pre-trained models to achieve exceptional performance across a broad spectrum of tasks. Despite their success, the full potential of MIM-based…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Sumin Son , Hyesong Choi , Dongbo Min

Understanding the contribution of individual features in predictive models remains a central goal in interpretable machine learning, and while many model-agnostic methods exist to estimate feature importance, they often fall short in…

Machine Learning · Computer Science 2025-07-08 Ivan Lazic , Chiara Barà , Marta Iovino , Sebastiano Stramaglia , Niksa Jakovljevic , Luca Faes

The task of infomin learning aims to learn a representation with high utility while being uninformative about a specified target, with the latter achieved by minimising the mutual information between the representation and the target. It…

Machine Learning · Computer Science 2023-02-22 Yanzhi Chen , Weihao Sun , Yingzhen Li , Adrian Weller

One of the fundamental problems in machine learning is the estimation of a probability distribution from data. Many techniques have been proposed to study the structure of data, most often building around the assumption that observations…

Machine Learning · Statistics 2013-02-22 Oren Rippel , Ryan Prescott Adams

In recent years, there has been a significant increase in applications of multimodal signal processing and analysis, largely driven by the increased availability of multimodal datasets and the rapid progress in multimodal learning systems.…

Image and Video Processing · Electrical Eng. & Systems 2024-05-22 Hadi Hadizadeh , S. Faegheh Yeganli , Bahador Rashidi , Ivan V. Bajić

We present two classes of improved estimators for mutual information $M(X,Y)$, from samples of random points distributed according to some joint probability density $\mu(x,y)$. In contrast to conventional estimators based on binnings, they…

Statistical Mechanics · Physics 2009-11-10 Alexander Kraskov , Harald Stoegbauer , Peter Grassberger

Large language models (LLMs) are powerful tools that, in a number of settings, overlap with the results of human pattern recognition and reasoning. Retrieval-augmented generation (RAG) further allows LLMs to produce tailored output…

Computation and Language · Computer Science 2026-04-07 Edward L. Wang , Mohammad Sharifi Kiasari , Tianyu Wang , Hayden Helm , Avanti Athreya , Carey Priebe , Vince Lyzinski

In learning theory, a standard assumption is that the data is generated from a finite mixture model. But what happens when the number of components is not known in advance? The problem of estimating the number of components, also called…

Data Structures and Algorithms · Computer Science 2023-04-25 Jerry Li , Allen Liu , Ankur Moitra

The information theoretic quantity known as mutual information finds wide use in classification and community detection analyses to compare two classifications of the same set of objects into groups. In the context of classification…

Social and Information Networks · Computer Science 2020-04-29 M. E. J. Newman , George T. Cantwell , Jean-Gabriel Young