English
Related papers

Related papers: Mutual Information Multinomial Estimation

200 papers

Class imbalance and distributional differences in large datasets present significant challenges for classification tasks machine learning, often leading to biased models and poor predictive performance for minority classes. This work…

Machine Learning · Statistics 2024-12-20 Alex Mak , Shubham Sahoo , Shivani Pandey , Yidan Yue , Linglong Kong

Reconstructing the structural connectivity between interacting units from observed activity is a challenge across many different disciplines. The fundamental first step is to establish whether or to what extent the interactions between the…

Neurons and Cognition · Quantitative Biology 2016-11-02 Elliot A. Martin , Jaroslav Hlinka , Jörn Davidsen

Subtraction of aligned images is a means to assess changes in a wide variety of clinical applications. In this paper we explore the information theoretical origin of Mutual Information (MI), which is based on Shannon's entropy.However, the…

Computer Vision and Pattern Recognition · Computer Science 2007-06-19 W. Jacquet , P. de Groen

We propose to use precise estimators of mutual information (MI) to find least dependent components in a linearly mixed signal. On the one hand this seems to lead to better blind source separation than with any other presently available…

Computational Physics · Physics 2007-07-16 Harald Stögbauer , Alexander Kraskov , Sergey A. Astakhov , Peter Grassberger

To provide an efficient approach to characterize the input-output mutual information (MI) under additive white Gaussian noise (AWGN) channel, this short report fits the curves of exact MI under multilevel quadrature amplitude modulation…

Information Theory · Computer Science 2019-08-27 Chongjun Ouyang , Sheng Wu , Hongwen Yang

Mutual information provides a powerful, general-purpose metric for quantifying the amount of shared information between variables. Estimating normalized mutual information using a k-Nearest Neighbor (k-NN) based approach involves the…

Information Theory · Computer Science 2025-07-10 Marko Tuononen , Ville Hautamäki

As digital data transmission continues to scale, concerns about privacy grow increasingly urgent - yet privacy remains a socially constructed and ambiguously defined concept, lacking a universally accepted quantitative measure. This work…

Cryptography and Security · Computer Science 2025-08-13 Ikram Messadi , Giulia Cervia , Vincent Itier

Since its inception, the neural estimation of mutual information (MI) has demonstrated the empirical success of modeling expected dependency between high-dimensional random variables. However, MI is an aggregate statistic and cannot be used…

Machine Learning · Computer Science 2020-10-16 Yao-Hung Hubert Tsai , Han Zhao , Makoto Yamada , Louis-Philippe Morency , Ruslan Salakhutdinov

One of the most fundamental questions one can ask about a pair of random variables X and Y is the value of their mutual information. Unfortunately, this task is often stymied by the extremely large dimension of the variables. We might hope…

Statistical Mechanics · Physics 2017-06-21 Ryan G. James , John R. Mahoney , James P. Crutchfield

A novel information-theoretic approach is proposed to assess the global practical identifiability of Bayesian statistical models. Based on the concept of conditional mutual information, an estimate of information gained for each model…

Methodology · Statistics 2024-04-22 Sahil Bhola , Karthik Duraisamy

Mutual information is one of the essential building blocks of information theory. Yet, it is only finitely defined for distributions with fast decaying tails on a countable joint alphabet of two random elements. The unboundedness of mutual…

Information Theory · Computer Science 2019-07-15 Zhiyi Zhang

Consider statistical learning (e.g. discrete distribution estimation) with local $\epsilon$-differential privacy, which preserves each data provider's privacy locally, we aim to optimize statistical data utility under the privacy…

Information Theory · Computer Science 2016-07-28 Shaowei Wang , Liusheng Huang , Pengzhan Wang , Yiwen Nie , Hongli Xu , Wei Yang , Xiang-Yang Li , Chunming Qiao

The task of infomin learning aims to learn a representation with high utility while being uninformative about a specified target, with the latter achieved by minimising the mutual information between the representation and the target. It…

Machine Learning · Computer Science 2023-02-22 Yanzhi Chen , Weihao Sun , Yingzhen Li , Adrian Weller

Mutual information (MI) minimization has gained considerable interests in various machine learning tasks. However, estimating and minimizing MI in high-dimensional spaces remains a challenging problem, especially when only samples, rather…

Machine Learning · Computer Science 2020-07-27 Pengyu Cheng , Weituo Hao , Shuyang Dai , Jiachang Liu , Zhe Gan , Lawrence Carin

We are assisting at a growing interest in the development of learning architectures with application to digital communication systems. Herein, we consider the detection/decoding problem. We aim at developing an optimal neural architecture…

Information Theory · Computer Science 2022-09-02 Andrea M. Tonello , Nunzio A. Letizia

In this survey, we present and compare different approaches to estimate Mutual Information (MI) from data to analyse general dependencies between variables of interest in a system. We demonstrate the performance difference of MI versus…

Machine Learning · Statistics 2015-06-18 D. Gencaga , N. K. Malakar , D. J. Lary

Mutual Information (MI) is often used for feature selection when developing classifier models. Estimating the MI for a subset of features is often intractable. We demonstrate, that under the assumptions of conditional independence, MI…

Machine Learning · Computer Science 2017-06-26 Hemanth Venkateswara , Prasanth Lade , Binbin Lin , Jieping Ye , Sethuraman Panchanathan

Information estimates such as the ``direct method'' of Strong et al. (1998) sidestep the difficult problem of estimating the joint distribution of response and stimulus by instead estimating the difference between the marginal and…

Neurons and Cognition · Quantitative Biology 2008-07-19 Vincent Q. Vu , Bin Yu , Robert E. Kass

Multiple importance sampling (MIS) methods use a set of proposal distributions from which samples are drawn. Each sample is then assigned an importance weight that can be obtained according to different strategies. This work is motivated by…

Computation · Statistics 2015-05-21 Víctor Elvira , Luca Martino , David Luengo , Mónica F. Bugallo

We consider the estimation of a signal from the knowledge of its noisy linear random Gaussian projections. A few examples where this problem is relevant are compressed sensing, sparse superposition codes, and code division multiple access.…

Information Theory · Computer Science 2020-08-31 Jean Barbier , Nicolas Macris , Mohamad Dia , Florent Krzakala