English
Related papers

Related papers: The Generalized Mean Information Coefficient

200 papers

Total correlation (TC) is a fundamental concept in information theory that measures statistical dependency among multiple random variables. Recently, TC has shown noticeable effectiveness as a regularizer in many learning tasks, where the…

Information Theory · Computer Science 2023-02-23 Ke Bai , Pengyu Cheng , Weituo Hao , Ricardo Henao , Lawrence Carin

Integrative analysis of data from multiple sources is critical to making generalizable discoveries. Associations that are consistently observed across multiple source populations are more likely to be generalized to target populations with…

Methodology · Statistics 2022-12-19 Zijian Guo

Mutual information (MI) is an information-theoretic measure of dependency between two random variables. Several methods to estimate MI, from samples of two random variables with unknown underlying probability distributions have been…

Machine Learning · Computer Science 2020-11-18 P Aditya Sreekar , Ujjwal Tiwari , Anoop Namboodiri

In Science, Reshef et al. (2011) proposed the concept of equitability for measures of dependence between two random variables. To this end, they proposed a novel measure, the maximal information coefficient (MIC). Recently a PNAS paper…

Methodology · Statistics 2023-04-17 A. Adam Ding , Yi Li

Recent work~\cite{Liu2016} has shown that dependencies between items in a dataset can lead to privacy leaks. We extend this concept to privacy-preserving transformations, considering a broader set of dependencies captured by correlation…

Cryptography and Security · Computer Science 2025-06-17 Kenneth Odoh

This article proposes a new method to estimate an existing mutual information based dependence measure using histogram density estimates. Finding a suitable bin length for histogram is an open problem. We propose a new way of computing the…

Information Theory · Computer Science 2015-09-15 Namita Jain , C. A. Murthy

Mutual information (MI) is a fundamental measure of statistical dependence, with a myriad of applications to information theory, statistics, and machine learning. While it possesses many desirable structural properties, the estimation of…

Information Theory · Computer Science 2021-10-19 Ziv Goldfeld , Kristjan Greenewald

The Mutual Information (MI) is an often used measure of dependency between two random variables utilized in information theory, statistics and machine learning. Recently several MI estimators have been proposed that can achieve parametric…

Information Theory · Computer Science 2018-11-26 Morteza Noshad , Yu Zeng , Alfred O. Hero

This paper proposes a geometric estimator of dependency between a pair of multivariate samples. The proposed estimator of dependency is based on a randomly permuted geometric graph (the minimal spanning tree) over the two multivariate…

Machine Learning · Computer Science 2019-10-02 Salimeh Yasaei Sekeh , Alfred O. Hero

This paper proposes a criterion for simultaneous GMM model and moment selection: the generalized focused information criterion (GFIC). Rather than attempting to identify the "true" specification, the GFIC chooses from a set of potentially…

Econometrics · Economics 2020-11-17 Minsu Chang , Francis J. DiTraglia

Mutual Information (MI) is a powerful statistical measure that quantifies shared information between random variables, particularly valuable in high-dimensional data analysis across fields like genomics, natural language processing, and…

Machine Learning · Computer Science 2024-12-02 Andre O. Falcao

Conditional Mutual Information (CMI) is a measure of conditional dependence between random variables X and Y, given another random variable Z. It can be used to quantify conditional dependence among variables in many data-driven inference…

Machine Learning · Computer Science 2019-06-10 Sudipto Mukherjee , Himanshu Asnani , Sreeram Kannan

Generalized mutual information (GMI) is used to compute achievable rates for fading channels with various types of channel state information at the transmitter (CSIT) and receiver (CSIR). The GMI is based on variations of auxiliary channel…

Information Theory · Computer Science 2023-05-23 Gerhard Kramer

We propose a fully data-driven approach to designing mutual information (MI) estimators. Since any MI estimator is a function of the observed sample from two random variables, we parameterize this function with a neural network (MIST) and…

Machine Learning · Computer Science 2026-02-24 German Gritsai , Megan Richards , Maxime Méloux , Kyunghyun Cho , Maxime Peyrard

Estimating mutual information (MI) from samples is a fundamental problem in statistics, machine learning, and data analysis. Recently it was shown that a popular class of non-parametric MI estimators perform very poorly for strongly…

Information Theory · Computer Science 2016-02-18 Shuyang Gao , Greg Ver Steeg , Aram Galstyan

Understanding the relationships between different properties of data, such as whether a connectome or genome has information about disease status, is becoming increasingly important in modern biological datasets. While existing approaches…

Machine Learning · Statistics 2024-06-27 Joshua T. Vogelstein , Eric Bridgeford , Qing Wang , Carey E. Priebe , Mauro Maggioni , Cencheng Shen

Mutual information (MI) is a fundamental measure of statistical dependence between two variables, yet accurate estimation from finite data remains notoriously difficult. No estimator is universally reliable, and common approaches fail in…

Data Analysis, Statistics and Probability · Physics 2025-10-02 Eslam Abdelaleem , K. Michael Martini , Ilya Nemenman

It is of importance to investigate the significance of a subset of covariates $W$ for the response $Y$ given covariates $Z$ in regression modeling. To this end, we propose a significance test for the partial mean independence problem based…

Methodology · Statistics 2024-06-06 Leheng Cai , Xu Guo , Wei Zhong

Generalized category discovery presents a challenge in a realistic scenario, which requires the model's generalization ability to recognize unlabeled samples from known and unknown categories. This paper revisits the challenge of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Zhaorui Tan , Chengrui Zhang , Xi Yang , Jie Sun , Kaizhu Huang

Data reproducibility is a critical issue in all scientific experiments. In this manuscript, we consider the problem of quantifying the reproducibility of graphical measurements. We generalize the concept of image intra-class correlation…

Methodology · Statistics 2013-11-20 Chen Yue , Shaojie Chen , Haris I. Sair , Raag Airan , Brian S. Caffo