English
Related papers

Related papers: CCMI : Classifier based Conditional Mutual Informa…

200 papers

Estimation of information theoretic quantities such as mutual information and its conditional variant has drawn interest in recent times owing to their multifaceted applications. Newly proposed neural estimators for these quantities have…

Machine Learning · Computer Science 2020-07-24 Arnab Kumar Mondal , Arnab Bhattacharya , Sudipto Mukherjee , Prathosh AP , Sreeram Kannan , Himanshu Asnani

The estimation of mutual information (MI) or conditional mutual information (CMI) from a set of samples is a long-standing problem. A recent line of work in this area has leveraged the approximation power of artificial neural networks and…

Information Theory · Computer Science 2021-10-27 Sina Molavipour , Germán Bassi , Mikael Skoglund

Mutual Information (MI) and Conditional Mutual Information (CMI) are multi-purpose tools from information theory that are able to naturally measure the statistical dependencies between random variables, thus they are usually of central…

Machine Learning · Computer Science 2022-11-22 Bao Duong , Thin Nguyen

Conditional independence testing (CIT) is a common task in machine learning, e.g., for variable selection, and a main component of constraint-based causal discovery. While most current CIT approaches assume that all variables are numerical…

Machine Learning · Computer Science 2023-11-07 Oana-Iuliana Popescu , Andreas Gerhardus , Jakob Runge

Several recent works in communication systems have proposed to leverage the power of neural networks in the design of encoders and decoders. In this approach, these blocks can be tailored to maximize the transmission rate based on…

Information Theory · Computer Science 2020-07-15 Sina Molavipour , Germán Bassi , Mikael Skoglund

Mutual information (MI) is a useful information-theoretic measure to quantify the statistical dependence between two random variables: $X$ and $Y$. Often, we are interested in understanding how the dependence between $X$ and $Y$ in one set…

Information Theory · Computer Science 2025-07-22 Chetan Gohil , Oliver M Cliff , James M. Shine , Ben D. Fulcher , Joseph T. Lizier

The conditional mutual information I(X;Y|Z) measures the average information that X and Y contain about each other given Z. This is an important primitive in many learning problems including conditional independence testing, graphical model…

Information Theory · Computer Science 2017-10-16 Arman Rahimzamani , Sreeram Kannan

Conditional independence testing is a fundamental problem underlying causal discovery and a particularly challenging task in the presence of nonlinear and high-dimensional dependencies. Here a fully non-parametric test for continuous data…

Machine Learning · Statistics 2017-09-06 Jakob Runge

Conditional independence (CI) testing is a fundamental task in modern statistics and machine learning. The conditional randomization test (CRT) was recently introduced to test whether two random variables, $X$ and $Y$, are conditionally…

Machine Learning · Statistics 2024-12-19 Yanfeng Yang , Shuai Li , Yingjie Zhang , Zhuoran Sun , Hai Shu , Ziqi Chen , Renming Zhang

Fields like public health, public policy, and social science often want to quantify the degree of dependence between variables whose relationships take on unknown functional forms. Typically, in fact, researchers in these fields are…

Statistics Theory · Mathematics 2019-12-10 Octavio César Mesner , Cosma Rohilla Shalizi

Estimating conditional mutual information (CMI) is an essential yet challenging step in many machine learning and data mining tasks. Estimating CMI from data that contains both discrete and continuous variables, or even discrete-continuous…

Information Theory · Computer Science 2021-01-14 Alexander Marx , Lincen Yang , Matthijs van Leeuwen

Estimating mutual information between continuous random variables is often intractable and extremely challenging for high-dimensional data. Recent progress has leveraged neural networks to optimize variational lower bounds on mutual…

Machine Learning · Computer Science 2020-12-01 Ruizhi Liao , Daniel Moyer , Polina Golland , William M. Wells

The concepts of conditional mutual information (CMI) and normalized conditional mutual information (NCMI) are introduced to measure the concentration and separation performance of a classification deep neural network (DNN) in the output…

Machine Learning · Computer Science 2023-09-19 En-Hui Yang , Shayan Mohajer Hamidi , Linfeng Ye , Renhao Tan , Beverly Yang

We provide an information-theoretic framework for studying the generalization properties of machine learning algorithms. Our framework ties together existing approaches, including uniform convergence bounds and recent methods for adaptive…

Machine Learning · Computer Science 2020-06-22 Thomas Steinke , Lydia Zakynthinou

The identification of relevant features, i.e., the driving variables that determine a process or the properties of a system, is an essential part of the analysis of data sets with a large number of variables. A mathematical rigorous…

Machine Learning · Statistics 2022-08-02 Benjamin Regler , Matthias Scheffler , Luca M. Ghiringhelli

The conditional mutual information quantifies the conditional dependence of two random variables. It has numerous applications; it forms, for example, part of the definition of transfer entropy, a common measure of the causal relationship…

Information Theory · Computer Science 2024-04-15 Jake Witter , Conor Houghton

Conditional independence testing is an important problem, especially in Bayesian network learning and causal discovery. Due to the curse of dimensionality, testing for conditional independence of continuous variables is particularly…

Machine Learning · Computer Science 2012-02-20 Kun Zhang , Jonas Peters , Dominik Janzing , Bernhard Schoelkopf

Conditional mean independence (CMI) testing is crucial for statistical tasks including model determination and variable importance evaluation. In this work, we introduce a novel population CMI measure and a bootstrap-based testing procedure…

Machine Learning · Statistics 2025-01-30 Yi Zhang , Linjun Huang , Yun Yang , Xiaofeng Shao

We demonstrate that a popular class of nonparametric mutual information (MI) estimators based on k-nearest-neighbor graphs requires number of samples that scales exponentially with the true MI. Consequently, accurate estimation of MI…

Information Theory · Computer Science 2015-03-09 Shuyang Gao , Greg Ver Steeg , Aram Galstyan

Mutual information (MI) is a fundamental measure of statistical dependence, with a myriad of applications to information theory, statistics, and machine learning. While it possesses many desirable structural properties, the estimation of…

Information Theory · Computer Science 2021-10-19 Ziv Goldfeld , Kristjan Greenewald
‹ Prev 1 2 3 10 Next ›