English
Related papers

Related papers: Non-parametric Conditional Independence Testing fo…

200 papers

Kernel-based conditional independence (KCI) testing is a powerful nonparametric method commonly employed in causal discovery tasks. Despite its flexibility and statistical reliability, cubic computational complexity limits its application…

Machine Learning · Computer Science 2025-12-05 Oliver Schacht , Biwei Huang

This paper develops a conditional independence (CI) test from a conditional density ratio (CDR) for weakly dependent data. The main contribution is presenting a closed-form expression for the estimated conditional density ratio function…

Methodology · Statistics 2025-04-25 Chunrong Ai , Zixuan Xu , Zheng Zhang

We propose an estimator of the Hilbert-Schmidt Independence Criterion obtained from an appropriate modification of the usual estimator. We then get asymptotic normality of this estimator both under independence hypothesis and under the…

Statistics Theory · Mathematics 2022-06-24 Terence Kevin Manfoumbi Djonguet , Guy Martial Nkiet , Alban Mbina Mbina

This paper is concerned with test of the conditional independence. We first establish an equivalence between the conditional independence and the mutual independence. Based on the equivalence, we propose an index to measure the conditional…

Methodology · Statistics 2021-05-18 Zhanrui Cai , Runze Li , Yaowu Zhang

Constraint-based causal discovery methods require a large number of conditional independence (CI) tests, which severely limits their practical applicability due to high computational complexity. Therefore, it is crucial to design an…

Machine Learning · Computer Science 2026-02-10 Shunyu Zhao , Yanfeng Yang , Shuai Li , Kenji Fukumizu

This paper develops a novel nonparametric significance test based on a tailored nonparametric-type projected weighting function that exhibits appealing theoretical and numerical properties. We derive the asymptotic properties of the…

Econometrics · Economics 2026-02-18 Xiaojun Song , Jichao Yuan

The varying-coefficient model is an important nonparametric statistical model that allows us to examine how the effects of covariates vary with exposure variables. When the number of covariates is big, the issue of variable selection…

Statistics Theory · Mathematics 2013-03-05 Jianqing Fan , Yunbei Ma , Wei Dai

We introduce a new machine-learning-based approach, which we call the Independent Classifier networks (InClass nets) technique, for the nonparameteric estimation of conditional independence mixture models (CIMMs). We approach the estimation…

Machine Learning · Statistics 2020-09-02 Konstantin T. Matchev , Prasanth Shyamsundar

Estimating conditional mutual information (CMI) is an essential yet challenging step in many machine learning and data mining tasks. Estimating CMI from data that contains both discrete and continuous variables, or even discrete-continuous…

Information Theory · Computer Science 2021-01-14 Alexander Marx , Lincen Yang , Matthijs van Leeuwen

For testing conditional independence (CI) of a response Y and a predictor X given covariates Z, the recently introduced model-X (MX) framework has been the subject of active methodological research, especially in the context of MX knockoffs…

Statistics Theory · Mathematics 2022-11-01 Eugene Katsevich , Aaditya Ramdas

Conditional independence tests (CI tests) have received special attention lately in Machine Learning and Computational Intelligence related literature as an important indicator of the relationship among the variables used by their models.…

Constraint-based causal discovery algorithms utilize many statistical tests for conditional independence to uncover networks of causal dependencies. These approaches to causal discovery rely on an assumed correspondence between the…

Machine Learning · Computer Science 2025-04-18 Bijan Mazaheri , Jiaqi Zhang , Caroline Uhler

Many relations of scientific interest are nonlinear, and even in linear systems distributions are often non-Gaussian, for example in fMRI BOLD data. A class of search procedures for causal relations in high dimensional data relies on sample…

Artificial Intelligence · Computer Science 2014-01-30 Joseph D. Ramsey

We describe a data-efficient, kernel-based approach to statistical testing of conditional independence. A major challenge of conditional independence testing is to obtain the correct test level (the specified upper bound on the rate of…

Machine Learning · Computer Science 2025-09-23 Roman Pogodin , Antonin Schrab , Yazhe Li , Danica J. Sutherland , Arthur Gretton

Determining conditional independence (CI) relationships between random variables is a fundamental yet challenging task in machine learning and statistics, especially in high-dimensional settings. Existing generative model-based CI testing…

Machine Learning · Computer Science 2025-05-30 Yixin Ren , Chenghou Jin , Yewei Xia , Li Ke , Longtao Huang , Hui Xue , Hao Zhang , Jihong Guan , Shuigeng Zhou

In recent work, Azadkia and Chatterjee (2021) laid out an ingenious approach to defining consistent measures of conditional dependence. Their fully nonparametric approach forms statistics based on ranks and nearest neighbor graphs. The…

Statistics Theory · Mathematics 2022-09-26 Hongjian Shi , Mathias Drton , Fang Han

Conditional independence tests are crucial across various disciplines in determining the independence of an outcome variable $Y$ from a treatment variable $X$, conditioning on a set of confounders $Z$. The Conditional Randomization Test…

Methodology · Statistics 2024-05-30 Bowen Xu , Yiwen Huang , Chuan Hong , Shuangning Li , Molei Liu

Conditional independence (CI) testing is frequently used in data analysis and machine learning for various scientific fields and it forms the basis of constraint-based causal discovery. Oftentimes, CI testing relies on strong, rather…

Methodology · Statistics 2023-06-21 Wiebke Günther , Urmi Ninad , jonas Wahl , Jakob Runge

In broad applications, it is routinely of interest to assess whether there is evidence in the data to refute the assumption of conditional independence of $Y$ and $X$ conditionally on $Z$. Such tests are well developed in parametric models…

Methodology · Statistics 2015-03-25 Tsuyoshi Kunihama , David B. Dunson

The concepts of conditional mutual information (CMI) and normalized conditional mutual information (NCMI) are introduced to measure the concentration and separation performance of a classification deep neural network (DNN) in the output…

Machine Learning · Computer Science 2023-09-19 En-Hui Yang , Shayan Mohajer Hamidi , Linfeng Ye , Renhao Tan , Beverly Yang