English
Related papers

Related papers: On the power of conditional independence testing u…

200 papers

Detecting conditional independencies plays a key role in several statistical and machine learning tasks, especially in causal discovery algorithms. In this study, we introduce LCIT (Latent representation based Conditional Independence…

Machine Learning · Computer Science 2022-09-07 Bao Duong , Thin Nguyen

Conditional independence testing (CIT) is essential for reliable scientific discovery. It prevents spurious findings and enables controlled feature selection. Recent CIT methods have used machine learning (ML) models as surrogates of the…

Statistics Theory · Mathematics 2026-02-02 Angel Reyero-Lobo , Bertrand Thirion , Pierre Neuvial

We propose the conditional predictive impact (CPI), a consistent and unbiased estimator of the association between one or several features and a given outcome, conditional on a reduced feature set. Building on the knockoff framework of…

Methodology · Statistics 2021-05-14 David S. Watson , Marvin N. Wright

Switchback experiments--alternating treatment and control over time--are widely used when unit-level randomization is infeasible, outcomes are aggregated, or user interference is unavoidable. In practice, experimentation must support fast…

Methodology · Statistics 2026-02-27 Jizhou Liu , Liang Zhong

Conditional independence testing (CIT) is a common task in machine learning, e.g., for variable selection, and a main component of constraint-based causal discovery. While most current CIT approaches assume that all variables are numerical…

Machine Learning · Computer Science 2023-11-07 Oana-Iuliana Popescu , Andreas Gerhardus , Jakob Runge

Conditional independence (CI) is central to causal inference, feature selection, and graphical modeling, yet it is untestable in many settings without additional assumptions. Existing CI tests often rely on restrictive structural…

Machine Learning · Computer Science 2025-12-23 Alek Frohlich , Vladimir Kostic , Karim Lounici , Daniel Perazzo , Massimiliano Pontil

We propose a general new method, the conditional permutation test, for testing the conditional independence of variables $X$ and $Y$ given a potentially high-dimensional random vector $Z$ that may contain confounding factors. The proposed…

Methodology · Statistics 2019-05-08 Thomas B. Berrett , Yi Wang , Rina Foygel Barber , Richard J. Samworth

Conditional independence testing is a key problem required by many machine learning and statistics tools. In particular, it is one way of evaluating the usefulness of some features on a supervised prediction problem. We propose a novel…

Machine Learning · Statistics 2019-08-02 Marco Henrique de Almeida Inácio , Rafael Izbicki , Rafael Bassi Stern

This paper introduces an innovative method for conducting conditional independence testing in high-dimensional data, facilitating the automated discovery of significant associations within distinct subgroups of a population, all while…

Methodology · Statistics 2023-09-19 Matteo Sesia , Tianshu Sun

We introduce a new test for conditional independence which is based on what we call the weighted generalised covariance measure (WGCM). It is an extension of the recently introduced generalised covariance measure (GCM). To test the null…

Methodology · Statistics 2022-05-17 Cyrill Scheidegger , Julia Hörrmann , Peter Bühlmann

Tests of conditional independence (CI) underpin a number of important problems in machine learning and statistics, from causal discovery to evaluation of predictor fairness and out-of-distribution robustness. Shah and Peters (2020) showed…

Machine Learning · Statistics 2025-12-17 Zheng He , Roman Pogodin , Yazhe Li , Namrata Deka , Arthur Gretton , Danica J. Sutherland

We present and evaluate the Fast (conditional) Independence Test (FIT) -- a nonparametric conditional independence test. The test is based on the idea that when $P(X \mid Y, Z) = P(X \mid Y)$, $Z$ is not useful as a feature to predict $X$,…

Machine Learning · Statistics 2018-04-10 Krzysztof Chalupka , Pietro Perona , Frederick Eberhardt

This paper develops a conditional independence (CI) test from a conditional density ratio (CDR) for weakly dependent data. The main contribution is presenting a closed-form expression for the estimated conditional density ratio function…

Methodology · Statistics 2025-04-25 Chunrong Ai , Zixuan Xu , Zheng Zhang

We propose a test of the conditional independence of random variables $X$ and~$Y$ given~$Z$ under the additional assumption that $X$ is stochastically nondecreasing in~$Z$. The well-documented hardness of testing conditional independence…

Methodology · Statistics 2026-04-24 Rohan Hore , Jake A. Soloff , Rina Foygel Barber , Richard J. Samworth

In many real-world scenarios, interested variables are often represented as discretized values due to measurement limitations. Applying Conditional Independence (CI) tests directly to such discretized data, however, can lead to incorrect…

Artificial Intelligence · Computer Science 2025-06-11 Boyang Sun , Yu Yao , Xinshuai Dong , Zongfang Liu , Tongliang Liu , Yumou Qiu , Kun Zhang

Conditional independence testing is an important problem, especially in Bayesian network learning and causal discovery. Due to the curse of dimensionality, testing for conditional independence of continuous variables is particularly…

Machine Learning · Computer Science 2012-02-20 Kun Zhang , Jonas Peters , Dominik Janzing , Bernhard Schoelkopf

Conditional independence is a fundamental concept in many areas of statistical research, including, for example, sufficient dimension reduction, causal inference, and statistical graphical models. In many modern applications, data arise in…

Methodology · Statistics 2026-03-17 Yin Tang , Bing Li

Conditional independence testing is a fundamental problem underlying causal discovery and a particularly challenging task in the presence of nonlinear and high-dimensional dependencies. Here a fully non-parametric test for continuous data…

Machine Learning · Statistics 2017-09-06 Jakob Runge

In this paper, the maximal nonlinear conditional correlation of two random vectors $X$ and $Y$ given another random vector $Z$, denoted by $\rho_1(X,Y|Z)$, is defined as a measure of conditional association, which satisfies certain…

Statistics Theory · Mathematics 2010-10-20 Tzee-Ming Huang

This article deals with the problem of testing conditional independence between two random vectors ${\bf X}$ and ${\bf Y}$ given a confounding random vector ${\bf Z}$. Several authors have considered this problem for multivariate data.…

Statistics Theory · Mathematics 2025-09-16 Bilol Banerjee