English
Related papers

Related papers: A Sample Efficient Conditional Independence Test i…

200 papers

Conditional independence is a fundamental concept in many areas of statistical research, including, for example, sufficient dimension reduction, causal inference, and statistical graphical models. In many modern applications, data arise in…

Methodology · Statistics 2026-03-17 Yin Tang , Bing Li

Kernel-based conditional independence (KCI) testing is a powerful nonparametric method commonly employed in causal discovery tasks. Despite its flexibility and statistical reliability, cubic computational complexity limits its application…

Machine Learning · Computer Science 2025-12-05 Oliver Schacht , Biwei Huang

We propose a sequential, anytime-valid method to test the conditional independence of a response $Y$ and a predictor $X$ given a random vector $Z$. The proposed test is based on e-statistics and test martingales, which generalize likelihood…

Methodology · Statistics 2023-02-22 Peter Grünwald , Alexander Henzi , Tyron Lardy

Motivation: Algorithms that discover variables which are causally related to a target may inform the design of experiments. With observational gene expression data, many methods discover causal variables by measuring each variable's degree…

Quantitative Methods · Quantitative Biology 2014-07-30 Eric V. Strobl , Shyam Visweswaran

The standard constraint-based paradigm for causal discovery with incomplete data -- impute first, test second -- is frequently miscalibrated: any consistent conditional independence (CI) test rejects a true null with probability approaching…

Methodology · Statistics 2026-05-07 Thomas S. Robinson , Ranjit Lall

Motivated by applications in biological science, we propose a novel test to assess the conditional mean dependence of a response variable on a large number of covariates. Our procedure is built on the martingale difference divergence…

Statistics Theory · Mathematics 2017-01-31 Xianyang Zhang , Shun Yao , Xiaofeng Shao

Independence testing plays a central role in statistical and causal inference from observational data. Standard independence tests assume that the data samples are independent and identically distributed (i.i.d.) but that assumption is…

Machine Learning · Statistics 2022-07-04 Ragib Ahsan , Zahra Fatemi , David Arbour , Elena Zheleva

We apply the concept of distance covariance for testing independence of two long-range dependent time series. As test statistic we propose a linear combination of empirical distance cross-covariances. We derive the asymptotic distribution…

Statistics Theory · Mathematics 2026-01-28 Annika Betken , Herold Dehling

A popular approach for testing if two univariate random variables are statistically independent consists of partitioning the sample space into bins, and evaluating a test statistic on the binned data. The partition size matters, and the…

Methodology · Statistics 2016-04-28 Ruth Heller , Yair Heller , Shachar Kaufman , Barak Brill , Malka Gorfine

This paper proposes a new statistic to test independence between two high dimensional random vectors ${\mathbf{X}}:p_1\times1$ and ${\mathbf{Y}}:p_2\times1$. The proposed statistic is based on the sum of regularized sample canonical…

Statistics Theory · Mathematics 2015-03-19 Yanrong Yang , Guangming Pan

Causal phenomena associated with rare events occur across a wide range of engineering problems, such as risk-sensitive safety analysis, accident analysis and prevention, and extreme value theory. However, current methods for causal…

Machine Learning · Statistics 2023-07-19 Chih-Yuan Chiu , Kshitij Kulkarni , Shankar Sastry

Causality lays the foundation for the trajectory of our world. Causal inference (CI), which aims to infer intrinsic causal relations among variables of interest, has emerged as a crucial research topic. Nevertheless, the lack of observation…

Machine Learning · Computer Science 2024-06-21 Yaochen Zhu , Yinhan He , Jing Ma , Mengxuan Hu , Sheng Li , Jundong Li

We propose a new conditional dependence measure and a statistical test for conditional independence. The measure is based on the difference between analytic kernel embeddings of two well-suited distributions evaluated at a finite set of…

Machine Learning · Statistics 2022-06-17 Meyer Scetbon , Laurent Meunier , Yaniv Romano

The model-X conditional randomization test is a generic framework for conditional independence testing, unlocking new possibilities to discover features that are conditionally associated with a response of interest while controlling type-I…

Machine Learning · Computer Science 2023-02-21 Shalev Shaer , Yaniv Romano

We present and evaluate the Fast (conditional) Independence Test (FIT) -- a nonparametric conditional independence test. The test is based on the idea that when $P(X \mid Y, Z) = P(X \mid Y)$, $Z$ is not useful as a feature to predict $X$,…

Machine Learning · Statistics 2018-04-10 Krzysztof Chalupka , Pietro Perona , Frederick Eberhardt

We propose consistent nonparametric tests of conditional independence for time series data. Our methods are motivated from the difference between joint conditional cumulative distribution function (CDF) and the product of conditional CDFs.…

Econometrics · Economics 2021-10-12 Xiaojun Song , Haoyu Wei

Conditional independence tests (CIT) are widely used for causal discovery and feature selection. Even with false discovery rate (FDR) control procedures, they often fail to provide frequentist guarantees in practice. We highlight two common…

Methodology · Statistics 2026-02-25 Milleno Pan , Antoine de Mathelin , Wesley Tansey

Testing for association or dependence between pairs of random variables is a fundamental problem in statistics. In some applications, data are subject to selection bias that causes dependence between observations even when it is absent from…

Methodology · Statistics 2020-10-13 Yaniv Tenzer , Micha Mandel , Or Zuk

Motivated by conditional independence testing, an essential step in constraint-based causal discovery algorithms, we study the nonparametric Von Mises estimator for the entropy of multivariate distributions built on a kernel density…

Machine Learning · Computer Science 2023-10-23 Fateme Jamshidi , Luca Ganassali , Negar Kiyavash

For a set of dependent random variables, without stationary or the strong mixing assumptions, we derive the asymptotic independence between their sums and maxima. Then we apply this result to high-dimensional testing problems, where we…

Methodology · Statistics 2022-05-12 Long Feng , Tiefeng Jiang , Xiaoyun Li , Binghui Liu