English
Related papers

Related papers: Practical Kernel Tests of Conditional Independence

200 papers

Recent years have witnessed growing concerns about the privacy of sensitive data. In response to these concerns, differential privacy has emerged as a rigorous framework for privacy protection, gaining widespread recognition in both…

Statistics Theory · Mathematics 2024-01-09 Ilmun Kim , Antonin Schrab

Safe control for dynamical systems is critical, yet the presence of unknown dynamics poses significant challenges. In this paper, we present a learning-based control approach for tracking control of a class of high-order systems, operating…

Systems and Control · Electrical Eng. & Systems 2024-05-03 Zewen Yang , Xiaobing Dai , Weijie Yang , Bahar İlgen , Aleksandar Anžel , Georges Hattab

This paper provides a new theoretical lens for understanding the finite-sample performance of kernel-based specification tests, such as the Kernel Conditional Moment (KCM) test. Rather than introducing a fundamentally new test, we isolate…

Econometrics · Economics 2025-10-15 Cui Rui , Li Yuhao , Song Xiaojun

We study the problem of independence and conditional independence tests between categorical covariates and a continuous response variable, which has an immediate application in genetics. Instead of estimating the conditional distribution of…

Methodology · Statistics 2015-05-05 Bo Jiang , Chao Ye , Jun S. Liu

We investigate the sample complexity of mutual information and conditional mutual information testing. For conditional mutual information testing, given access to independent samples of a triple of random variables $(A, B, C)$ with unknown…

Data Structures and Algorithms · Computer Science 2025-06-05 Jan Seyfried , Sayantan Sen , Marco Tomamichel

We propose kernel PCA as a method for analyzing the dependence structure of multivariate extremes and demonstrate that it can be a powerful tool for clustering and dimension reduction. Our work provides some theoretical insight into the…

Machine Learning · Statistics 2022-11-28 Marco Avella-Medina , Richard A. Davis , Gennady Samorodnitsky

Causal discovery is a powerful technique for identifying causal relationships among variables in data. It has been widely used in various applications in software engineering. Causal discovery extensively involves conditional independence…

Software Engineering · Computer Science 2023-09-12 Pingchuan Ma , Zhenlan Ji , Peisen Yao , Shuai Wang , Kui Ren

Constraint-based causal discovery relies on numerous conditional independence tests (CITs), but its practical applicability is severely constrained by the prohibitive computational cost, especially as CITs themselves have high time…

Machine Learning · Computer Science 2026-03-02 Zhengkang Guan , Kun Kuang

We introduce an independence criterion based on entropy regularized optimal transport. Our criterion can be used to test for independence between two samples. We establish non-asymptotic bounds for our test statistic and study its…

Machine Learning · Statistics 2022-04-21 Lang Liu , Soumik Pal , Zaid Harchaoui

We consider the problem of conditional independence testing of $X$ and $Y$ given $Z$ where $X,Y$ and $Z$ are three real random variables and $Z$ is continuous. We focus on two main cases - when $X$ and $Y$ are both discrete, and when $X$…

Statistics Theory · Mathematics 2021-07-05 Matey Neykov , Sivaraman Balakrishnan , Larry Wasserman

We propose consistent nonparametric tests of conditional independence for time series data. Our methods are motivated from the difference between joint conditional cumulative distribution function (CDF) and the product of conditional CDFs.…

Econometrics · Economics 2021-10-12 Xiaojun Song , Haoyu Wei

Conditional independence tests are crucial across various disciplines in determining the independence of an outcome variable $Y$ from a treatment variable $X$, conditioning on a set of confounders $Z$. The Conditional Randomization Test…

Methodology · Statistics 2024-05-30 Bowen Xu , Yiwen Huang , Chuan Hong , Shuangning Li , Molei Liu

We present and evaluate the Fast (conditional) Independence Test (FIT) -- a nonparametric conditional independence test. The test is based on the idea that when $P(X \mid Y, Z) = P(X \mid Y)$, $Z$ is not useful as a feature to predict $X$,…

Machine Learning · Statistics 2018-04-10 Krzysztof Chalupka , Pietro Perona , Frederick Eberhardt

The standard constraint-based paradigm for causal discovery with incomplete data -- impute first, test second -- is frequently miscalibrated: any consistent conditional independence (CI) test rejects a true null with probability approaching…

Methodology · Statistics 2026-05-07 Thomas S. Robinson , Ranjit Lall

We establish a fundamental connection between optimal structure learning and optimal conditional independence testing by showing that the minimax optimal rate for structure learning problems is determined by the minimax rate for conditional…

Statistics Theory · Mathematics 2025-10-06 Ming Gao , Yuhao Wang , Bryon Aragam

Inferring causal relationships from dynamical systems is the central interest of many scientific inquiries. Conditional local independence, which describes whether the evolution of one process is influenced by another process given…

Methodology · Statistics 2025-10-09 Mingzhou Liu , Xinwei Sun , Yizhou Wang

We consider the problem of two-sample testing in a semi-supervised setting with abundant unlabeled covariate data. Standard two-sample tests neglect covariate information, which has the potential to significantly boost performance. However,…

Machine Learning · Statistics 2026-05-05 Gyumin Lee , Shubhanshu Shekhar , Ilmun Kim

Evaluating whether data streams are drawn from the same distribution is at the heart of various machine learning problems. This is particularly relevant for data generated by dynamical systems since such systems are essential for many…

We describe a novel non-parametric statistical hypothesis test of relative dependence between a source variable and two candidate target variables. Such a test enables us to determine whether one source variable is significantly more…

Machine Learning · Statistics 2015-05-28 Wacha Bounliphone , Arthur Gretton , Arthur Tenenhaus , Matthew Blaschko

Model-X approaches to testing conditional independence between a predictor and an outcome variable given a vector of covariates usually assume exact knowledge of the conditional distribution of the predictor given the covariates.…

Methodology · Statistics 2023-02-10 Ziang Niu , Abhinav Chakraborty , Oliver Dukes , Eugene Katsevich