English
Related papers

Related papers: Testing Conditional Independence in Supervised Lea…

200 papers

Recent advances in machine learning have greatly expanded the repertoire of predictive methods for medical imaging. However, the interpretability of complex models remains a challenge, which limits their utility in medical applications.…

Machine Learning · Statistics 2025-08-13 Joseph Paillard , Antoine Collas , Denis A. Engemann , Bertrand Thirion

Drawbacks of ignoring the causal mechanisms when performing imitation learning have recently been acknowledged. Several approaches both to assess the feasibility of imitation and to circumvent causal confounding and causal misspecifications…

Machine Learning · Computer Science 2023-06-13 Fateme Jamshidi , Sina Akbari , Negar Kiyavash

We study inference with a small labeled sample, a large unlabeled sample, and high-quality predictions from an external model. We link prediction-powered inference with empirical likelihood by stacking supervised estimating equations based…

Methodology · Statistics 2025-12-19 Guanghui Wang , Mengtao Wen , Changliang Zou

We introduce a framework for filtering features that employs the Hilbert-Schmidt Independence Criterion (HSIC) as a measure of dependence between the features and the labels. The key idea is that good features should maximise such…

Machine Learning · Computer Science 2007-05-23 Le Song , Alex Smola , Arthur Gretton , Karsten Borgwardt , Justin Bedo

Motivated by conditional independence testing, an essential step in constraint-based causal discovery algorithms, we study the nonparametric Von Mises estimator for the entropy of multivariate distributions built on a kernel density…

Machine Learning · Computer Science 2023-10-23 Fateme Jamshidi , Luca Ganassali , Negar Kiyavash

For testing conditional independence (CI) of a response Y and a predictor X given covariates Z, the recently introduced model-X (MX) framework has been the subject of active methodological research, especially in the context of MX knockoffs…

Statistics Theory · Mathematics 2022-11-01 Eugene Katsevich , Aaditya Ramdas

The use of machine learning (ML) in high-stakes societal decisions has encouraged the consideration of fairness throughout the ML lifecycle. Although data integration is one of the primary steps to generate high quality training data, most…

Machine Learning · Computer Science 2022-04-01 Sainyam Galhotra , Karthikeyan Shanmugam , Prasanna Sattigeri , Kush R. Varshney

Conditional independence (CI) constraints are critical for defining and evaluating fairness in machine learning, as well as for learning unconfounded or causal representations. Traditional methods for ensuring fairness either blindly learn…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Jensen Hwa , Qingyu Zhao , Aditya Lahiri , Adnan Masood , Babak Salimi , Ehsan Adeli

We explore fairness from a statistical perspective by selectively utilizing either conditional distance covariance or distance covariance statistics as measures to assess the independence between predictions and sensitive attributes. We…

Machine Learning · Computer Science 2025-12-22 Ruifan Huang , Haixia Liu

Explaining the decision process of machine learning algorithms is nowadays crucial for both model's performance enhancement and human comprehension. This can be achieved by assessing the variable importance of single variables, even for…

Machine Learning · Computer Science 2023-12-19 Ahmad Chamma , Bertrand Thirion , Denis A. Engemann

Conditional Independence (CI) graphs are a type of probabilistic graphical models that are primarily used to gain insights about feature relationships. Each edge represents the partial correlation between the connected features which gives…

Machine Learning · Computer Science 2024-08-30 Harsh Shrivastava , Urszula Chajewska

Conditional independence provides a way to understand causal relationships among the variables of interest. An underlying system may exhibit more fine-grained causal relationships especially between a variable and its parents, which will be…

Machine Learning · Computer Science 2024-05-14 Inwoo Hwang , Yunhyeok Kwak , Yeon-Ji Song , Byoung-Tak Zhang , Sanghack Lee

Conditional independence testing is a fundamental problem underlying causal discovery and a particularly challenging task in the presence of nonlinear and high-dimensional dependencies. Here a fully non-parametric test for continuous data…

Machine Learning · Statistics 2017-09-06 Jakob Runge

Conditional independence testing (CIT) is essential for reliable scientific discovery. It prevents spurious findings and enables controlled feature selection. Recent CIT methods have used machine learning (ML) models as surrogates of the…

Statistics Theory · Mathematics 2026-02-02 Angel Reyero-Lobo , Bertrand Thirion , Pierre Neuvial

Given independent samples generated from the joint distribution $p(\mathbf{x},\mathbf{y},\mathbf{z})$, we study the problem of Conditional Independence (CI-Testing), i.e., whether the joint equals the CI distribution…

Machine Learning · Statistics 2018-06-27 Rajat Sen , Karthikeyan Shanmugam , Himanshu Asnani , Arman Rahimzamani , Sreeram Kannan

This paper introduces the \textit{weighted partial copula} function for testing conditional independence. The proposed test procedure results from these two ingredients: (i) the test statistic is an explicit Cramer-von Mises transformation…

Methodology · Statistics 2021-02-15 Pascal Bianchi , Kevin Elgui , François Portier

Conditional randomization tests (CRTs) assess whether a variable $x$ is predictive of another variable $y$, having observed covariates $z$. CRTs require fitting a large number of predictive models, which is often computationally…

Methodology · Statistics 2023-04-12 Mukund Sudarshan , Aahlad Manas Puli , Wesley Tansey , Rajesh Ranganath

Conditional-independence-based discovery uses statistical tests to identify a graphical model that represents the independence structure of variables in a dataset. These tests, however, can be unreliable, and algorithms are sensitive to…

Machine Learning · Computer Science 2026-04-21 Philipp M. Faller , Dominik Janzing

Real-world applications often require improved models by leveraging a range of cheap incidental supervision signals. These could include partial labels, noisy labels, knowledge-based constraints, and cross-domain or cross-task annotations…

Machine Learning · Computer Science 2021-09-13 Hangfeng He , Mingyuan Zhang , Qiang Ning , Dan Roth

The standard constraint-based paradigm for causal discovery with incomplete data -- impute first, test second -- is frequently miscalibrated: any consistent conditional independence (CI) test rejects a true null with probability approaching…

Methodology · Statistics 2026-05-07 Thomas S. Robinson , Ranjit Lall