English
Related papers

Related papers: Testing Conditional Independence in Supervised Lea…

200 papers

Testing for the conditional independence structure in data is a fundamental and critical task in statistics and machine learning, which finds natural applications in causal discovery - a highly relevant problem to many scientific…

Machine Learning · Statistics 2025-03-03 Bao Duong , Nu Hoang , Thin Nguyen

Detecting conditional independencies plays a key role in several statistical and machine learning tasks, especially in causal discovery algorithms. In this study, we introduce LCIT (Latent representation based Conditional Independence…

Machine Learning · Computer Science 2022-09-07 Bao Duong , Thin Nguyen

Conditional independence (CI) testing arises naturally in many scientific problems and applications domains. The goal of this problem is to investigate the conditional independence between a response variable $Y$ and another variable $X$,…

Methodology · Statistics 2025-10-07 Adel Javanmard , Mohammad Mehrabi

The identification of compound-protein interactions (CPI) plays a critical role in drug screening, drug repurposing, and combination therapy studies. The effectiveness of CPI prediction relies heavily on the features extracted from both…

Biomolecules · Quantitative Biology 2023-06-16 Li Zhang , Wenhao Li , Haotian Guan , Zhiquan He , Mingjun Cheng , Han Wang

Conditional independence (CI) tests are widely used in statistical data analysis, e.g., they are the building block of many algorithms for causal graph discovery. The goal of a CI test is to accept or reject the null hypothesis that $X…

Machine Learning · Statistics 2024-03-26 Iden Kalemaj , Shiva Prasad Kasiviswanathan , Aaditya Ramdas

Mixture proportion estimation (MPE) aims to estimate class priors from unlabeled data. This task is a critical component in weakly supervised learning, such as PU learning, learning with label noise, and domain adaptation. Existing MPE…

Machine Learning · Computer Science 2026-04-09 Yushi Hirose , Akito Narahara , Takafumi Kanamori

Conditional mean independence (CMI) testing is crucial for statistical tasks including model determination and variable importance evaluation. In this work, we introduce a novel population CMI measure and a bootstrap-based testing procedure…

Machine Learning · Statistics 2025-01-30 Yi Zhang , Linjun Huang , Yun Yang , Xiaofeng Shao

Conditional independence is a fundamental concept in many areas of statistical research, including, for example, sufficient dimension reduction, causal inference, and statistical graphical models. In many modern applications, data arise in…

Methodology · Statistics 2026-03-17 Yin Tang , Bing Li

We describe a data-efficient, kernel-based approach to statistical testing of conditional independence. A major challenge of conditional independence testing is to obtain the correct test level (the specified upper bound on the rate of…

Machine Learning · Computer Science 2025-09-23 Roman Pogodin , Antonin Schrab , Yazhe Li , Danica J. Sutherland , Arthur Gretton

Conditional independence (CI) tests underlie many approaches to model testing and structure learning in causal inference. Most existing CI tests for categorical and ordinal data stratify the sample by the conditioning variables, perform…

Machine Learning · Statistics 2023-07-06 Ankur Ankan , Johannes Textor

Constraint-based causal discovery (CCD) algorithms require fast and accurate conditional independence (CI) testing. The Kernel Conditional Independence Test (KCIT) is currently one of the most popular CI tests in the non-parametric setting,…

Methodology · Statistics 2017-04-14 Eric V. Strobl , Kun Zhang , Shyam Visweswaran

Conformal prediction is a framework for predictive inference with a distribution-free, finite-sample guarantee. However, it tends to provide uninformative prediction sets when calibration data are scarce. This paper introduces…

Machine Learning · Computer Science 2025-06-17 Meshi Bashari , Roy Maor Lotan , Yonghoon Lee , Edgar Dobriban , Yaniv Romano

Learning causal relations from observational data is a fundamental problem with wide-ranging applications across many fields. Constraint-based methods infer the underlying causal structure by performing conditional independence tests.…

Machine Learning · Computer Science 2026-03-24 Marc Franquesa Monés , Jiaqi Zhang , Caroline Uhler

Kernel-based conditional independence (KCI) testing is a powerful nonparametric method commonly employed in causal discovery tasks. Despite its flexibility and statistical reliability, cubic computational complexity limits its application…

Machine Learning · Computer Science 2025-12-05 Oliver Schacht , Biwei Huang

A central goal of probabilistic programming languages (PPLs) is to separate modelling from inference. However, this goal is hard to achieve in practice. Users are often forced to re-write their models in order to improve efficiency of…

Programming Languages · Computer Science 2022-02-21 Maria I. Gorinova , Andrew D. Gordon , Charles Sutton , Matthijs Vákár

We introduce the Conditional Independence Regression CovariancE (CIRCE), a measure of conditional independence for multivariate continuous-valued variables. CIRCE applies as a regularizer in settings where we wish to learn neural features…

Machine Learning · Computer Science 2023-12-20 Roman Pogodin , Namrata Deka , Yazhe Li , Danica J. Sutherland , Victor Veitch , Arthur Gretton

Causal influence measures for machine learnt classifiers shed light on the reasons behind classification, and aid in identifying influential input features and revealing their biases. However, such analyses involve evaluating the classifier…

Machine Learning · Computer Science 2018-04-10 Shayak Sen , Piotr Mardziel , Anupam Datta , Matthew Fredrikson

This paper introduces an innovative method for conducting conditional independence testing in high-dimensional data, facilitating the automated discovery of significant associations within distinct subgroups of a population, all while…

Methodology · Statistics 2023-09-19 Matteo Sesia , Tianshu Sun

Tackling large approximate dynamic programming or reinforcement learning problems requires methods that can exploit regularities, or intrinsic structure, of the problem in hand. Most current methods are geared towards exploiting the…

Machine Learning · Computer Science 2014-07-03 Amir-massoud Farahmand , Doina Precup , André M. S. Barreto , Mohammad Ghavamzadeh

We propose a method for inferring the conditional independence graph (CIG) of a high-dimensional Gaussian vector time series (discrete-time process) from a finite-length observation. By contrast to existing approaches, we do not rely on a…

Machine Learning · Statistics 2015-10-28 Alexander Jung