English
Related papers

Related papers: Toward Scalable and Valid Conditional Independence…

200 papers

This work addresses testing the independence of two continuous and finite-dimensional random variables from the design of a data-driven partition. The empirical log-likelihood statistic is adopted to approximate the sufficient statistics of…

Machine Learning · Statistics 2022-01-19 Mauricio E. Gonzalez , Jorge F. Silva , Miguel Videla , Marcos E. Orchard

We propose the Sobolev Independence Criterion (SIC), an interpretable dependency measure between a high dimensional random variable X and a response variable Y . SIC decomposes to the sum of feature importance scores and hence can be used…

Machine Learning · Computer Science 2019-11-01 Youssef Mroueh , Tom Sercu , Mattia Rigotti , Inkit Padhi , Cicero Dos Santos

We propose a method for inferring the conditional independence graph (CIG) of a high-dimensional Gaussian vector time series (discrete-time process) from a finite-length observation. By contrast to existing approaches, we do not rely on a…

Machine Learning · Statistics 2015-10-28 Alexander Jung

Constraint-based (CB) learning is a formalism for learning a causal network with a database D by performing a series of conditional-independence tests to infer structural information. This paper considers a new test of independence that…

Artificial Intelligence · Computer Science 2012-12-12 Denver Dash , Marek J. Druzdzel

Conditional independence tests are crucial across various disciplines in determining the independence of an outcome variable $Y$ from a treatment variable $X$, conditioning on a set of confounders $Z$. The Conditional Randomization Test…

Methodology · Statistics 2024-05-30 Bowen Xu , Yiwen Huang , Chuan Hong , Shuangning Li , Molei Liu

Measuring conditional independence is one of the important tasks in statistical inference and is fundamental in causal discovery, feature selection, dimensionality reduction, Bayesian network learning, and others. In this work, we explore…

Statistics Theory · Mathematics 2020-08-18 Tianhong Sheng , Bharath K. Sriperumbudur

We propose a method for feature selection that employs kernel-based measures of independence to find a subset of covariates that is maximally predictive of the response. Building on past work in kernel dimension reduction, we show how to…

Machine Learning · Statistics 2018-10-23 Jianbo Chen , Mitchell Stern , Martin J. Wainwright , Michael I. Jordan

Conditional Independence (CI) graphs are a type of probabilistic graphical models that are primarily used to gain insights about feature relationships. Each edge represents the partial correlation between the connected features which gives…

Machine Learning · Computer Science 2024-08-30 Harsh Shrivastava , Urszula Chajewska

We study prediction-powered conditional inference in the setting where labeled data are scarce, unlabeled covariates are abundant, and a black-box machine-learning predictor is available. The goal is to perform statistical inference on…

Machine Learning · Statistics 2026-03-09 Yang Sui , Jin Zhou , Hua Zhou , Xiaowu Dai

We consider the problem of learning causal relationships from relational data. Existing approaches rely on queries to a relational conditional independence (RCI) oracle to establish and orient causal relations in such a setting. In…

Machine Learning · Computer Science 2019-12-06 Sanghack Lee , Vasant Honavar

This paper develops a conditional independence (CI) test from a conditional density ratio (CDR) for weakly dependent data. The main contribution is presenting a closed-form expression for the estimated conditional density ratio function…

Methodology · Statistics 2025-04-25 Chunrong Ai , Zixuan Xu , Zheng Zhang

The defining challenge for causal inference from observational data is the presence of `confounders', covariates that affect both treatment assignment and the outcome. To address this challenge, practitioners collect and adjust for the…

Machine Learning · Computer Science 2021-07-28 Claudia Shi , Victor Veitch , David Blei

Selective conformal prediction can yield substantially tighter uncertainty sets when we can identify calibration examples that are exchangeable with the test example. In interventional settings, such as perturbation experiments in genomics,…

Machine Learning · Computer Science 2026-03-03 Amir Asiaee , Kavey Aryan , James P. Long

Causal representation learning in the anti-causal setting (labels cause features rather than the reverse) presents unique challenges requiring specialized approaches. We propose Anti-Causal Invariant Abstractions (ACIA), a novel…

Machine Learning · Computer Science 2025-10-22 Arman Behnam , Binghui Wang

Representation learning models exhibit a surprising stability in their internal representations. Whereas most prior work treats this stability as a single property, we formalize it as two distinct concepts: statistical identifiability…

Machine Learning · Computer Science 2026-03-13 Walter Nelson , Marco Fumero , Theofanis Karaletsos , Francesco Locatello

The accurate representation of epistemic uncertainty is a challenging yet essential task in machine learning. A widely used representation corresponds to convex sets of probabilistic predictors, also known as credal sets. One popular way of…

Machine Learning · Computer Science 2025-07-30 Mira Jürgens , Thomas Mortier , Eyke Hüllermeier , Viktor Bengs , Willem Waegeman

Given independent samples generated from the joint distribution $p(\mathbf{x},\mathbf{y},\mathbf{z})$, we study the problem of Conditional Independence (CI-Testing), i.e., whether the joint equals the CI distribution…

Machine Learning · Statistics 2018-06-27 Rajat Sen , Karthikeyan Shanmugam , Himanshu Asnani , Arman Rahimzamani , Sreeram Kannan

The assumption of separability is a simplifying and very popular assumption in the analysis of spatio-temporal or hypersurface data structures. It is often made in situations where the covariance structure cannot be easily estimated, for…

Methodology · Statistics 2019-01-03 Pramita Bagchi , Holger Dette

Kernel dependence measures yield accurate estimates of nonlinear relations between random variables, and they are also endorsed with solid theoretical properties and convergence rates. Besides, the empirical estimates are easy to compute in…

Machine Learning · Statistics 2016-11-03 Adrián Pérez-Suay , Gustau Camps-Valls

Conditional-independence-based discovery uses statistical tests to identify a graphical model that represents the independence structure of variables in a dataset. These tests, however, can be unreliable, and algorithms are sensitive to…

Machine Learning · Computer Science 2026-04-21 Philipp M. Faller , Dominik Janzing