English
Related papers

Related papers: Approximate Kernel-based Conditional Independence …

200 papers

Markov blanket feature selection, while theoretically optimal, is generally challenging to implement. This is due to the shortcomings of existing approaches to conditional independence (CI) testing, which tend to struggle either with the…

Machine Learning · Computer Science 2020-06-23 Alan Yang , AmirEmad Ghassami , Maxim Raginsky , Negar Kiyavash , Elyse Rosenbaum

This paper introduces an innovative method for conducting conditional independence testing in high-dimensional data, facilitating the automated discovery of significant associations within distinct subgroups of a population, all while…

Methodology · Statistics 2023-09-19 Matteo Sesia , Tianshu Sun

Conditional independence tests (CI tests) have received special attention lately in Machine Learning and Computational Intelligence related literature as an important indicator of the relationship among the variables used by their models.…

In this paper we introduce a kernel-based measure for detecting differences between two conditional distributions. Using the `kernel trick' and nearest-neighbor graphs, we propose a consistent estimate of this measure which can be computed…

Methodology · Statistics 2024-08-30 Anirban Chatterjee , Ziang Niu , Bhaswar B. Bhattacharya

In a nonparametric setting, the causal structure is often identifiable only up to Markov equivalence, and for the purpose of causal inference, it is useful to learn a graphical representation of the Markov equivalence class (MEC). In this…

Machine Learning · Statistics 2022-06-20 Xinwei Shen , Shengyu Zhu , Jiji Zhang , Shoubo Hu , Zhitang Chen

Platform trials allow treatment arms to enter and exit over time while maintaining a shared control arm, yielding concurrent and non-concurrent controls (NCC). Pooling NCC is often motivated as a strategy to improve statistical efficiency,…

Methodology · Statistics 2026-03-12 Antonio D'Alessandro , Samrachana Adhikari , Michele Santacatterina

Graphical structure learning is an effective way to assess and visualize cross-biomarker dependencies in biomedical settings. Standard approaches to estimating graphs rely on conditional independence tests that may not be sensitive to…

Methodology · Statistics 2024-11-28 Zain Khan , Daniel Malinsky , Martin Picard , Alan A. Cohen , Columbia SOH Group , Ying Wei

We introduce Conformal Interquantile Regression (CIR), a conformal regression method that efficiently constructs near-minimal prediction intervals with guaranteed coverage. CIR leverages black-box machine learning models to estimate outcome…

Machine Learning · Statistics 2026-01-07 Naixin Guo , Rui Luo , Zhixin Zhou

Causal discovery aims to recover causal structures generating the observational data. Despite its success in certain problems, in many real-world scenarios the observed variables are not the target variables of interest, but the imperfect…

Machine Learning · Computer Science 2022-10-21 Haoyue Dai , Peter Spirtes , Kun Zhang

Over the last couple of decades, several copula based methods have been proposed in the literature to test for the independence among several random variables. But these existing tests are not invariant under monotone transformations of the…

Statistics Theory · Mathematics 2019-11-15 Angshuman Roy , Anil Ghosh , Alok Goswami , C. A. Murthy

Randomized Controlled Trials (RCT)s are relied upon to assess new treatments, but suffer from limited power to guide personalized treatment decisions. On the other hand, observational (i.e., non-experimental) studies have large and diverse…

Methodology · Statistics 2023-03-07 Zeshan Hussain , Ming-Chieh Shih , Michael Oberst , Ilker Demirel , David Sontag

We provide a unified framework for independence and mean independence tests based on the Hilbert-Schmidt independence criterion, extending some previous results in the literature to hold in general topological spaces. We also present a…

Methodology · Statistics 2026-05-01 Daniel Diz-Castro , Manuel Febrero-Bande , Wenceslao González-Manteiga

Causal discovery studies the problem of mining causal relationships between variables from data, which is of primary interest in science. During the past decades, significant amount of progresses have been made toward this fundamental data…

Artificial Intelligence · Computer Science 2016-11-28 Kui Yu , Jiuyong Li , Lin Liu

We establish a fundamental connection between optimal structure learning and optimal conditional independence testing by showing that the minimax optimal rate for structure learning problems is determined by the minimax rate for conditional…

Statistics Theory · Mathematics 2025-10-06 Ming Gao , Yuhao Wang , Bryon Aragam

The partial copula provides a method for describing the dependence between two random variables $X$ and $Y$ conditional on a third random vector $Z$ in terms of nonparametric residuals $U_1$ and $U_2$. This paper develops a nonparametric…

Statistics Theory · Mathematics 2021-04-30 Lasse Petersen , Niels Richard Hansen

The discovery of causal relations from observed data has attracted significant interest from disciplines such as economics, social sciences, and biology. In practical applications, considerable knowledge of the underlying systems is often…

Quantum Physics · Physics 2026-03-19 Yu Terada , Ken Arai , Yu Tanaka , Yota Maeda , Hiroshi Ueno , Hiroyuki Tezuka

Combinatorial interaction testing (CIT) is a useful testing technique to address the interaction of input parameters in software systems. In many applications, the technique has been used as a systematic sampling technique to sample the…

Software Engineering · Computer Science 2019-07-23 Bestoun S. Ahmed , Angelo Gargantini , Kamal Z. Zamli , Cemal Yilmaz , Miroslav Bures , Marek Szeles

A simple and intuitive method for feature selection consists of choosing the feature subset that maximizes a nonparametric measure of dependence between the response and the features. A popular proposal from the literature uses the…

Machine Learning · Statistics 2024-06-12 Keli Liu , Feng Ruan

High-dimensional covariates often admit linear factor structure. To effectively screen correlated covariates in high-dimension, we propose a conditional variable screening test based on non-parametric regression using neural networks due to…

Econometrics · Economics 2024-08-21 Jianqing Fan , Weining Wang , Yue Zhao

Local structure such as context-specific independence (CSI) has received much attention in the probabilistic graphical model (PGM) literature, as it facilitates the modeling of large complex systems, as well as for reasoning with them. In…

Artificial Intelligence · Computer Science 2020-06-15 Yujia Shen , Arthur Choi , Adnan Darwiche