中文
相关论文

相关论文: Practical Kernel Tests of Conditional Independence

200 篇论文

This paper introduces Kernel-based Information Criterion (KIC) for model selection in regression analysis. The novel kernel-based complexity measure in KIC efficiently computes the interdependency between parameters of the model using a…

机器学习 · 统计学 2014-12-16 Somayeh Danafar , Kenji Fukumizu , Faustino Gomez

We propose the conditional predictive impact (CPI), a consistent and unbiased estimator of the association between one or several features and a given outcome, conditional on a reduced feature set. Building on the knockoff framework of…

统计方法学 · 统计学 2021-05-14 David S. Watson , Marvin N. Wright

Conditional independence (CI) tests are widely used in statistical data analysis, e.g., they are the building block of many algorithms for causal graph discovery. The goal of a CI test is to accept or reject the null hypothesis that $X…

机器学习 · 统计学 2024-03-26 Iden Kalemaj , Shiva Prasad Kasiviswanathan , Aaditya Ramdas

This paper introduces the \textit{weighted partial copula} function for testing conditional independence. The proposed test procedure results from these two ingredients: (i) the test statistic is an explicit Cramer-von Mises transformation…

统计方法学 · 统计学 2021-02-15 Pascal Bianchi , Kevin Elgui , François Portier

Multivariate time series data that capture the temporal evolution of interconnected systems are ubiquitous in diverse areas. Understanding the complex relationships and potential dependencies among co-observed variables is crucial for the…

统计方法学 · 统计学 2023-11-03 Zhaolu Liu , Robert L. Peach , Felix Laumann , Sara Vallejo Mengod , Mauricio Barahona

We introduce the Kernel Calibration Conditional Stein Discrepancy test (KCCSD test), a non-parametric, kernel-based test for assessing the calibration of probabilistic models with well-defined scores. In contrast to previous methods, our…

机器学习 · 统计学 2025-10-17 Pierre Glaser , David Widmann , Fredrik Lindsten , Arthur Gretton

Independence screening is a powerful method for variable selection for `Big Data' when the number of variables is massive. Commonly used independence screening methods are based on marginal correlations or variations of it. In many…

统计理论 · 数学 2012-11-02 Emre Barut , Jianqing Fan , Anneleen Verhasselt

Determining conditional independence (CI) relationships between random variables is a fundamental yet challenging task in machine learning and statistics, especially in high-dimensional settings. Existing generative model-based CI testing…

机器学习 · 计算机科学 2025-05-30 Yixin Ren , Chenghou Jin , Yewei Xia , Li Ke , Longtao Huang , Hui Xue , Hao Zhang , Jihong Guan , Shuigeng Zhou

In nonparametric independence testing, we observe i.i.d.\ data $\{(X_i,Y_i)\}_{i=1}^n$, where $X \in \mathcal{X}, Y \in \mathcal{Y}$ lie in any general spaces, and we wish to test the null that $X$ is independent of $Y$. Modern test…

统计方法学 · 统计学 2022-12-20 Shubhanshu Shekhar , Ilmun Kim , Aaditya Ramdas

Conditional independence (CI) testing is a fundamental and challenging task in modern statistics and machine learning. Many modern methods for CI testing rely on powerful supervised learning methods to learn regression functions or Bayes…

机器学习 · 统计学 2023-10-31 Felipe Maia Polo , Yuekai Sun , Moulinath Banerjee

Measuring conditional independence is one of the important tasks in statistical inference and is fundamental in causal discovery, feature selection, dimensionality reduction, Bayesian network learning, and others. In this work, we explore…

统计理论 · 数学 2020-08-18 Tianhong Sheng , Bharath K. Sriperumbudur

We introduce a general non-parametric independence test between right-censored survival times and covariates, which may be multivariate. Our test statistic has a dual interpretation, first in terms of the supremum of a potentially infinite…

统计方法学 · 统计学 2021-11-23 Tamara Fernandez , Arthur Gretton , David Rindt , Dino Sejdinovic

Many tools exist to detect dependence between random variables, a core question across a wide range of machine learning, statistical, and scientific endeavors. Although several statistical tests guarantee eventual detection of any…

机器学习 · 统计学 2026-03-23 Nathaniel Xu , Feng Liu , Danica J. Sutherland

We propose a method for feature selection that employs kernel-based measures of independence to find a subset of covariates that is maximally predictive of the response. Building on past work in kernel dimension reduction, we show how to…

机器学习 · 统计学 2018-10-23 Jianbo Chen , Mitchell Stern , Martin J. Wainwright , Michael I. Jordan

Kernel-based tests provide a simple yet effective framework that use the theory of reproducing kernel Hilbert spaces to design non-parametric testing procedures. In this paper we propose new theoretical tools that can be used to study the…

统计理论 · 数学 2022-09-02 Tamara Fernández , Nicolás Rivera

Detecting conditional independencies plays a key role in several statistical and machine learning tasks, especially in causal discovery algorithms. In this study, we introduce LCIT (Latent representation based Conditional Independence…

机器学习 · 计算机科学 2022-09-07 Bao Duong , Thin Nguyen

Testing for the conditional independence structure in data is a fundamental and critical task in statistics and machine learning, which finds natural applications in causal discovery - a highly relevant problem to many scientific…

机器学习 · 统计学 2025-03-03 Bao Duong , Nu Hoang , Thin Nguyen

Conditional mean independence (CMI) testing is crucial for statistical tasks including model determination and variable importance evaluation. In this work, we introduce a novel population CMI measure and a bootstrap-based testing procedure…

机器学习 · 统计学 2025-01-30 Yi Zhang , Linjun Huang , Yun Yang , Xiaofeng Shao

In many real-world scenarios, interested variables are often represented as discretized values due to measurement limitations. Applying Conditional Independence (CI) tests directly to such discretized data, however, can lead to incorrect…

人工智能 · 计算机科学 2025-06-11 Boyang Sun , Yu Yao , Xinshuai Dong , Zongfang Liu , Tongliang Liu , Yumou Qiu , Kun Zhang

To adapt kernel two-sample and independence testing to complex structured data, aggregation of multiple kernels is frequently employed to boost testing power compared to single-kernel tests. However, we observe a phenomenon that directly…

机器学习 · 计算机科学 2025-10-14 Zhijian Zhou , Xunye Tian , Liuhua Peng , Chao Lei , Antonin Schrab , Danica J. Sutherland , Feng Liu