English
Related papers

Related papers: Kernel-based independence tests for causal structu…

200 papers

In this article, we study nonparametric inference problems in the context of multivariate or functional time series, including testing for goodness-of-fit, the presence of a change point in the marginal distribution, and the independence of…

Methodology · Statistics 2026-01-22 Deep Ghoshal , Xiaofeng Shao

A fundamental task in AI is to assess (in)dependence between mixed-type variables (text, image, sound). We propose a Bayesian kernelised correlation test of (in)dependence using a Dirichlet process model. The new measure of (in)dependence…

Machine Learning · Statistics 2021-05-11 Alessio Benavoli , Cassio de Campos

The multivariate Hilbert-Schmidt-Independence-Criterion (dHSIC) and distance multivariance allow to measure and test independence of an arbitrary number of random vectors with arbitrary dimensions. Here we define versions which only depend…

Statistics Theory · Mathematics 2020-04-17 Björn Böttcher

Recognizing, quantifying and visualizing associations between two variables is increasingly important. This paper investigates how a new function-valued measure of dependence, the quantile dependence function, can be used to construct tests…

Methodology · Statistics 2019-04-16 Ćmiel Bogdan , Ledwina Teresa

High-dimensional variable selection is an important issue in many scientific fields, such as genomics. In this paper, we develop a sure independence feature screening pro- cedure based on kernel canonical correlation analysis (KCCA-SIS, for…

Methodology · Statistics 2016-10-04 Tianqi Liu , Kuang-Yao Lee , Hongyu Zhao

We demonstrate how to test for conditional independence of two variables with categorical data using Poisson log-linear models. The size of the conditioning set of variables can vary from 0 (simple independence) up to many variables. We…

Methodology · Statistics 2017-06-08 Michail Tsagris

We formulate and analyze a graphical model selection method for inferring the conditional independence graph of a high-dimensional nonstationary Gaussian random process (time series) from a finite-length observation. The observed process…

Machine Learning · Statistics 2016-09-14 Nguyen Tran Quang , Alexander Jung

For a continuous random variable $Z$, testing conditional independence $X \perp\!\!\!\perp Y |Z$ is known to be a particularly hard problem. It constitutes a key ingredient of many constraint-based causal discovery algorithms. These…

Statistics Theory · Mathematics 2021-12-21 Philip A. Boeken , Joris M. Mooij

We propose a novel method to detect and date structural breaks in the entire distribution of functional data. Theoretical guarantees are developed for our procedure under fewer assumptions than in the existing work. In particular, we…

Methodology · Statistics 2025-04-17 Peijun Sang , Bing Li

Conditional independence (CI) testing arises naturally in many scientific problems and applications domains. The goal of this problem is to investigate the conditional independence between a response variable $Y$ and another variable $X$,…

Methodology · Statistics 2025-10-07 Adel Javanmard , Mohammad Mehrabi

Causal discovery is to learn cause-effect relationships among variables given observational data and is important for many applications. Existing causal discovery methods assume data sufficiency, which may not be the case in many real world…

Machine Learning · Computer Science 2022-06-20 Zijun Cui , Naiyu Yin , Yuru Wang , Qiang Ji

We propose the conditional predictive impact (CPI), a consistent and unbiased estimator of the association between one or several features and a given outcome, conditional on a reduced feature set. Building on the knockoff framework of…

Methodology · Statistics 2021-05-14 David S. Watson , Marvin N. Wright

We propose a series of computationally efficient nonparametric tests for the two-sample, independence, and goodness-of-fit problems, using the Maximum Mean Discrepancy (MMD), Hilbert Schmidt Independence Criterion (HSIC), and Kernel Stein…

Machine Learning · Statistics 2023-01-27 Antonin Schrab , Ilmun Kim , Benjamin Guedj , Arthur Gretton

This paper introduces Kernel-based Information Criterion (KIC) for model selection in regression analysis. The novel kernel-based complexity measure in KIC efficiently computes the interdependency between parameters of the model using a…

Machine Learning · Statistics 2014-12-16 Somayeh Danafar , Kenji Fukumizu , Faustino Gomez

We revisit the classical problem of comparing regression functions, a fundamental question in statistical inference with broad relevance to modern applications such as data integration, transfer learning, and causal inference. Existing…

Methodology · Statistics 2025-10-29 Jian Yan , Zhuoxi Li , Yang Ning , Yong Chen

This paper develops a conditional independence (CI) test from a conditional density ratio (CDR) for weakly dependent data. The main contribution is presenting a closed-form expression for the estimated conditional density ratio function…

Methodology · Statistics 2025-04-25 Chunrong Ai , Zixuan Xu , Zheng Zhang

Inferring causal relationships from dynamical systems is the central interest of many scientific inquiries. Conditional local independence, which describes whether the evolution of one process is influenced by another process given…

Methodology · Statistics 2025-10-09 Mingzhou Liu , Xinwei Sun , Yizhou Wang

A vast amount of expert and domain knowledge is captured by causal structural priors, yet there has been little research on testing such priors for generalization and data synthesis purposes. We propose a novel model architecture, Causal…

Machine Learning · Computer Science 2022-11-08 Jeffrey Jiang , Omead Pooladzandi , Sunay Bhat , Gregory Pottie

Kernel techniques are among the most influential approaches in data science and statistics. Under mild conditions, the reproducing kernel Hilbert space associated to a kernel is capable of encoding the independence of $M\ge 2$ random…

Statistics Theory · Mathematics 2024-10-15 Florian Kalinke , Zoltan Szabo

We propose a method to efficiently construct data-dependent kernels which can make use of large quantities of (unlabeled) data. Our construction makes an approximation in the standard construction of semi-supervised kernels in Sindhwani et…

Machine Learning · Computer Science 2015-03-19 Guy Lever , Tom Diethe , John Shawe-Taylor