English
Related papers

Related papers: Kernel-based method for joint independence of func…

200 papers

Causal inference grows increasingly complex as the number of confounders increases. Given treatments $X$, confounders $Z$ and outcomes $Y$, we develop a non-parametric method to test the \textit{do-null} hypothesis $H_0:\; p(y|\text{\it…

Methodology · Statistics 2024-06-04 Robert Hu , Dino Sejdinovic , Robin J. Evans

In this paper, we present the general theory of embedding independence tests on Hilbert spaces that generalizes the concepts of distance covariance, distance multivariance and HSIC. This is done by defining new types of kernel on an $n$…

Functional Analysis · Mathematics 2024-11-14 Jean Carlo Guella

Two-sample and independence tests with the kernel-based MMD and HSIC have shown remarkable results on i.i.d. data and stationary random processes. However, these statistics are not directly applicable to non-stationary random processes, a…

Methodology · Statistics 2021-01-05 Felix Laumann , Julius von Kügelgen , Mauricio Barahona

The Hilbert--Schmidt Independence Criterion (HSIC) is a popular measure of the dependency between two random variables. The statistic dHSIC is an extension of HSIC that can be used to test joint independence of $d$ random variables. Such…

Statistics Theory · Mathematics 2020-05-15 David Rindt , Dino Sejdinovic , David Steinsaltz

We describe a novel non-parametric statistical hypothesis test of relative dependence between a source variable and two candidate target variables. Such a test enables us to determine whether one source variable is significantly more…

Machine Learning · Statistics 2015-05-28 Wacha Bounliphone , Arthur Gretton , Arthur Tenenhaus , Matthew Blaschko

In nonparametric independence testing, we observe i.i.d.\ data $\{(X_i,Y_i)\}_{i=1}^n$, where $X \in \mathcal{X}, Y \in \mathcal{Y}$ lie in any general spaces, and we wish to test the null that $X$ is independent of $Y$. Modern test…

Methodology · Statistics 2022-12-20 Shubhanshu Shekhar , Ilmun Kim , Aaditya Ramdas

Conditional independence is a fundamental concept in many areas of statistical research, including, for example, sufficient dimension reduction, causal inference, and statistical graphical models. In many modern applications, data arise in…

Methodology · Statistics 2026-03-17 Yin Tang , Bing Li

We introduce a general non-parametric independence test between right-censored survival times and covariates, which may be multivariate. Our test statistic has a dual interpretation, first in terms of the supremum of a potentially infinite…

Methodology · Statistics 2021-11-23 Tamara Fernandez , Arthur Gretton , David Rindt , Dino Sejdinovic

Recent works investigated the generalization properties in deep neural networks (DNNs) by studying the Information Bottleneck in DNNs. However, the mea- surement of the mutual information (MI) is often inaccurate due to the density…

Information Theory · Computer Science 2018-02-16 Denny Wu , Yixiu Zhao , Yao-Hung Hubert Tsai , Makoto Yamada , Ruslan Salakhutdinov

This paper proposes some novel one-sided omnibus tests for independence between two multivariate stationary time series. These new tests apply the Hilbert-Schmidt independence criterion (HSIC) to test the independence between the…

Methodology · Statistics 2018-04-27 Guochang Wang , Wai Keung Li , Ke Zhu

We introduce a framework for filtering features that employs the Hilbert-Schmidt Independence Criterion (HSIC) as a measure of dependence between the features and the labels. The key idea is that good features should maximise such…

Machine Learning · Computer Science 2007-05-23 Le Song , Alex Smola , Arthur Gretton , Karsten Borgwardt , Justin Bedo

The Hilbert Schmidt Independence Criterion (HSIC) is a kernel dependence measure that has applications in various aspects of machine learning. Conveniently, the objectives of different dimensionality reduction applications using HSIC often…

Machine Learning · Statistics 2019-09-12 Chieh Wu , Jared Miller , Yale Chang , Mario Sznaier , Jennifer Dy

We develop a Hilbert--Schmidt independence criterion (HSIC)-based framework for testing serial independence in strictly stationary time series. The proposed auto Hilbert--Schmidt independence criterion (AutoHSIC) measures dependence between…

Methodology · Statistics 2026-05-22 Muyi Li , Yuqing Xu , Zhou Zhou

We propose an estimator of the kernel-based conditional mean dependence measure obtained from an appropriate modification of a naive estimator based on usual empirical estimators. We then get asymptotic normality of this estimator both…

Statistics Theory · Mathematics 2022-07-27 Terence Kevin Manfoumbi Djonguet , Guy Martial Nkiet

Conditional independence testing is an important problem, especially in Bayesian network learning and causal discovery. Due to the curse of dimensionality, testing for conditional independence of continuous variables is particularly…

Machine Learning · Computer Science 2012-02-20 Kun Zhang , Jonas Peters , Dominik Janzing , Bernhard Schoelkopf

A new computationally efficient dependence measure, and an adaptive statistical test of independence, are proposed. The dependence measure is the difference between analytic embeddings of the joint distribution and the product of the…

Machine Learning · Statistics 2016-10-18 Wittawat Jitkrittum , Zoltan Szabo , Arthur Gretton

The multivariate Hilbert-Schmidt-Independence-Criterion (dHSIC) and distance multivariance allow to measure and test independence of an arbitrary number of random vectors with arbitrary dimensions. Here we define versions which only depend…

Statistics Theory · Mathematics 2020-04-17 Björn Böttcher

This paper presents a new efficient black-box attribution method based on Hilbert-Schmidt Independence Criterion (HSIC), a dependence measure based on Reproducing Kernel Hilbert Spaces (RKHS). HSIC measures the dependence between regions of…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Paul Novello , Thomas Fel , David Vigouroux

We consider the problem of conditional independence (CI) testing and adopt a kernel-based approach. Kernel-based CI tests embed variables in reproducing kernel Hilbert spaces, regress their embeddings on the conditioning variables, and test…

Machine Learning · Statistics 2026-04-07 Luca Bergen , Dino Sejdinovic , Vanessa Didelez

Evaluation of statistical dependencies between two data samples is a basic problem of data science/machine learning, and HSIC (Hilbert-Schmidt Information Criterion)~\cite{HSIC} is considered the state-of-art method. However, for size $n$…

Machine Learning · Computer Science 2025-09-03 Jarek Duda , Jagoda Bracha , Adrian Przybysz