English
Related papers

Related papers: Consistency of permutation tests for HSIC and dHSI…

200 papers

We propose a new nonparametric test for the supposition of independence between two continuous random variables. The test is based on the size of the longest increasing subsequence of a random permutation. We identified the independence…

Methodology · Statistics 2015-03-13 Jesus E. Garcia , Veronica A. Gonzalez-Lopez

Kernel dependence measures yield accurate estimates of nonlinear relations between random variables, and they are also endorsed with solid theoretical properties and convergence rates. Besides, the empirical estimates are easy to compute in…

Machine Learning · Statistics 2016-11-03 Adrián Pérez-Suay , Gustau Camps-Valls

We study the problem of independence testing given independent and identically distributed pairs taking values in a $\sigma$-finite, separable measure space. Defining a natural measure of dependence $D(f)$ as the squared $L^2$-distance…

Statistics Theory · Mathematics 2020-11-09 Thomas B. Berrett , Ioannis Kontoyiannis , Richard J. Samworth

We develop a Hilbert--Schmidt independence criterion (HSIC)-based framework for testing serial independence in strictly stationary time series. The proposed auto Hilbert--Schmidt independence criterion (AutoHSIC) measures dependence between…

Methodology · Statistics 2026-05-22 Muyi Li , Yuqing Xu , Zhou Zhou

The test of independence is a crucial component of modern data analysis. However, traditional methods often struggle with the complex dependency structures found in high-dimensional data. To overcome this challenge, we introduce a novel…

Methodology · Statistics 2024-09-13 Mingshuo Liu , Doudou Zhou , Hao Chen

In this paper, we study distance covariance, Hilbert-Schmidt covariance (aka Hilbert-Schmidt independence criterion [Gretton et al. (2008)]) and related independence tests under the high dimensional scenario. We show that the sample…

Statistics Theory · Mathematics 2019-02-12 Changbo Zhu , Shun Yao , Xianyang Zhang , Xiaofeng Shao

We propose a general new method, the conditional permutation test, for testing the conditional independence of variables $X$ and $Y$ given a potentially high-dimensional random vector $Z$ that may contain confounding factors. The proposed…

Methodology · Statistics 2019-05-08 Thomas B. Berrett , Yi Wang , Rina Foygel Barber , Richard J. Samworth

A simple and intuitive method for feature selection consists of choosing the feature subset that maximizes a nonparametric measure of dependence between the response and the features. A popular proposal from the literature uses the…

Machine Learning · Statistics 2024-06-12 Keli Liu , Feng Ruan

Recent works investigated the generalization properties in deep neural networks (DNNs) by studying the Information Bottleneck in DNNs. However, the mea- surement of the mutual information (MI) is often inaccurate due to the density…

Information Theory · Computer Science 2018-02-16 Denny Wu , Yixiu Zhao , Yao-Hung Hubert Tsai , Makoto Yamada , Ruslan Salakhutdinov

We propose an estimator of the Hilbert-Schmidt Independence Criterion obtained from an appropriate modification of the usual estimator. We then get asymptotic normality of this estimator both under independence hypothesis and under the…

Statistics Theory · Mathematics 2022-06-24 Terence Kevin Manfoumbi Djonguet , Guy Martial Nkiet , Alban Mbina Mbina

Kernel techniques are among the most popular and powerful approaches of data science. Among the key features that make kernels ubiquitous are (i) the number of domains they have been designed for, (ii) the Hilbert structure of the function…

Machine Learning · Statistics 2025-03-18 Florian Kalinke , Zoltán Szabó

A new computationally efficient dependence measure, and an adaptive statistical test of independence, are proposed. The dependence measure is the difference between analytic embeddings of the joint distribution and the product of the…

Machine Learning · Statistics 2016-10-18 Wittawat Jitkrittum , Zoltan Szabo , Arthur Gretton

We present the $U$-Statistic Permutation (USP) test of independence in the context of discrete data displayed in a contingency table. Either Pearson's chi-squared test of independence, or the $G$-test, are typically used for this task, but…

Methodology · Statistics 2022-01-19 Thomas B. Berrett , Richard J. Samworth

Causal inference grows increasingly complex as the number of confounders increases. Given treatments $X$, confounders $Z$ and outcomes $Y$, we develop a non-parametric method to test the \textit{do-null} hypothesis $H_0:\; p(y|\text{\it…

Methodology · Statistics 2024-06-04 Robert Hu , Dino Sejdinovic , Robin J. Evans

We investigate the use of a non-parametric independence measure, the Hilbert-Schmidt Independence Criterion (HSIC), as a loss-function for learning robust regression and classification models. This loss-function encourages learning models…

Machine Learning · Computer Science 2020-07-14 Daniel Greenfeld , Uri Shalit

Testing two potentially multivariate variables for statistical dependence on the basis finite samples is a fundamental statistical challenge. Here we explore a family of tests that adapt to the complexity of the relationship between the…

Machine Learning · Statistics 2020-10-23 Baihan Lin , Nikolaus Kriegeskorte

Multivariate time series data that capture the temporal evolution of interconnected systems are ubiquitous in diverse areas. Understanding the complex relationships and potential dependencies among co-observed variables is crucial for the…

Methodology · Statistics 2023-11-03 Zhaolu Liu , Robert L. Peach , Felix Laumann , Sara Vallejo Mengod , Mauricio Barahona

In this paper we propose several variants to perform the independence test between two random elements based on recurrence rates. We will show how to calculate the test statistic in each one of these cases. From simulations we obtain that…

Methodology · Statistics 2020-09-21 Juan Kalemkerian , Diego Fernández

The paper introduces robust independence tests with non-asymptotically guaranteed significance levels for stochastic linear time-invariant systems, assuming that the observed outputs are synchronous, which means that the systems are driven…

Machine Learning · Statistics 2023-08-07 Ambrus Tamás , Dániel Ágoston Bálint , Balázs Csanád Csáji

Distance multivariance is a multivariate dependence measure, which can detect dependencies between an arbitrary number of random vectors each of which can have a distinct dimension. Here we discuss several new aspects, present a concise…

Statistics Theory · Mathematics 2020-04-17 Björn Böttcher