English
Related papers

Related papers: Independence test for high dimensional data based …

200 papers

Many tools exist to detect dependence between random variables, a core question across a wide range of machine learning, statistical, and scientific endeavors. Although several statistical tests guarantee eventual detection of any…

Machine Learning · Statistics 2026-03-23 Nathaniel Xu , Feng Liu , Danica J. Sutherland

This paper develops a model-free sequential test for conditional independence. The proposed test allows researchers to analyze an incoming i.i.d. data stream with any arbitrary dependency structure, and safely conclude whether a feature is…

Methodology · Statistics 2023-02-21 Shalev Shaer , Gal Maman , Yaniv Romano

We consider the problem of testing for the presence of linear relationships between large sets of random variables based on a post-selection inference approach to canonical correlation analysis. The challenge is to adjust for the selection…

Methodology · Statistics 2020-10-20 Ian W. McKeague , Xin Zhang

We propose a novel statistical test to assess the mutual independence of multidimensional random vectors. Our approach is based on the $L_1$-distance between the joint density function and the product of the marginal densities associated…

Statistics Theory · Mathematics 2024-04-19 Nour-Eddine Berrahou , Salim Bouzebda , Lahcen Douge

A new computationally efficient dependence measure, and an adaptive statistical test of independence, are proposed. The dependence measure is the difference between analytic embeddings of the joint distribution and the product of the…

Machine Learning · Statistics 2016-10-18 Wittawat Jitkrittum , Zoltan Szabo , Arthur Gretton

Relational data are often represented as a square matrix, the entries of which record the relationships between pairs of objects. Many statistical methods for the analysis of such data assume some degree of similarity or dependence between…

Statistics Theory · Mathematics 2013-06-26 Alexander Volfovsky , Peter D. Hoff

In this article, we consider the complete independence test of high-dimensional data. Based on Chatterjee coefficient, we pioneer the development of quadratic test and extreme value test which possess good testing performance for…

Statistics Theory · Mathematics 2024-09-17 Liqi Xia , Ruiyuan Cao , Jiang Du , Jun Dai

We propose a high-dimensional white noise test that captures serial correlations within and across component series without specifying an alternative model. The test statistic is a U-statistic based on sample autocovariances. Under the…

Methodology · Statistics 2026-05-07 Yuanya Xu

Given well-shuffled data, can we determine whether the data items are statistically (in)dependent? Formally, we consider the problem of testing whether a set of exchangeable random variables are independent. We will show that this is…

Statistics Theory · Mathematics 2022-10-25 Marcus Hutter

Temporal data are increasingly prevalent in modern data science. A fundamental question is whether two time series are related or not. Existing approaches often have limitations, such as relying on parametric assumptions, detecting only…

Machine Learning · Statistics 2024-05-29 Cencheng Shen , Jaewon Chung , Ronak Mehta , Ting Xu , Joshua T. Vogelstein

In this article, we propose a class of $L_q$-norm based U-statistics for a family of global testing problems related to high-dimensional data. This includes testing of mean vector and its spatial sign, simultaneous testing of linear model…

Statistics Theory · Mathematics 2023-03-16 Yangfan Zhang , Runmin Wang , Xiaofeng Shao

We propose two model-free, permutation-based tests of independence between a pair of random variables. The tests can be applied to samples from any bivariate distribution: continuous, discrete or mixture of those, with light tails or heavy…

Methodology · Statistics 2022-05-16 Jiří Dvořák , Tomáš Mrkvička

Motivated by applications in biological science, we propose a novel test to assess the conditional mean dependence of a response variable on a large number of covariates. Our procedure is built on the martingale difference divergence…

Statistics Theory · Mathematics 2017-01-31 Xianyang Zhang , Shun Yao , Xiaofeng Shao

We introduce a new test for conditional independence which is based on what we call the weighted generalised covariance measure (WGCM). It is an extension of the recently introduced generalised covariance measure (GCM). To test the null…

Methodology · Statistics 2022-05-17 Cyrill Scheidegger , Julia Hörrmann , Peter Bühlmann

We propose a new method to test conditional independence of two real random variables $Y$ and $Z$ conditionally on an arbitrary third random variable $X$. %with $F_{.|.}$ representing conditional distribution functions, The partial copula…

Statistics Theory · Mathematics 2011-01-25 Wicher Bergsma

It is established that the linear spectral statistics (LSS) of the smoothed periodogram estimate of the spectral coherence matrix of a complex Gaussian high-dimensional times series (yn) n$\in$Z with independent components satisfy at each…

Statistics Theory · Mathematics 2025-11-19 Philippe Loubaton , Alexis Rosuel , Pascal Vallet

In this article, we first establish the joint central limit theorem (CLT) for the extreme eigenvalues of the sample correlation matrix of high-dimensional random walks with cross-sectional dependence. We further investigate the asymptotic…

Methodology · Statistics 2025-08-05 Ruihan Liu , Chen Wang

Tests of independence are an important tool in applications, specifically in connection with the detection of a relationship between variables; they also have initiated many developments in statistical theory. In the present paper we build…

Statistics Theory · Mathematics 2026-05-13 L. Baringhaus , R. Grübel

Information theory provides ideas for conceptualising information and measuring relationships between objects. It has found wide application in the sciences, but economics and finance have made surprisingly little use of it. We show that…

Statistical Finance · Quantitative Finance 2013-05-02 Galen Sher , Pedro Vitoria

This paper investigates the central limit theorem for linear spectral statistics of high dimensional sample covariance matrices of the form $\mathbf{B}_n=n^{-1}\sum_{j=1}^{n}\mathbf{Q}\mathbf{x}_j\mathbf{x}_j^{*}\mathbf{Q}^{*}$ where…

Probability · Mathematics 2017-08-15 Shurong Zheng , Zhidong Bai , Jianfeng Yao , Hongtu Zhu
‹ Prev 1 3 4 5 6 7 10 Next ›