English
Related papers

Related papers: Learning Representations for Independence Testing

200 papers

This paper proposes a new statistic to test independence between two high dimensional random vectors ${\mathbf{X}}:p_1\times1$ and ${\mathbf{Y}}:p_2\times1$. The proposed statistic is based on the sum of regularized sample canonical…

Statistics Theory · Mathematics 2015-03-19 Yanrong Yang , Guangming Pan

Refining one's hypotheses in the light of data is a common scientific practice; however, the dependency on the data introduces selection bias and can lead to specious statistical analysis. An approach for addressing this is via conditioning…

Machine Learning · Computer Science 2020-03-03 Jen Ning Lim , Makoto Yamada , Wittawat Jitkrittum , Yoshikazu Terada , Shigeyuki Matsui , Hidetoshi Shimodaira

In this paper we develop a novel nonparametric framework to test the independence of two random variables $\mathbf{X}$ and $\mathbf{Y}$ with unknown respective marginals $H(dx)$ and $G(dy)$ and joint distribution $F(dx dy)$, based on {\it…

Statistics Theory · Mathematics 2024-03-20 Myrto Limnios , Stéphan Clémençon

Simple correlation coefficients between two variables have been generalized to measure association between two matrices in many ways. Coefficients such as the RV coefficient, the distance covariance (dCov) coefficient and kernel based…

Methodology · Statistics 2014-08-19 Julie Josse , Susan Holmes

Conditional independence testing (CIT) is a common task in machine learning, e.g., for variable selection, and a main component of constraint-based causal discovery. While most current CIT approaches assume that all variables are numerical…

Machine Learning · Computer Science 2023-11-07 Oana-Iuliana Popescu , Andreas Gerhardus , Jakob Runge

This paper introduces a new method for testing the statistical significance of estimated parameters in predictive regressions. The approach features a new family of test statistics that are robust to the degree of persistence of the…

Econometrics · Economics 2025-02-04 Jean-Yves Pitarakis

This paper proposes a nonparametric test of pairwise independence of one random variable from a large pool of other random variables. The test statistic is the maximum of several Chatterjee's rank correlations and critical values are…

Methodology · Statistics 2026-02-17 Mauricio Olivares , Tomasz Olma , Daniel Wilhelm

We develop inference procedures robust to general forms of weak dependence. The procedures utilize test statistics constructed by resampling in a manner that does not depend on the unknown correlation structure of the data. We prove that…

Econometrics · Economics 2021-08-26 Michael P. Leung

We introduce the HSIC (Hilbert-Schmidt independence criterion) bottleneck for training deep neural networks. The HSIC bottleneck is an alternative to the conventional cross-entropy loss and backpropagation that has a number of distinct…

Machine Learning · Computer Science 2019-12-06 Wan-Duo Kurt Ma , J. P. Lewis , W. Bastiaan Kleijn

For testing two random vectors for independence, we consider testing whether the distance of one vector from a center point is independent from the distance of the other vector from a center point by a univariate test. In this paper we…

Methodology · Statistics 2016-03-11 Ruth Heller , Yair Heller

The problem of signal detection using sparse, faint information is closely related to a variety of contemporary statistical problems, including the control of false-discovery rate, and classification using very high-dimensional data. Each…

Statistics Theory · Mathematics 2008-12-18 Peter Hall , Jiashun Jin

We consider the problem of testing mutual independence among the components of a high-dimensional random vector. Building on the rank-based max-sum framework, we introduce fixed finite-$L_q$ power-sum statistics under three general classes…

Methodology · Statistics 2026-05-26 Ping Zhao , Hongfei Wang , Long Feng

We propose a method for learning Markov network structures for continuous data without invoking any assumptions about the distribution of the variables. The method makes use of previous work on a non-parametric estimator for mutual…

Machine Learning · Computer Science 2017-08-09 Janne Leppä-aho , Santeri Räisänen , Xiao Yang , Teemu Roos

The concept of independence plays a crucial role in probability theory and has been the subject of extensive research in recent years. Numerous approaches have been proposed to test for independence; however, most of them address the…

Methodology · Statistics 2026-05-14 Bogdan Ćmiel , Bartłomiej Gibas

In this paper, we are concerned with the independence test for $k$ high-dimensional sub-vectors of a normal vector, with fixed positive integer $k$. A natural high-dimensional extension of the classical sample correlation matrix, namely…

Statistics Theory · Mathematics 2014-10-21 Zhigang Bao , Jiang Hu , Guangming Pan , Wang Zhou

Modeling users' dynamic preferences from historical behaviors lies at the core of modern recommender systems. Due to the diverse nature of user interests, recent advances propose the multi-interest networks to encode historical behaviors…

Information Retrieval · Computer Science 2022-07-19 Zhaocheng Liu , Yingtao Luo , Di Zeng , Qiang Liu , Daqing Chang , Dongying Kong , Zhi Chen

Statistical dependence between hypotheses poses a significant challenge to the stability of large scale multiple hypotheses testing. Ignoring it often results in an unacceptably large spread in the false positive proportion even though the…

Methodology · Statistics 2018-10-15 Sairam Rayaprolu , Zhiyi Chi

We apply the concept of distance covariance for testing independence of two long-range dependent time series. As test statistic we propose a linear combination of empirical distance cross-covariances. We derive the asymptotic distribution…

Statistics Theory · Mathematics 2026-01-28 Annika Betken , Herold Dehling

Identifying how dependence relationships vary across different conditions plays a significant role in many scientific investigations. For example, it is important for the comparison of biological systems to see if relationships between…

Methodology · Statistics 2023-07-31 Hoseung Song , Michael C. Wu

In this paper, we introduce a ${\mathcal L}_2$ type test for testing mutual independence and banded dependence structure for high dimensional data. The test is constructed based on the pairwise distance covariance and it accounts for the…

Methodology · Statistics 2017-09-20 Shun Yao , Xianyang Zhang , Xiaofeng Shao