English
Related papers

Related papers: Conditional Independence Testing for Discrete Dist…

200 papers

There has been much interest in the nonparametric testing of conditional independence in the econometric and statistical literature, but the simplest and potentially most useful method, based on the sample partial correlation, seems to have…

Statistics Theory · Mathematics 2020-05-27 Wicher Bergsma

For testing independence it is very popular to use either the $\chi^{2}$-statistic or $G^{2}$-statistics (mutual information). Asymptotically both are $\chi^{2}$-distributed so an obvious question is which of the two statistics that has a…

Statistics Theory · Mathematics 2014-02-04 Peter Harremoës

This paper proposes new specification tests for conditional models with discrete responses, which are key to apply efficient maximum likelihood methods, to obtain consistent estimates of partial effects and to get appropriate predictions of…

Statistics Theory · Mathematics 2018-02-01 Igor Kheifets , Carlos Velasco

Model-X approaches to testing conditional independence between a predictor and an outcome variable given a vector of covariates usually assume exact knowledge of the conditional distribution of the predictor given the covariates.…

Methodology · Statistics 2023-02-10 Ziang Niu , Abhinav Chakraborty , Oliver Dukes , Eugene Katsevich

We introduce new estimates and tests of independence in copula models with unknown margins using $\phi$-divergences and the duality technique. The asymptotic laws of the estimates and the test statistics are established both when the…

Statistics Theory · Mathematics 2019-03-06 Salim Bouzebda , Amor Keziou

This paper proposes a novel test method for high-dimensional mean testing regard for the temporal dependent data. Comparison to existing methods, we establish the asymptotic normality of the test statistic without relying on restrictive…

Methodology · Statistics 2025-12-01 Yuchen Hu , Xiaoyi Wang , Long Feng

Tests of conditional independence (CI) underpin a number of important problems in machine learning and statistics, from causal discovery to evaluation of predictor fairness and out-of-distribution robustness. Shah and Peters (2020) showed…

Machine Learning · Statistics 2025-12-17 Zheng He , Roman Pogodin , Yazhe Li , Namrata Deka , Arthur Gretton , Danica J. Sutherland

Symmetry plays a central role in the sciences, machine learning, and statistics. For situations in which data are known to obey a symmetry, a multitude of methods that exploit symmetry have been developed. Statistical tests for the presence…

Methodology · Statistics 2024-12-24 Kenny Chiu , Benjamin Bloem-Reddy

Distance correlation is a measure of dependence between two paired random vectors or matrices of arbitrary, not necessarily equal, dimensions. Unlike Pearson correlation, the population distance correlation coefficient is zero if and only…

Methodology · Statistics 2025-06-19 Kontemeniotis Nikolaos , Vargiakakis Rafail , Tsagris Michail

Higher criticism is a large-scale testing procedure that can attain the optimal detection boundary for sparse and faint signals. However, there has been a lack of knowledge in most existing works about its asymptotic distribution for more…

Statistics Theory · Mathematics 2025-11-11 Jingkun Qiu

Conditional-independence-based discovery uses statistical tests to identify a graphical model that represents the independence structure of variables in a dataset. These tests, however, can be unreliable, and algorithms are sensitive to…

Machine Learning · Computer Science 2026-04-21 Philipp M. Faller , Dominik Janzing

We describe a data-efficient, kernel-based approach to statistical testing of conditional independence. A major challenge of conditional independence testing is to obtain the correct test level (the specified upper bound on the rate of…

Machine Learning · Computer Science 2025-09-23 Roman Pogodin , Antonin Schrab , Yazhe Li , Danica J. Sutherland , Arthur Gretton

We apply the concept of distance covariance for testing independence of two long-range dependent time series. As test statistic we propose a linear combination of empirical distance cross-covariances. We derive the asymptotic distribution…

Statistics Theory · Mathematics 2026-01-28 Annika Betken , Herold Dehling

Conditional independence (CI) testing is frequently used in data analysis and machine learning for various scientific fields and it forms the basis of constraint-based causal discovery. Oftentimes, CI testing relies on strong, rather…

Methodology · Statistics 2023-06-21 Wiebke Günther , Urmi Ninad , jonas Wahl , Jakob Runge

This article addresses the problem of testing the conditional independence of two generic random vectors $X$ and $Y$ given a third random vector $Z$, which plays an important role in statistical and machine learning applications. We propose…

Methodology · Statistics 2024-07-26 Yi Zhang , Linjun Huang , Yun Yang , Xiaofeng Shao

We consider the problem of non-parametric Conditional Independence testing (CI testing) for continuous random variables. Given i.i.d samples from the joint distribution $f(x,y,z)$ of continuous random vectors $X,Y$ and $Z,$ we determine…

We demonstrate how to test for conditional independence of two variables with categorical data using Poisson log-linear models. The size of the conditioning set of variables can vary from 0 (simple independence) up to many variables. We…

Methodology · Statistics 2017-06-08 Michail Tsagris

We study the problem of testing discrete distributions with a focus on the high probability regime. Specifically, given samples from one or more discrete distributions, a property $\mathcal{P}$, and parameters $0< \epsilon, \delta <1$, we…

Data Structures and Algorithms · Computer Science 2020-09-15 Ilias Diakonikolas , Themis Gouleakis , Daniel M. Kane , John Peebles , Eric Price

This paper develops a novel nonparametric significance test based on a tailored nonparametric-type projected weighting function that exhibits appealing theoretical and numerical properties. We derive the asymptotic properties of the…

Econometrics · Economics 2026-02-18 Xiaojun Song , Jichao Yuan

We introduce an independence criterion based on entropy regularized optimal transport. Our criterion can be used to test for independence between two samples. We establish non-asymptotic bounds for our test statistic and study its…

Machine Learning · Statistics 2022-04-21 Lang Liu , Soumik Pal , Zaid Harchaoui