English
Related papers

Related papers: Measures of independence and functional dependence

200 papers

We review a minimum set of notions from our previous paper on structural properties of SAT at arXiv:0802.1790 that will allow us to define and discuss the "complete internal independence" of a decision problem. This property is strictly…

Computational Complexity · Computer Science 2008-05-21 Silvano Di Zenzo

Independence testing is a classical statistical problem that has been extensively studied in the batch setting when one fixes the sample size before collecting data. However, practitioners often prefer procedures that adapt to the…

Machine Learning · Statistics 2025-05-21 Aleksandr Podkopaev , Patrick Blöbaum , Shiva Prasad Kasiviswanathan , Aaditya Ramdas

We present and evaluate the Fast (conditional) Independence Test (FIT) -- a nonparametric conditional independence test. The test is based on the idea that when $P(X \mid Y, Z) = P(X \mid Y)$, $Z$ is not useful as a feature to predict $X$,…

Machine Learning · Statistics 2018-04-10 Krzysztof Chalupka , Pietro Perona , Frederick Eberhardt

Conditional independence is a fundamental concept in many areas of statistical research, including, for example, sufficient dimension reduction, causal inference, and statistical graphical models. In many modern applications, data arise in…

Methodology · Statistics 2026-03-17 Yin Tang , Bing Li

Many tools exist to detect dependence between random variables, a core question across a wide range of machine learning, statistical, and scientific endeavors. Although several statistical tests guarantee eventual detection of any…

Machine Learning · Statistics 2026-03-23 Nathaniel Xu , Feng Liu , Danica J. Sutherland

In C-tests the hypothesis of items local independence is violated, which doesn't permit to consider them as real tests. It is suggested to determine the distances between separate C-test items (blanks) and to combine items into clusters.…

Computers and Society · Computer Science 2007-10-18 Tretjakova Tamara

In exploratory data analysis, we are often interested in identifying promising pairwise associations for further analysis while filtering out weaker, less interesting ones. This can be accomplished by computing a measure of dependence on…

Methodology · Statistics 2018-03-28 David N. Reshef , Yakir A. Reshef , Pardis C. Sabeti , Michael M. Mitzenmacher

We propose a class of flexible non-parametric tests for the presence of dependence between components of a random vector based on weighted Cram\'{e}r-von Mises functionals of the empirical copula process. The weights act as a tuning…

Statistics Theory · Mathematics 2014-05-29 Ivan Medovikov

The multiscale Fisher's independence test (MULTIFIT hereafter) proposed by Gorsky & Ma (2022) is a novel method to test independence between two random vectors. By its design, this test is particularly useful in detecting local dependence.…

Statistics Theory · Mathematics 2022-04-27 Duyeol Lee , Helal El-Zaatari , Michael R. Kosorok , Xinyi Li , Kai Zhang

We present a new way of testing ordered hypotheses against all alternatives which overpowers the classical approach both in simplicity and statistical power. Our new method tests the constrained likelihood ratio statistic against the…

Methodology · Statistics 2018-06-26 Diaa Al Mohamad , Jelle J. Goeman , Erik W. van Zwet , Eric A. Cator

Quantifying the strength of functional dependence between random scalars $X$ and $Y$ is an important statistical problem. While many existing correlation coefficients excel in identifying linear or monotone functional dependence, they fall…

Methodology · Statistics 2024-03-27 Muhong Gao , Qizhai Li

We extend to rank-based tests of multivariate independence the Chernoff-Savage and Hodges-Lehmann classical univariate results. More precisely, we show that the Taskinen, Kankainen and Oja (2004) normal-score rank test for multivariate…

Statistics Theory · Mathematics 2008-12-18 Marc Hallin , Davy Paindaveine

This paper proposes new tests of conditional independence of two random variables given a single-index involving an unknown finite-dimensional parameter. The tests employ Rosenblatt transforms and are shown to be distribution-free while…

Statistics Theory · Mathematics 2009-11-20 Kyungchul Song

A new computationally efficient dependence measure, and an adaptive statistical test of independence, are proposed. The dependence measure is the difference between analytic embeddings of the joint distribution and the product of the…

Machine Learning · Statistics 2016-10-18 Wittawat Jitkrittum , Zoltan Szabo , Arthur Gretton

Conditional independence testing is a key problem required by many machine learning and statistics tools. In particular, it is one way of evaluating the usefulness of some features on a supervised prediction problem. We propose a novel…

Machine Learning · Statistics 2019-08-02 Marco Henrique de Almeida Inácio , Rafael Izbicki , Rafael Bassi Stern

In this paper we propose several variants to perform the independence test between two random elements based on recurrence rates. We will show how to calculate the test statistic in each one of these cases. From simulations we obtain that…

Methodology · Statistics 2020-09-21 Juan Kalemkerian , Diego Fernández

We treat the problem of testing independence between m continuous variables when m can be larger than the available sample size n. We consider three types of test statistics that are constructed as sums or sums of squares of pairwise rank…

Statistics Theory · Mathematics 2016-12-05 Dennis Leung , Mathias Drton

We introduce a new type of test for complete spatial randomness that applies to mapped point patterns in a rectangle or a cube of any dimension. This is the first test of its kind to be based on characteristic functions and utilizes a…

Methodology · Statistics 2025-09-23 Yiran Zeng , Dale L. Zimmerman

In this paper, we investigate local permutation tests for testing conditional independence between two random vectors $X$ and $Y$ given $Z$. The local permutation test determines the significance of a test statistic by locally shuffling…

Statistics Theory · Mathematics 2022-01-07 Ilmun Kim , Matey Neykov , Sivaraman Balakrishnan , Larry Wasserman

We consider settings in which the data of interest correspond to pairs of ordered times, e.g, the birth times of the first and second child, the times at which a new user creates an account and makes the first purchase on a website, and the…

Methodology · Statistics 2020-11-19 Tamara Fernández , Wenkai Xu , Marc Ditzhaus , Arthur Gretton