English
Related papers

Related papers: Testing Conditional Independence of Discrete Distr…

200 papers

We investigate the problems of identity and closeness testing over a discrete population from random samples. Our goal is to develop efficient testers while guaranteeing Differential Privacy to the individuals of the population. We describe…

Machine Learning · Computer Science 2017-07-19 Maryam Aliakbarpour , Ilias Diakonikolas , Ronitt Rubinfeld

We consider testing marginal independence versus conditional independence in a trivariate Gaussian setting. The two models are non-nested and their intersection is a union of two marginal independences. We consider two sequences of such…

Statistics Theory · Mathematics 2020-10-23 F. Richard Guo , Thomas S. Richardson

It is a common saying that testing for conditional independence, i.e., testing whether whether two random vectors $X$ and $Y$ are independent, given $Z$, is a hard statistical problem if $Z$ is a continuous random variable (or vector). In…

Statistics Theory · Mathematics 2022-03-25 Rajen D. Shah , Jonas Peters

As a crucial problem in statistics is to decide whether additional variables are needed in a regression model. We propose a new multivariate test to investigate the conditional mean independence of Y given X conditioning on some known…

Statistics Theory · Mathematics 2018-05-18 Ze Jin , Xiaohan Yan , David S. Matteson

We revisit the distributed hypothesis testing (or hypothesis testing with communication constraints) problem from the viewpoint of privacy. Instead of observing the raw data directly, the transmitter observes a sanitized or randomized…

Information Theory · Computer Science 2019-06-26 Atefeh Gilani , Selma Belhadj Amor , Sadaf Salehkalaibar , Vincent Y. F. Tan

We study the following independence testing problem: given access to samples from a distribution $P$ over $\{0,1\}^n$, decide whether $P$ is a product distribution or whether it is $\varepsilon$-far in total variation distance from any…

Data Structures and Algorithms · Computer Science 2023-01-04 Arnab Bhattacharyya , Clément L. Canonne , Joy Qiping Yang

We study goodness-of-fit and independence testing of discrete distributions in a setting where samples are distributed across multiple users. The users wish to preserve the privacy of their data while enabling a central server to perform…

Data Structures and Algorithms · Computer Science 2021-01-21 Jayadev Acharya , Clément L. Canonne , Cody Freitag , Ziteng Sun , Himanshu Tyagi

Given samples from two distributions over an $n$-element set, we wish to test whether these distributions are statistically close. We present an algorithm which uses sublinear in $n$, specifically, $O(n^{2/3}\epsilon^{-8/3}\log n)$,…

Data Structures and Algorithms · Computer Science 2010-11-05 Tugkan Batu , Lance Fortnow , Ronitt Rubinfeld , Warren D. Smith , Patrick White

In this short note, we identify and address an error in the proof of Theorem 1.3 in Canonne et al. (2018), a recent breakthrough in conditional independence testing. After correcting the error, we show that the general sample complexity…

Statistics Theory · Mathematics 2022-07-07 Ilmun Kim

Causal phenomena associated with rare events occur across a wide range of engineering problems, such as risk-sensitive safety analysis, accident analysis and prevention, and extreme value theory. However, current methods for causal…

Machine Learning · Statistics 2023-07-19 Chih-Yuan Chiu , Kshitij Kulkarni , Shankar Sastry

We propose a coefficient of conditional dependence between two random variables $Y$ and $Z$ given a set of other variables $X_1,\ldots,X_p$, based on an i.i.d. sample. The coefficient has a long list of desirable properties, the most…

Statistics Theory · Mathematics 2021-03-30 Mona Azadkia , Sourav Chatterjee

In this work, we give a novel general approach for distribution testing. We describe two techniques: our first technique gives sample-optimal testers, while our second technique gives matching sample lower bounds. As a consequence, we…

Data Structures and Algorithms · Computer Science 2016-05-10 Ilias Diakonikolas , Daniel M. Kane

The problem of measuring conditional dependence between two random phenomena arises when a third one (a confounder) has a potential influence on the amount of information between them. A typical issue in this challenging problem is the…

Machine Learning · Statistics 2025-03-12 Ferran de Cabrera , Marc Vilà-Insa , Jaume Riba

A collaborative distributed binary decision problem is considered. Two statisticians are required to declare the correct probability measure of two jointly distributed memoryless process, denoted by $X^n=(X_1,\dots,X_n)$ and…

Information Theory · Computer Science 2016-04-11 Gil Katz , Pablo Piantanida , Merouane Debbah

Independence testing plays a central role in statistical and causal inference from observational data. Standard independence tests assume that the data samples are independent and identically distributed (i.i.d.) but that assumption is…

Machine Learning · Statistics 2022-07-04 Ragib Ahsan , Zahra Fatemi , David Arbour , Elena Zheleva

Given samples from an unknown distribution $p$, is it possible to distinguish whether $p$ belongs to some class of distributions $\mathcal{C}$ versus $p$ being far from every distribution in $\mathcal{C}$? This fundamental question has…

Data Structures and Algorithms · Computer Science 2015-12-09 Jayadev Acharya , Constantinos Daskalakis , Gautam Kamath

We consider the closeness testing problem for discrete distributions. The goal is to distinguish whether two samples are drawn from the same unspecified distribution, or whether their respective distributions are separated in $L_1$-norm. In…

Statistics Theory · Mathematics 2021-01-20 Joseph Lam-Weil , Alexandra Carpentier , Bharath K. Sriperumbudur

Given well-shuffled data, can we determine whether the data items are statistically (in)dependent? Formally, we consider the problem of testing whether a set of exchangeable random variables are independent. We will show that this is…

Statistics Theory · Mathematics 2022-10-25 Marcus Hutter

We study the problem of discrete distribution testing in the two-party setting. For example, in the standard closeness testing problem, Alice and Bob each have $t$ samples from, respectively, distributions $a$ and $b$ over $[n]$, and they…

Data Structures and Algorithms · Computer Science 2018-11-12 Alexandr Andoni , Tal Malkin , Negev Shekel Nosatzki

We apply the concept of distance covariance for testing independence of two long-range dependent time series. As test statistic we propose a linear combination of empirical distance cross-covariances. We derive the asymptotic distribution…

Statistics Theory · Mathematics 2026-01-28 Annika Betken , Herold Dehling