English
Related papers

Related papers: Testing Data Binnings

200 papers

In this work we present novel differentially private identity (goodness-of-fit) testers for natural and widely studied classes of multivariate product distributions: Gaussians in $\mathbb{R}^d$ with known covariance and product…

Data Structures and Algorithms · Computer Science 2022-03-07 Clément L. Canonne , Gautam Kamath , Audra McMillan , Jonathan Ullman , Lydia Zakynthinou

In this work, we consider the sample complexity required for testing the monotonicity of distributions over partial orders. A distribution $p$ over a poset is monotone if, for any pair of domain elements $x$ and $y$ such that $x \preceq y$,…

Data Structures and Algorithms · Computer Science 2019-07-09 Maryam Aliakbarpour , Themis Gouleakis , John Peebles , Ronitt Rubinfeld , Anak Yodpinyanee

We study goodness-of-fit and independence testing of discrete distributions in a setting where samples are distributed across multiple users. The users wish to preserve the privacy of their data while enabling a central server to perform…

Data Structures and Algorithms · Computer Science 2021-01-21 Jayadev Acharya , Clément L. Canonne , Cody Freitag , Ziteng Sun , Himanshu Tyagi

In the binary hypothesis testing problem, it is well known that sequentiality in taking samples eradicates the trade-off between two error exponents, yet implementing the optimal test requires the knowledge of the underlying distributions,…

Information Theory · Computer Science 2025-01-07 Ching-Fang Li , I-Hsiang Wang

Trustworthy deployment of ML models requires a proper measure of uncertainty, especially in safety-critical applications. We focus on uncertainty quantification (UQ) for classification problems via two avenues -- prediction sets using…

Machine Learning · Statistics 2021-07-08 Aleksandr Podkopaev , Aaditya Ramdas

A fundamental problem in statistics and learning theory is to test properties of distributions. We show that quantum computers can solve such problems with significant speed-ups. In particular, we give fast quantum algorithms for testing…

Quantum Physics · Physics 2019-02-05 András Gilyén , Tongyang Li

By extrapolating the explicit formula of the zero-bias distribution occurring in the context of Stein's method, we construct characterization identities for a large class of absolutely continuous univariate distributions. Instead of trying…

Statistics Theory · Mathematics 2021-02-26 Steffen Betsch , Bruno Ebner

Distribution testing deals with what information can be deduced about an unknown distribution over $\{1,\ldots,n\}$, where the algorithm is only allowed to obtain a relatively small number of independent samples from the distribution. In…

Computational Complexity · Computer Science 2016-09-23 Eldar Fischer , Oded Lachish , Yadu Vasudev

Private closeness testing asks to decide whether the underlying probability distributions of two sensitive datasets are identical or differ significantly in statistical distance, while guaranteeing (differential) privacy of the data. As in…

Data Structures and Algorithms · Computer Science 2023-09-14 Clément L. Canonne , Yucheng Sun

The classic problems of testing uniformity of and learning a discrete distribution, given access to independent samples from it, are examined under general $\ell_p$ metrics. The intuitions and results often contrast with the classic…

Data Structures and Algorithms · Computer Science 2015-03-24 Bo Waggoner

We study the problem of discrete distribution testing in the two-party setting. For example, in the standard closeness testing problem, Alice and Bob each have $t$ samples from, respectively, distributions $a$ and $b$ over $[n]$, and they…

Data Structures and Algorithms · Computer Science 2018-11-12 Alexandr Andoni , Tal Malkin , Negev Shekel Nosatzki

We study the problem of conditional two-sample testing, which aims to determine whether two populations have the same distribution after accounting for confounding factors. This problem commonly arises in various applications, such as…

Machine Learning · Statistics 2026-05-05 Seongchan Lee , Suman Cha , Ilmun Kim

We study distributed goodness-of-fit testing for discrete distribution under bandwidth and differential privacy constraints. Information constraint distributed goodness-of-fit testing is a problem that has received considerable attention…

Statistics Theory · Mathematics 2024-11-05 Lasse Vuursteen

The main purpose of this paper is to present new families of test statistics for studying the problem of goodness-of-fit of some data to a latent class model for binary data. The families of test statistics introduced are based on…

Methodology · Statistics 2014-07-09 Ángel Felipe , Nirian Martín , Pedro Miranda , Leandro Pardo

We theoretically analyze the problem of testing for $p$-hacking based on distributions of $p$-values across multiple studies. We provide general results for when such distributions have testable restrictions (are non-increasing) under the…

Econometrics · Economics 2022-05-13 Graham Elliott , Nikolay Kudrin , Kaspar Wuthrich

Unsupervised clustering of feature matrix data is an indispensible technique for exploratory data analysis and quality control of experimental data. However, clusters are difficult to assess for statistical significance in an objective way.…

Statistics Theory · Mathematics 2021-10-01 James Mathews , Cameron Crowe , Rami Vanguri , Margaret Callahan , Travis Hollmann , Saad Nadeem

This paper develops novel conformal methods to test whether a new observation was sampled from the same distribution as a reference set. Blending inductive and transductive conformal inference in an innovative way, the described methods can…

Methodology · Statistics 2022-08-26 Ziyi Liang , Matteo Sesia , Wenguang Sun

This paper resolves two open problems from a recent paper, arXiv:2403.16981, concerning the sample complexity of distributed simple binary hypothesis testing under information constraints. The first open problem asks whether interaction…

Information Theory · Computer Science 2025-06-18 Hadi Kazemi , Ankit Pensia , Varun Jog

The sample complexity of simple binary hypothesis testing is the smallest number of i.i.d.\ samples required to distinguish between two distributions $p$ and $q$ in either: (i) the prior-free setting, with type-I error at most $\alpha$ and…

Statistics Theory · Mathematics 2025-05-27 Ankit Pensia , Varun Jog , Po-Ling Loh

We extend the framework of augmented distribution testing (Aliakbarpour, Indyk, Rubinfeld, and Silwal, NeurIPS 2024) to the differentially private setting. This captures scenarios where a data analyst must perform hypothesis testing tasks…

Machine Learning · Computer Science 2025-03-20 Maryam Aliakbarpour , Arnav Burudgunte , Clément Cannone , Ronitt Rubinfeld