English
Related papers

Related papers: Optimal Closeness Testing of Discrete Distribution…

200 papers

The estimation of probability densities based on available data is a central task in many statistical applications. Especially in the case of large ensembles with many samples or high-dimensional sample spaces, computationally efficient…

Methodology · Statistics 2017-05-04 Daniel W. Meyer

We present a new framework to address the non-convex robust hypothesis testing problem, wherein the goal is to seek the optimal detector that minimizes the maximum of worst-case type-I and type-II risk functions. The distributional…

Machine Learning · Statistics 2024-03-25 Jie Wang , Rui Gao , Yao Xie

Sequential likelihood ratio testing is found to be most powerful in sequential studies with early stopping rules when grouped data come from the one-parameter exponential family. First, to obtain this elusive result, the probability measure…

Methodology · Statistics 2021-01-28 Sergey Tarima , Nancy Flournoy

We introduce $\pi$-test, a privacy-preserving algorithm for testing statistical independence between data distributed across multiple parties. Our algorithm relies on privately estimating the distance correlation between datasets, a…

Statistics Theory · Mathematics 2023-09-28 Praneeth Vepakomma , Mohammad Mohammadi Amiri , Clément L. Canonne , Ramesh Raskar , Alex Pentland

A finite form of de Finetti's representation theorem is established using elementary information-theoretic tools: The distribution of the first $k$ random variables in an exchangeable binary vector of length $n\geq k$ is close to a mixture…

Information Theory · Computer Science 2021-06-28 Lampros Gavalakis , Ioannis Kontoyiannis

As statistical analyses become more central to science, industry and society, there is a growing need to ensure correctness of their results. Approximate correctness can be verified by replicating the entire analysis, but can we verify…

Computational Complexity · Computer Science 2024-09-11 Tal Herman , Guy Rothblum

Position probability distribution of a set of massive mutually exclusive particles in one dimension has been defined. Examples with a given two mutually exclusive particles system are considered. It is emphasized that quantum particles at…

Quantum Physics · Physics 2016-10-28 Rasool Kheiry , Shahram Salehi

The purpose of this paper is twofold. First, we provide a novel characterization of independence of random vectors based on the checkerboard approximation to a multivariate copula. Using this result, we then propose a new family of tests of…

Statistics Theory · Mathematics 2019-06-07 José M. González-Barrios , Eduardo Gutiérrez-Peña , Juan D. Nieves , Raúl Rueda

This paper reviews recent advancements in the application of optimal transport (OT) to multivariate distribution-free nonparametric testing. Inspired by classical rank-based methods, such as Wilcoxon's rank-sum and signed-rank tests, we…

Methodology · Statistics 2025-03-18 Zhen Huang , Bodhisattva Sen

Given a small random sample of $n$-bit strings labeled by an unknown Boolean function, which properties of this function can be tested computationally efficiently? We show an equivalence between properties that are efficiently testable from…

Computational Complexity · Computer Science 2026-04-07 Cynthia Dwork , Pranay Tankala

The paper presents a new statistical method that enables the use of systematic errors in the maximum-likelihood regression of integer-count Poisson data to a parametric model. The method is primarily aimed at the characterization of the…

Instrumentation and Methods for Astrophysics · Physics 2024-07-18 Max Bonamente , Yang Chen , Dale Zimmerman

We revisit the fundamental question of simple-versus-simple hypothesis testing with an eye towards computational complexity, as the statistically optimal likelihood ratio test is often computationally intractable in high-dimensional…

Statistics Theory · Mathematics 2025-05-05 Ankur Moitra , Alexander S. Wein

Stability is a central property in learning and statistics promising the output of an algorithm $A$ does not change substantially when applied to similar datasets $S$ and $S'$. It is an elementary fact that any sufficiently stable algorithm…

Machine Learning · Computer Science 2025-02-13 Max Hopkins , Shay Moran

In the Bayes paradigm and for a given loss function, we propose the construction of a new type of posterior distributions, that extends the classical Bayes one, for estimating the law of an $n$-sample. The loss functions we have in mind are…

Statistics Theory · Mathematics 2024-01-05 Yannick Baraud

We revisit the problem of tolerant distribution testing. That is, given samples from an unknown distribution $p$ over $\{1, \dots, n\}$, is it $\varepsilon_1$-close to or $\varepsilon_2$-far from a reference distribution $q$ (in total…

Data Structures and Algorithms · Computer Science 2021-11-10 Clément L. Canonne , Ayush Jain , Gautam Kamath , Jerry Li

We propose a new powerful family of tests of univariate normality. These tests are based on an initial value problem in the space of characteristic functions originating from the fixed point property of the normal distribution in the zero…

Statistics Theory · Mathematics 2020-02-28 Bruno Ebner

Entropy and its various generalizations are important in many fields, including mathematical statistics, communication theory, physics and computer science, for characterizing the amount of information associated with a probability…

Statistics Theory · Mathematics 2021-06-02 Mehmet Siddik Cadirci , Dafydd Evans , Nikolai Leonenko , Oleg Seleznjev

In this work, we revisit outlier hypothesis testing and propose exponentially consistent, low-complexity fixed-length tests that achieve a better tradeoff between detection performance and computational complexity than existing…

Signal Processing · Electrical Eng. & Systems 2026-01-28 Lina Zhu , Lin Zhou

Let $\pi_n$ be a uniformly chosen random permutation on $[n]$. Using an analysis of the probability that two overlapping consecutive $k$-permutations are order isomorphic, the authors of a recent paper showed that the expected number of…

Combinatorics · Mathematics 2024-08-07 Anant Godbole , Hannah Swickheimer

Mutual information is widely used, in a descriptive way, to measure the stochastic dependence of categorical random variables. In order to address questions such as the reliability of the descriptive value, one must consider…

Machine Learning · Computer Science 2007-07-13 Marcus Hutter , Marco Zaffalon