English
Related papers

Related papers: Improving and extending the testing of distributio…

200 papers

High-dimensional feature selection is a central problem in a variety of application domains such as machine learning, image analysis, and genomics. In this paper, we propose graph-based tests as a useful basis for feature selection. We…

Methodology · Statistics 2024-08-13 Swarnadip Ghosh , Somabha Mukherjee , Divyansh Agarwal , Yichen He , Mingzhi Song , Xuejiao Pei

Property Testing is a formal framework to study the computational power and complexity of sampling from combinatorial objects. A central goal in standard graph property testing is to understand which graph properties are testable with…

Data Structures and Algorithms · Computer Science 2025-09-08 Artur Czumaj , Christian Sohler , Stefan Walzer

We study the basic statistical problem of testing whether normally distributed $n$-dimensional data has been truncated, i.e. altered by only retaining points that lie in some unknown truncation set $S \subseteq \mathbb{R}^n$. As our main…

Data Structures and Algorithms · Computer Science 2024-11-25 Anindya De , Shivam Nadimpalli , Rocco A. Servedio

We provide improved differentially private algorithms for identity testing of high-dimensional distributions. Specifically, for $d$-dimensional Gaussian distributions with known covariance $\Sigma$, we can test whether the distribution…

Data Structures and Algorithms · Computer Science 2022-07-26 Shyam Narayanan

In this paper, we address the problem of testing goodness-of-fit for discrete distributions, where we focus on the geometric distribution. We define new likelihood-based goodness-of-fit tests using the beta-geometric distribution and the…

Statistics Theory · Mathematics 2020-10-09 Rasmus Erlemann , Bo Henry Lindqvist

A $k$-modal probability distribution over the discrete domain $\{1,...,n\}$ is one whose histogram has at most $k$ "peaks" and "valleys." Such distributions are natural generalizations of monotone ($k=0$) and unimodal ($k=1$) probability…

Data Structures and Algorithms · Computer Science 2014-09-16 Constantinos Daskalakis , Ilias Diakonikolas , Rocco A. Servedio

Estimating properties of discrete distributions is a fundamental problem in statistical learning. We design the first unified, linear-time, competitive, property estimator that for a wide class of properties and for all underlying…

Machine Learning · Statistics 2019-04-02 Yi Hao , Alon Orlitsky , Ananda T. Suresh , Yihong Wu

In many statistical applications, the dimension is too large to handle for standard high-dimensional machine learning procedures. This is particularly true for graphical models, where the interpretation of a large graph is difficult and…

Statistics Theory · Mathematics 2024-05-20 Luc Devroye , Gábor Lugosi , Piotr Zwiernik

In this letter, we consider multiple statistical classification problem where a sequence of n independent and identically distributed observations, that are generated by one of M discrete sources, need to be classified. The source…

Information Theory · Computer Science 2021-08-31 Hüseyin Afşer

Motivated by the fact that input distributions are often unknown in advance, distribution-free property testing considers a setting where the algorithmic task is to accept functions $f : [n] \to \{0,1\}$ with a certain property P and reject…

Computational Complexity · Computer Science 2024-02-19 Hugo Aaronson , Tom Gur , Ninad Rajgopal , Ron D. Rothblum

Let $\mathfrak{C}$ be a class of probability distributions over the discrete domain $[n] = \{1,...,n\}.$ We show that if $\mathfrak{C}$ satisfies a rather general condition -- essentially, that each distribution in $\mathfrak{C}$ can be…

Machine Learning · Computer Science 2012-10-03 Siu-on Chan , Ilias Diakonikolas , Rocco A. Servedio , Xiaorui Sun

In this paper we define and examine the power of the {\em conditional-sampling} oracle in the context of distribution-property testing. The conditional-sampling oracle for a discrete distribution $\mu$ takes as input a subset $S \subset…

Data Structures and Algorithms · Computer Science 2014-04-09 Sourav Chakraborty , Eldar Fischer , Yonatan Goldhirsh , Arie Matsliah

The study of distribution testing has become ubiquitous in the area of property testing, both for its theoretical appeal, as well as for its applications in other fields of Computer Science. The original distribution testing model relies on…

Data Structures and Algorithms · Computer Science 2022-11-17 Sourav Chakraborty , Eldar Fischer , Arijit Ghosh , Gopinath Mishra , Sayantan Sen

We consider a network of sensors deployed to sense a spatio-temporal field and estimate a parameter of interest. We are interested in the case where the temporal process sensed by each sensor can be modeled as a state-space process that is…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-04-12 S. Sundhar Ram , V. V. Veeravalli , A. Nedic

The primary problem in property testing is to decide whether a given function satisfies a certain property, or is far from any function satisfying it. This crucially requires a notion of distance between functions. The most prevalent notion…

Discrete Mathematics · Computer Science 2014-04-04 Deeparnab Chakrabarty , Kashyap Dixit , Madhav Jha , C. Seshadhri

Existing uncertainty modeling approaches try to detect an out-of-distribution point from the in-distribution dataset. We extend this argument to detect finer-grained uncertainty that distinguishes between (a). certain points, (b). uncertain…

Machine Learning · Computer Science 2020-02-12 Rahul Soni , Naresh Shah , Jimmy D. Moore

We present convincing empirical evidence for an effective and general strategy for building accurate small models. Such models are attractive for interpretability and also find use in resource-constrained environments. The strategy is to…

Machine Learning · Computer Science 2024-04-30 Abhishek Ghose

Understanding the shape of a distribution of data is of interest to people in a great variety of fields, as it may affect the types of algorithms used for that data. We study one such problem in the framework of distribution property…

Machine Learning · Computer Science 2022-12-06 Maryam Aliakbarpour , Amartya Shankha Biswas , Kavya Ravichandran , Ronitt Rubinfeld

Distributed aggregation allows the derivation of a given global aggregate property from many individual local values in nodes of an interconnected network system. Simple aggregates such as minima/maxima, counts, sums and averages have been…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-04-09 Miguel Borges , Paulo Jesus , Carlos Baquero , Paulo Sérgio Almeida

The $k$-of-$n$ testing problem involves performing $n$ independent tests sequentially, in order to determine whether/not at least $k$ tests pass. The objective is to minimize the expected cost of testing. This is a fundamental and…

Data Structures and Algorithms · Computer Science 2026-03-26 Rayen Tan , Viswanath Nagarajan