English
Related papers

Related papers: Property Testing on Product Distributions: Optimal…

200 papers

We investigate the problem of testing whether a discrete probability distribution over an ordered domain is a histogram on a specified number of bins. One of the most common tools for the succinct approximation of data, $k$-histograms over…

Data Structures and Algorithms · Computer Science 2022-07-15 Clément L. Canonne , Ilias Diakonikolas , Daniel M. Kane , Sihan Liu

We initiate a systematic investigation of distribution testing in the framework of algorithmic replicability. Specifically, given independent samples from a collection of probability distributions, the goal is to characterize the sample…

Machine Learning · Computer Science 2025-07-04 Ilias Diakonikolas , Jingyi Gao , Daniel Kane , Sihan Liu , Christopher Ye

Mining frequent patterns is plagued by the problem of pattern explosion making pattern reduction techniques a key challenge in pattern mining. In this paper we propose a novel theoretical framework for pattern reduction. We do this by…

Databases · Computer Science 2019-04-25 Nikolaj Tatti , Fabian Moerchen , Toon Calders

We study the general problem of testing whether an unknown distribution belongs to a specified family of distributions. More specifically, given a distribution family $\mathcal{P}$ and sample access to an unknown discrete distribution…

Data Structures and Algorithms · Computer Science 2017-08-09 Clément L. Canonne , Ilias Diakonikolas , Alistair Stewart

We study quantum algorithms for verifying properties of the output probability distribution of a classical or quantum circuit, given access to the source code that generates the distribution. We consider the basic task of uniformity…

Quantum Physics · Physics 2024-11-08 Clément L. Canonne , Robin Kothari , Ryan O'Donnell

Collections of probability distributions arise in a variety of applications ranging from user activity pattern analysis to brain connectomics. In practice these distributions can be defined over diverse domain types including finite…

Methodology · Statistics 2023-06-16 Raif Rustamov , Subhabrata Majumdar

We present a general method for obtaining strong bounds for discrete optimization problems that is based on a concept of branching duality. It can be applied when no useful integer programming model is available, and we illustrate this with…

Data Structures and Algorithms · Computer Science 2019-08-22 J. G. Benade , J. N. Hooker

Optimal transport distances are powerful tools to compare probability distributions and have found many applications in machine learning. Yet their algorithmic complexity prevents their direct use on large scale datasets. To overcome this…

Machine Learning · Statistics 2021-10-14 Kilian Fatras , Younes Zine , Rémi Flamary , Rémi Gribonval , Nicolas Courty

In many problems in data mining and machine learning, data items that need to be clustered or classified are not points in a high-dimensional space, but are distributions (points on a high dimensional simplex). For distributions, natural…

Data Structures and Algorithms · Computer Science 2007-07-13 Sudipto Guha , Andrew McGregor , Suresh Venkatasubramanian

The distributed hypothesis testing problem with full side-information is studied. The trade-off (reliability function) between the two types of error exponents under limited rate is studied in the following way. First, the problem is…

Information Theory · Computer Science 2019-04-24 Nir Weinberger , Yuval Kochman

We study distributed goodness-of-fit testing for discrete distribution under bandwidth and differential privacy constraints. Information constraint distributed goodness-of-fit testing is a problem that has received considerable attention…

Statistics Theory · Mathematics 2024-11-05 Lasse Vuursteen

The classic exact pattern matching problem, given two strings -- a pattern $P$ of length $m$ and a text $T$ of length $n$ -- asks whether $P$ occurs as a substring of $T$. A property tester for the problem needs to distinguish (with high…

Data Structures and Algorithms · Computer Science 2025-10-21 Ce Jin , Tomasz Kociumaka

This paper addresses the general problem of domain adaptation which arises in a variety of applications where the distribution of the labeled sample available somewhat differs from that of the test data. Building on previous work by…

Machine Learning · Computer Science 2023-12-04 Yishay Mansour , Mehryar Mohri , Afshin Rostamizadeh

In the property testing model, the task is to distinguish objects possessing some property from the objects that are far from it. One of such properties is monotonicity, when the objects are functions from one poset to another. This is an…

Computational Complexity · Computer Science 2018-05-11 Aleksandrs Belovs

Dimension reduction algorithms are a crucial part of many data science pipelines, including data exploration, feature creation and selection, and denoising. Despite their wide utilization, many non-linear dimension reduction algorithms are…

Machine Learning · Statistics 2024-08-06 Ryan Murray , Adam Pickarski

Uniformity testing is one of the most well-studied problems in property testing, with many known test statistics, including ones based on counting collisions, singletons, and the empirical TV distance. It is known that the optimal sample…

Machine Learning · Statistics 2022-06-23 Shivam Gupta , Eric Price

We consider the fundamental learning problem of estimating properties of distributions over large domains. Using a novel piecewise-polynomial approximation technique, we derive the first unified methodology for constructing sample- and…

Machine Learning · Computer Science 2020-03-18 Yi Hao , Alon Orlitsky

In Bayesian statistics, a continuity property of the posterior distribution with respect to the observable variable is crucial as it expresses well-posedness, i.e., stability with respect to errors in the measurement of data. Essentially,…

Probability · Mathematics 2023-05-17 Emanuele Dolera , Edoardo Mainini

One of the most fundamental questions in graph property testing is to characterize the combinatorial structure of properties that are testable with a constant number of queries. We work towards an answer to this question for the…

Data Structures and Algorithms · Computer Science 2018-11-08 Hendrik Fichtenberger , Pan Peng , Christian Sohler

We give a distributed algorithm in the {\sf CONGEST} model for property testing of planarity with one-sided error in general (unbounded-degree) graphs. Following Censor-Hillel et al. (DISC 2016), who recently initiated the study of property…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-15 Reut Levi , Moti Medina , Dana Ron