English
Related papers

Related papers: Decoding from Pooled Data: Sharp Information-Theor…

200 papers

Two new information-theoretic methods are introduced for establishing Poisson approximation inequalities. First, using only elementary information-theoretic techniques it is shown that, when $S_n=\sum_{i=1}^nX_i$ is the sum of the (possibly…

Probability · Mathematics 2010-10-21 Ioannis Kontoyiannis , Peter Harremoes , Oliver Johnson

Some of the most used sampling mechanisms that implicitly leverage a social network depend on tuning parameters; for instance, Respondent-Driven Sampling (RDS) is specified by the number of seeds and maximum number of referrals. We are…

Methodology · Statistics 2019-12-06 Simón Lunagómez , Marios Papamichalis , Patrick J. Wolfe , Edoardo M. Airoldi

In recent years, crowdsourcing, aka human aided computation has emerged as an effective platform for solving problems that are considered complex for machines alone. Using human is time-consuming and costly due to monetary compensations.…

Data Structures and Algorithms · Computer Science 2016-04-08 Arya Mazumdar , Barna Saha

Let X_n=(x_{ij}) be an n by p data matrix, where the n rows form a random sample of size n from a certain p-dimensional population distribution. Let R_n=(\rho_{ij}) be the p\times p sample correlation matrix of X_n; that is, the entry…

Probability · Mathematics 2009-09-29 Tiefeng Jiang

Random instances of Constraint Satisfaction Problems (CSP's) appear to be hard for all known algorithms, when the number of constraints per variable lies in a certain interval. Contributing to the general understanding of the structure of…

Discrete Mathematics · Computer Science 2009-04-20 Andrea Montanari , Ricardo Restrepo , Prasad Tetali

We study the problem of counting the number of distinct elements in a dataset subject to the constraint of differential privacy. We consider the challenging setting of person-level DP (a.k.a. user-level DP) where each person may contribute…

Data Structures and Algorithms · Computer Science 2023-10-30 Alexander Knop , Thomas Steinke

The integration and transfer of information from multiple sources to multiple targets is a core motive of neural systems. The emerging field of partial information decomposition (PID) provides a novel information-theoretic lens into these…

Information Theory · Computer Science 2021-10-28 Ari Pakman , Amin Nejatbakhsh , Dar Gilboa , Abdullah Makkeh , Luca Mazzucato , Michael Wibral , Elad Schneidman

Perhaps the single most important use case for differential privacy is to privately answer numerical queries, which is usually achieved by adding noise to the answer vector. The central question, therefore, is to understand which noise…

Machine Learning · Statistics 2021-03-17 Jinshuo Dong , Weijie J. Su , Linjun Zhang

We study Bayesian inference of an unknown matching $\pi^*$ between two correlated random point sets $\{X_i\}_{i=1}^n$ and $\{Y_i\}_{i=1}^n$ in $[0,1]^d$, under a critical scaling $\|X_i-Y_{\pi^*(i)}\|_2 \asymp n^{-1/d}$, in both an exact…

Statistics Theory · Mathematics 2026-03-10 Zhou Fan , Timothy L. H. Wee , Kaylee Y. Yang

The traditional approach to the quantitative study of segregation is to employ indices that are selected by ``desirable properties''. Here, we detail how information theory underpins entropy-based indices and demonstrate how desirable…

Physics and Society · Physics 2022-12-15 Boris Barron , Yunus A. Kinkhabwala , Chriss Hess , Matthew Hall , Itai Cohen , Tomás A. Arias

The exploration of selected single nucleotide polymorphisms (SNPs) to identify genetic diversity between different sequencing population pools (Pool-seq) is a fundamental task in genetic research. As underlying sequence reads and their…

Genomics · Quantitative Biology 2021-01-05 Julia Siekiera , Stefan Kramer

A counting constraint satisfaction problem (#CSP) asks for the number of ways to satisfy a given list of constraints, drawn from a fixed constraint language \Gamma. We study how hard it is to evaluate this number approximately. There is an…

Computational Complexity · Computer Science 2012-04-26 Colin McQuillan

In genetic studies, haplotype data provide more refined information than data about separate genetic markers. However, large-scale studies that genotype hundreds to thousands of individuals may only provide results of pooled data, where…

Methodology · Statistics 2023-09-01 Yong See Foo , Jennifer A. Flegg

In filtering, each output is produced by a certain number of different inputs. We explore the statistics of this degeneracy in an explicitly treatable filtering problem in which filtering performs the maximal compression of relevant…

Disordered Systems and Neural Networks · Physics 2020-04-08 G. J. Baxter , R. A. da Costa , S. N. Dorogovtsev , J. F. F. Mendes

We consider the problem of detecting a small subset of defective items from a large set via non-adaptive "random pooling" group tests. We consider both the case when the measurements are noiseless, and the case when the measurements are…

Information Theory · Computer Science 2011-07-25 Chun Lam Chan , Pak Hou Che , Sidharth Jaggi , Venkatesh Saligrama

Given a set $P$ of $n$ uncertain points on the real line, each represented by its one-dimensional probability density function, we consider the problem of building data structures on $P$ to answer range queries of the following three types…

Computational Geometry · Computer Science 2015-01-13 Jian Li , Haitao Wang

We study the problem of estimating the mean of an identity covariance Gaussian in the truncated setting, in the regime when the truncation set comes from a low-complexity family $\mathcal{C}$ of sets. Specifically, for a fixed but unknown…

Data Structures and Algorithms · Computer Science 2024-03-05 Ilias Diakonikolas , Daniel M. Kane , Thanasis Pittas , Nikos Zarifis

Schaefer's theorem is a complexity classification result for so-called Boolean constraint satisfaction problems: it states that every Boolean constraint satisfaction problem is either contained in one out of six classes and can be solved in…

Computational Complexity · Computer Science 2015-05-19 Manuel Bodirsky , Michael Pinsker

In this paper we describe a triple correspondence between graph limits, information theory and group theory. We put forward a new graph limit concept called log-convergence that is closely connected to dense graph limits but its main…

Combinatorics · Mathematics 2015-04-06 Balazs Szegedy

Notwithstanding various attempts to construct a Partial Information Decomposition (PID) for multiple variables by defining synergistic, redundant, and unique information, there is no consensus on how one ought to precisely define either of…

Data Analysis, Statistics and Probability · Physics 2023-06-07 Steven J. van Enk