English
Related papers

Related papers: Decoding from Pooled Data: Sharp Information-Theor…

200 papers

We consider biological individuality in terms of information theoretic and graphical principles. Our purpose is to extract through an algorithmic decomposition system-environment boundaries supporting individuality. We infer or detect…

Populations and Evolution · Quantitative Biology 2014-12-09 David Krakauer , Nils Bertschinger , Eckehard Olbrich , Nihat Ay , Jessica C. Flack

We determine the exact freezing threshold, r^f, for a family of models of random boolean constraint satisfaction problems, including NAE-SAT and hypergraph 2-colouring, when the constraint size is sufficiently large. If the…

Discrete Mathematics · Computer Science 2012-09-24 Michael Molloy , Ricardo Restrepo

We present a Bayesian sequential decision-making formulation of the information filtering problem, in which an algorithm presents items (news articles, scientific papers, tweets) arriving in a stream, and learns relevance from user feedback…

Machine Learning · Computer Science 2016-10-25 Bangrui Chen , Peter I. Frazier

We revisit the distributed hypothesis testing (or hypothesis testing with communication constraints) problem from the viewpoint of privacy. Instead of observing the raw data directly, the transmitter observes a sanitized or randomized…

Information Theory · Computer Science 2019-06-26 Atefeh Gilani , Selma Belhadj Amor , Sadaf Salehkalaibar , Vincent Y. F. Tan

Panels with large time $(T)$ and cross-sectional $(N)$ dimensions are a key data structure in social sciences and other fields. A central question in panel data analysis is whether to pool data across individuals or to estimate separate…

Methodology · Statistics 2025-12-18 Tim Kutta , Martin Schumann , Holger Dette

In the pooled data problem the goal is to efficiently reconstruct a binary signal from additive measurements. Given a signal $\sigma \in \{ 0,1 \}^n$, we can query multiple entries at once and get the total number of non-zero entries in the…

Discrete Mathematics · Computer Science 2022-04-14 Oliver Gebhard , Max Hahn-Klimroth , Dominik Kaaser , Philipp Loick

In this paper, we consider lower bounds on the query complexity for testing CSPs in the bounded-degree model. First, for any ``symmetric'' predicate $P:{0,1}^{k} \to {0,1}$ except \equ where $k\geq 3$, we show that every (randomized)…

Data Structures and Algorithms · Computer Science 2010-07-21 Yuichi Yoshida

Dense subgraph discovery methods are routinely used in a variety of applications including the identification of a team of skilled individuals for collaboration from a social network. However, when the network's node set is associated with…

Social and Information Networks · Computer Science 2023-06-06 Atsushi Miyauchi , Tianyi Chen , Konstantinos Sotiropoulos , Charalampos E. Tsourakakis

In the context of statistical learning, the Information Bottleneck method seeks a right balance between accuracy and generalization capability through a suitable tradeoff between compression complexity, measured by minimum description…

Information Theory · Computer Science 2021-02-16 Mohammad Mahdi Mahvari , Mari Kobayashi , Abdellatif Zaidi

Social and information networks may become polarized, leading to echo chambers and political gridlock. Accurately measuring this phenomenon is a critical challenge. Existing measures often conflate genuine structural division with random…

Social and Information Networks · Computer Science 2025-12-04 Giulia Preti , Matteo Riondato , Aristides Gionis , Gianmarco De Francisci Morales

Statisticians increasingly face the problem to reconsider the adaptability of classical inference techniques. In particular, divers types of high-dimensional data structures are observed in various research areas; disclosing the boundaries…

Statistics Theory · Mathematics 2017-06-09 Paavo Sattler , Markus Pauly

We present a family of algorithms to solve random planted instances of any $k$-ary Boolean constraint satisfaction problem (CSP). A randomly planted instance of a Boolean CSP is generated by (1) choosing an arbitrary planted assignment…

Data Structures and Algorithms · Computer Science 2025-07-16 Arpon Basu , Jun-Ting Hsieh , Andrew D. Lin , Peter Manohar

An informative sampling design leads to the selection of units whose inclusion probabilities are correlated with the response variable of interest. Model inference performed on the resulting observed sample will be biased for the population…

Methodology · Statistics 2018-06-29 Matthew R. Williams , Terrance D. Savitsky

We initiate the study of differentially private (DP) estimation with access to a small amount of public data. For private estimation of d-dimensional Gaussians, we assume that the public data comes from a Gaussian that may have vanishing…

Machine Learning · Computer Science 2023-04-07 Alex Bie , Gautam Kamath , Vikrant Singhal

Correlated proportions arise in longitudinal (panel) studies. A typical example is the ``opinion swing'' problem: ``Has the proportion of people favoring a politician changed after his recent speech to the nation on TV?''. Since the same…

Statistics Theory · Mathematics 2007-07-27 Guido Consonni , Luca La Rocca

The Information Bottleneck (IB) is a conceptual method for extracting the most compact, yet informative, representation of a set of variables, with respect to the target. It generalizes the notion of minimal sufficient statistics from…

Machine Learning · Computer Science 2017-11-08 Amichai Painsky , Naftali Tishby

We study the task of selecting $k$ nodes, in a social network of size $n$, to seed a diffusion with maximum expected spread size, under the independent cascade model with cascade probability $p$. Most of the previous work on this problem…

Social and Information Networks · Computer Science 2022-05-24 Dean Eckles , Hossein Esfandiari , Elchanan Mossel , M. Amin Rahimian

In this paper we revisit the classical method of partitioning classification and study its convergence rate under relaxed conditions, both for observable (non-privatised) and for privatised data. We consider the problem of classification in…

Machine Learning · Statistics 2025-09-09 Balázs Csanád Csáji , László Györfi , Ambrus Tamás , Harro Walk

This paper provides an elementary, self-contained analysis of diffusion-based sampling methods for generative modeling. In contrast to existing approaches that rely on continuous-time processes and then discretize, our treatment works…

Machine Learning · Statistics 2025-06-25 Galen Reeves , Henry D. Pfister

Consider a population of $N$ individuals, each having $d\geq 1$ different traits, and an additive measure, called dispersion, which rewards large pairwise separations between traits. The goal is to select $M\leq N$ individuals such that…

Statistical Mechanics · Physics 2026-05-01 Fabio Deelan Cunden , Noemi Cuppone , Giovanni Gramegna , Pierpaolo Vivo