English
Related papers

Related papers: Interactive Inference under Information Constraint…

200 papers

We consider the problem of hypothesis testing for discrete distributions. In the standard model, where we have sample access to an underlying distribution $p$, extensive research has established optimal bounds for uniformity testing,…

Machine Learning · Computer Science 2024-12-03 Maryam Aliakbarpour , Piotr Indyk , Ronitt Rubinfeld , Sandeep Silwal

We study robust testing and estimation of discrete distributions in the strong contamination model. We consider both the "centralized setting" and the "distributed setting with information constraints" including communication and local…

Information Theory · Computer Science 2021-04-23 Jayadev Acharya , Ziteng Sun , Huanyu Zhang

Finding anonymization mechanisms to protect personal data is at the heart of recent machine learning research. Here, we consider the consequences of local differential privacy constraints on goodness-of-fit testing, i.e. the statistical…

Statistics Theory · Mathematics 2021-04-16 Joseph Lam-Weil , Béatrice Laurent , Jean-Michel Loubes

The distributed inference framework comprises of a group of spatially distributed nodes which acquire observations about a phenomenon of interest. Due to bandwidth and energy constraints, the nodes often quantize their observations into a…

Cryptography and Security · Computer Science 2015-02-20 Bhavya Kailkhura , V. Sriram Siddhardh Nadendla , Pramod K. Varshney

We propose a general statistical inference framework to capture the privacy threat incurred by a user that releases data to a passive but curious adversary, given utility constraints. We show that applying this general framework to the…

Information Theory · Computer Science 2012-10-09 Flavio du Pin Calmon , Nadia Fawaz

The objective of goodness-of-fit testing is to assess whether a dataset of observations is likely to have been drawn from a candidate probability distribution. This paper presents a rank-based family of goodness-of-fit tests that is…

Statistics Theory · Mathematics 2019-04-18 Feras A. Saad , Cameron E. Freer , Nathanael L. Ackerman , Vikash K. Mansinghka

We consider the problem of communication-constrained collaborative personalized mean estimation under a privacy constraint in an environment of several agents continuously receiving data according to arbitrary unknown agent-specific…

Social and Information Networks · Computer Science 2025-11-10 Yauhen Yakimenka , Hsuan-Yin Lin , Eirik Rosnes , Jörg Kliewer

Data attribution methods aim to answer useful counterfactual questions like "what would a ML model's prediction be if it were trained on a different dataset?" However, estimation of data attribution models through techniques like empirical…

Machine Learning · Computer Science 2025-08-19 Ari Karchmer , Martin Pawelczyk , Seth Neel

A collaborative distributed binary decision problem is considered. Two statisticians are required to declare the correct probability measure of two jointly distributed memoryless process, denoted by $X^n=(X_1,\dots,X_n)$ and…

Information Theory · Computer Science 2016-04-11 Gil Katz , Pablo Piantanida , Merouane Debbah

We study simple binary hypothesis testing under both local differential privacy (LDP) and communication constraints. We qualify our results as either minimax optimal or instance optimal: the former hold for the set of distribution pairs…

Statistics Theory · Mathematics 2023-12-19 Ankit Pensia , Amir R. Asadi , Varun Jog , Po-Ling Loh

In the era of big data, it is necessary to split extremely large data sets across multiple computing nodes and construct estimators using the distributed data. When designing distributed estimators, it is desirable to minimize the amount of…

Statistics Theory · Mathematics 2022-04-25 Azeem Zaman , Botond Szabó

We address the problem of distributed cooperative localization in wireless networks, i.e. nodes without prior position knowledge (agents) wish to determine their own positions. In non-cooperative approaches, positioning is only based on…

Signal Processing · Electrical Eng. & Systems 2018-02-09 Rico Mendrzik , Gerhard Bauch

In a decentralized Internet of Things (IoT) network, a fusion center receives information from multiple sensors to infer a public hypothesis of interest. To prevent the fusion center from abusing the sensor information, each sensor…

Information Theory · Computer Science 2019-04-09 Meng Sun , Wee Peng Tay

Federated learning has attracted significant recent attention due to its applicability across a wide range of settings where data is collected and analyzed across disparate locations. In this paper, we study federated nonparametric…

Statistics Theory · Mathematics 2024-06-12 T. Tony Cai , Abhinav Chakraborty , Lasse Vuursteen

Independent samples from an unknown probability distribution $\bf p$ on a domain of size $k$ are distributed across $n$ players, with each player holding one sample. Each player can communicate $\ell$ bits to a central referee in a…

Data Structures and Algorithms · Computer Science 2019-05-24 Jayadev Acharya , Clément L. Canonne , Himanshu Tyagi

In this article we present very intuitive, easy to follow, yet mathematically rigorous, approach to the so called data fitting process. Rather than minimizing the distance between measured and simulated data points, we prefer to find such…

Data Analysis, Statistics and Probability · Physics 2017-08-07 Marek W. Gutowski

Differentially private federated learning is crucial for maintaining privacy in distributed environments. This paper investigates the challenges of high-dimensional estimation and inference under the constraints of differential privacy.…

Machine Learning · Statistics 2024-04-26 Zhe Zhang , Ryumei Nakada , Linjun Zhang

Local differential privacy has recently received increasing attention from the statistics community as a valuable tool to protect the privacy of individual data owners without the need of a trusted third party. Similar to the classical…

Statistics Theory · Mathematics 2022-07-04 Cristina Butucea , Angelika Rohde , Lukas Steinberger

We characterize the communication complexity of the following distributed estimation problem. Alice and Bob observe infinitely many iid copies of $\rho$-correlated unit-variance (Gaussian or $\pm1$ binary) random variables, with unknown…

Information Theory · Computer Science 2019-04-19 Uri Hadar , Jingbo Liu , Yury Polyanskiy , Ofer Shayevitz

The problem of statistical learning is to construct an accurate predictor of a random variable as a function of a correlated random variable on the basis of an i.i.d. training sample from their joint distribution. Allowable predictors are…

Information Theory · Computer Science 2009-04-30 Maxim Raginsky