English
Related papers

Related papers: Estimation Efficiency Under Privacy Constraints

200 papers

A lossy source coding problem with privacy constraint is studied in which two correlated discrete sources $X$ and $Y$ are compressed into a reconstruction $\hat{X}$ with some prescribed distortion $D$. In addition, a privacy constraint is…

Information Theory · Computer Science 2015-04-23 Farshid Mokhtarinezhad , Joerg Kliewer , Osvaldo Simeone

We establish a simple connection between robust and differentially-private algorithms: private mechanisms which perform well with very high probability are automatically robust in the sense that they retain accuracy even if a constant…

Machine Learning · Statistics 2022-12-02 Kristian Georgiev , Samuel B. Hopkins

We study the statistical complexity of private linear regression under an unknown, potentially ill-conditioned covariate distribution. Somewhat surprisingly, under privacy constraints the intrinsic complexity is \emph{not} captured by the…

Machine Learning · Computer Science 2025-11-06 Fan Chen , Jiachun Li , Alexander Rakhlin , David Simchi-Levi

The privacy-utility tradeoff problem is formulated as determining the privacy mechanism (random mapping) that minimizes the mutual information (a metric for privacy leakage) between the private features of the original dataset and a…

Information Theory · Computer Science 2026-05-12 Kousha Kalantari , Oliver Kosut , Lalitha Sankar

We provide a differentially private algorithm for hypothesis selection. Given samples from an unknown probability distribution $P$ and a set of $m$ probability distributions $\mathcal{H}$, the goal is to output, in a…

Data Structures and Algorithms · Computer Science 2021-01-05 Mark Bun , Gautam Kamath , Thomas Steinke , Zhiwei Steven Wu

The problem of publishing privacy-guaranteed data for hypothesis testing is studied using the maximal leakage (ML) as a metric for privacy and the type-II error exponent as the utility metric. The optimal mechanism (random mapping) that…

Information Theory · Computer Science 2017-04-12 Jiachun Liao , Lalitha Sankar , Flavio P. Calmon , Vincent Y. F. Tan

We study statistical estimation under local differential privacy (LDP) when users may hold heterogeneous privacy levels and accuracy must be guaranteed with high probability. Departing from the common in-expectation analyses, and for…

Machine Learning · Statistics 2025-10-15 Maryam Aliakbarpour , Alireza Fallah , Swaha Roy , Ria Stevens

We consider the minimax estimation problem of a discrete distribution with support size $k$ under locally differential privacy constraints. A privatization scheme is applied to each raw sample independently, and we need to estimate the…

Statistics Theory · Mathematics 2018-10-18 Min Ye , Alexander Barg

The challenge of producing accurate statistics while respecting the privacy of the individuals in a sample is an important area of research. We study minimax lower bounds for classes of differentially private estimators. In particular, we…

Machine Learning · Computer Science 2024-09-19 Clément Lalanne , Aurélien Garivier , Rémi Gribonval

We study privacy-preserving sparse linear regression in the high-dimensional regime, focusing on the LASSO estimator. We analyze two widely used mechanisms for differential privacy: output perturbation, which injects noise into the…

Machine Learning · Statistics 2026-04-06 Ayaka Sakata , Haruka Tanzawa

Working under a model of privacy in which data remains private even from the statistician, we study the tradeoff between privacy guarantees and the risk of the resulting statistical estimators. We develop private versions of classical…

Statistics Theory · Mathematics 2017-11-16 John Duchi , Martin Wainwright , Michael Jordan

We consider the privacy amplification properties of a sampling scheme in which a user's data is used in $k$ steps chosen randomly and uniformly from a sequence (or set) of $t$ steps. This sampling scheme has been recently applied in the…

Machine Learning · Computer Science 2026-02-20 Vitaly Feldman , Moshe Shenfeld

This paper investigates the privacy funnel, a privacy-utility tradeoff problem in which mutual information quantifies both privacy and utility. The objective is to maximize utility while adhering to a specified privacy budget. However, the…

Information Theory · Computer Science 2024-08-20 Mohammad Amin Zarrabian , Parastoo Sadeghi

Protecting individual privacy is crucial when releasing sensitive data for public use. While data de-identification helps, it is not enough. This paper addresses parameter estimation in scenarios where data are perturbed using the…

Methodology · Statistics 2024-03-13 Qinglong Tian , Jiwei Zhao

We study the problem of differentially private optimization with linear constraints when the right-hand-side of the constraints depends on private data. This type of problem appears in many applications, especially resource allocation.…

Machine Learning · Computer Science 2020-11-05 Andrés Muñoz Medina , Umar Syed , Sergei Vassilvitskii , Ellen Vitercik

Differential Privacy (DP) is the current gold-standard for ensuring privacy for statistical queries. Estimation problems under DP constraints appearing in the literature have largely focused on providing equal privacy to all users. We…

Machine Learning · Computer Science 2025-04-22 Syomantak Chaudhuri , Thomas A. Courtade

We suggest the use of hash functions to cut down the communication costs when counting subgraphs under edge local differential privacy. While various algorithms exist for computing graph statistics, including the count of subgraphs, under…

Cryptography and Security · Computer Science 2025-08-15 Quentin Hillebrand , Vorapong Suppakitpaisarn , Tetsuo Shibuya

We develop a sharp, experiment-level privacy theory for amplification by shuffling in the Gaussian regime: a fixed finite-output local randomizer with full support and neighboring binary datasets differing in one user. We first prove exact…

Information Theory · Computer Science 2026-03-24 Alex Shvets

In this paper, we consider the problem of estimating a potentially sensitive (individually stigmatizing) statistic on a population. In our model, individuals are concerned about their privacy, and experience some cost as a function of their…

Computer Science and Game Theory · Computer Science 2012-02-28 Katrina Ligett , Aaron Roth

Data publishing under privacy constraints can be achieved with mechanisms that add randomness to data points when released to an untrusted party, thereby decreasing the data's utility. In this paper, we analyze this privacy-utility tradeoff…

Information Theory · Computer Science 2024-08-28 Leonhard Grosse , Sara Saeidian , Tobias Oechtering