English
Related papers

Related papers: Instance-Optimality for Private KL Distribution Es…

200 papers

We initiate an investigation of node differential privacy for graphs in the local model of private data analysis. In our model, dubbed LNDP*, each node sees its own edge list and releases the output of a local randomizer on this input.…

Data Structures and Algorithms · Computer Science 2026-04-03 Sofya Raskhodnikova , Adam Smith , Connor Wagaman , Anatoly Zavyalov

There is growing interest in improving our algorithmic understanding of fundamental statistical problems such as mean estimation, driven by the goal of understanding the limits of what we can extract from valuable data. The state of the art…

Statistics Theory · Mathematics 2023-11-22 Trung Dang , Jasper C. H. Lee , Maoyuan Song , Paul Valiant

We consider the problem of model selection in a high-dimensional sparse linear regression model under privacy constraints. We propose a differentially private (DP) best subset selection method with strong statistical utility properties by…

Machine Learning · Statistics 2024-10-30 Saptarshi Roy , Zehua Wang , Ambuj Tewari

In this brief, we present an enhanced privacy-preserving distributed estimation algorithm, referred to as the ``Double-Private Algorithm," which combines the principles of both differential privacy (DP) and cryptography. The proposed…

Signal Processing · Electrical Eng. & Systems 2024-03-19 Mehdi Korki , Fatemehsadat Hosseiniamin , Hadi Zayyani , Mehdi Bekrani

Finding anonymization mechanisms to protect personal data is at the heart of recent machine learning research. Here, we consider the consequences of local differential privacy constraints on goodness-of-fit testing, i.e. the statistical…

Statistics Theory · Mathematics 2021-04-16 Joseph Lam-Weil , Béatrice Laurent , Jean-Michel Loubes

Given $n$ i.i.d. random matrices $A_i \in \mathbb{R}^{d \times d}$ that share a common expectation $\Sigma$, the objective of Differentially Private Stochastic PCA is to identify a subspace of dimension $k$ that captures the largest…

Machine Learning · Statistics 2025-08-15 Johanna Düngler , Amartya Sanyal

We study differentially private (DP) algorithms for stochastic convex optimization (SCO). In this problem the goal is to approximately minimize the population loss given i.i.d. samples from a distribution over convex and Lipschitz loss…

Machine Learning · Computer Science 2019-08-28 Raef Bassily , Vitaly Feldman , Kunal Talwar , Abhradeep Thakurta

Independence testing is a fundamental problem in statistical inference: given samples from a joint distribution $p$ over multiple random variables, the goal is to determine whether $p$ is a product distribution or is $\epsilon$-far from all…

Machine Learning · Statistics 2026-03-06 Maryam Aliakbarpour , Alireza Azizi , Ria Stevens

Molecular communication (MC) enables information exchange in nanoscale sensor networks operating in biological environments, yet privacy remains largely unaddressed. We integrate local differential privacy (LDP) into diffusion-based MC by…

Information Theory · Computer Science 2026-03-03 Melih Şahin , Ozgur B. Akan

Constructing a differentially private (DP) estimator requires deriving the maximum influence of an observation, which can be difficult in the absence of exogenous bounds on the input data or the estimator, especially in high dimensional…

Machine Learning · Statistics 2022-07-27 Ryan Cumings-Menon

We study convex optimization problems under differential privacy (DP). With heavy-tailed gradients, existing works achieve suboptimal rates. The main obstacle is that existing gradient estimators have suboptimal tail properties, resulting…

Machine Learning · Computer Science 2024-08-20 Puning Zhao , Jiafei Wu , Zhe Liu , Chong Wang , Rongfei Fan , Qingming Li

Suppose we have a memory storing $0$s and $1$s and we want to estimate the frequency of $1$s by sampling. We want to do this I/O-efficiently, exploiting that each read gives a block of $B$ bits at unit cost; not just one bit. If the input…

Data Structures and Algorithms · Computer Science 2024-10-21 Shyam Narayanan , Václav Rozhoň , Jakub Tětek , Mikkel Thorup

We initiate the study of locally differentially private (LDP) learning with public features. We define semi-feature LDP, where some features are publicly available while the remaining ones, along with the label, require protection under…

Machine Learning · Statistics 2025-02-12 Yuheng Ma , Ke Jia , Hanfang Yang

We study the problem of in-context learning (ICL) with large language models (LLMs) on private datasets. This scenario poses privacy risks, as LLMs may leak or regurgitate the private examples demonstrated in the prompt. We propose a novel…

We present a new locally differentially private algorithm for the heavy hitters problem which achieves optimal worst-case error as a function of all standardly considered parameters. Prior work obtained error rates which depend optimally on…

Data Structures and Algorithms · Computer Science 2017-11-15 Mark Bun , Jelani Nelson , Uri Stemmer

Privacy-preserving data analysis is a rising challenge in contemporary statistics, as the privacy guarantees of statistical methods are often achieved at the expense of accuracy. In this paper, we investigate the tradeoff between…

Machine Learning · Statistics 2020-11-11 T. Tony Cai , Yichen Wang , Linjun Zhang

Local differential privacy (LDP) can provide each user with strong privacy guarantees under untrusted data curators while ensuring accurate statistics derived from privatized data. Due to its powerfulness, LDP has been widely adopted to…

Cryptography and Security · Computer Science 2019-06-06 Teng Wang , Jun Zhao , Xinyu Yang , Xuebin Ren

We study the problem of estimating finite sample confidence intervals of the mean of a normal population under the constraint of differential privacy. We consider both the known and unknown variance cases and construct differentially…

Cryptography and Security · Computer Science 2017-11-13 Vishesh Karwa , Salil Vadhan

We introduce a general model for the local obfuscation of probability distributions by probabilistic perturbation, e.g., by adding differentially private noise, and investigate its theoretical properties. Specifically, we relax a notion of…

Cryptography and Security · Computer Science 2023-07-19 Yusuke Kawamoto , Takao Murakami

Estimating frequencies of certain items among a population is a basic step in data analytics, which enables more advanced data analytics (e.g., heavy hitter identification, frequent pattern mining), client software optimization, and…

Cryptography and Security · Computer Science 2018-12-12 Jinyuan Jia , Neil Zhenqiang Gong