English
Related papers

Related papers: PLAN: Variance-Aware Private Mean Estimation

200 papers

The concept of differential privacy (DP) can quantitatively measure privacy loss by observing the changes in the distribution caused by the inclusion of individuals in the target dataset. The DP, which is generally used as a constraint, has…

Cryptography and Security · Computer Science 2025-07-16 Sehyun Ryu , Jonggyu Jang , Hyun Jong Yang

Many resource allocation problems can be formulated as an optimization problem whose constraints contain sensitive information about participating users. This paper concerns solving this kind of optimization problem in a distributed manner…

Optimization and Control · Mathematics 2016-11-17 Shuo Han , Ufuk Topcu , George J. Pappas

We study the problem of differentially private clustering under input-stability assumptions. Despite the ever-growing volume of works on differential privacy in general and differentially private clustering in particular, only three works…

Machine Learning · Computer Science 2021-12-20 Moshe Shechner

We study the classical problem of community recovery in stochastic block models with a fixed number of communities, with a twist: We seek algorithms that are stable with respect to node-wise changes in the graph structure, formally defined…

Statistics Theory · Mathematics 2026-05-18 Laurentiu Marchis , Ethan D'souza , Tomáš Flídr , Po-Ling Loh

This article introduces differentially private log-location-scale (DP-LLS) regression models, which incorporate differential privacy into LLS regression through the functional mechanism. The proposed models are established by injecting…

Machine Learning · Statistics 2024-04-16 Jiewen Sheng , Xiaolei Fang

In the post-industrial world, data science and analytics have gained paramount importance regarding digital data privacy. Improper methods of establishing privacy for accessible datasets can compromise large amounts of user data even if the…

Machine Learning · Computer Science 2020-02-20 Kenneth Choi , Tony Lee

Differentially private stochastic gradient descent privatizes model training by injecting noise into each iteration, where the noise magnitude increases with the number of model parameters. Recent works suggest that we can reduce the noise…

Machine Learning · Statistics 2025-07-25 Xin Gu , Gautam Kamath , Zhiwei Steven Wu

Differential privacy is a mathematical concept that provides an information-theoretic security guarantee. While differential privacy has emerged as a de facto standard for guaranteeing privacy in data sharing, the known mechanisms to…

Cryptography and Security · Computer Science 2024-03-26 March Boedihardjo , Thomas Strohmer , Roman Vershynin

Datasets are often used multiple times and each successive analysis may depend on the outcome of previous analyses. Standard techniques for ensuring generalization and statistical validity do not account for this adaptive dependence. A…

Machine Learning · Computer Science 2018-06-13 Vitaly Feldman , Thomas Steinke

Differentially private noise mechanisms commonly use symmetric noise distributions. This is attractive both for achieving the differential privacy definition, and for unbiased expectations in the noised answers. However, there are contexts…

Cryptography and Security · Computer Science 2021-10-18 Benjamin M. Case , James Honaker , Mahnush Movahedi

We present STAMP (Selective Task-Aware Mechanism for Text Privacy), a new framework for task-aware text privatization that achieves an improved privacy-utility trade-off. STAMP selectively allocates privacy budgets across tokens by jointly…

Machine Learning · Computer Science 2026-03-13 Fengwei Tian , Payel Bhattacharjee , Heidi Hanson , Geoffrey D. Rubin , Joseph Y. Lo , Ravi Tandon

Temporal difference (TD) learning is a widely used method to evaluate policies in reinforcement learning. While many TD learning methods have been developed in recent years, little attention has been paid to preserving privacy and most of…

Machine Learning · Computer Science 2022-01-26 Canzhe Zhao , Yanjie Ze , Jing Dong , Baoxiang Wang , Shuai Li

Increasing interest in privacy-preserving machine learning has led to new and evolved approaches for generating private synthetic data from undisclosed real data. However, mechanisms of privacy preservation can significantly reduce the…

Machine Learning · Statistics 2022-05-23 Sahra Ghalebikesabi , Harrison Wilde , Jack Jewson , Arnaud Doucet , Sebastian Vollmer , Chris Holmes

We study the sample complexity of learning threshold functions under the constraint of differential privacy. It is assumed that each labeled example in the training data is the information of one individual and we would like to come up with…

Data Structures and Algorithms · Computer Science 2019-11-25 Haim Kaplan , Katrina Ligett , Yishay Mansour , Moni Naor , Uri Stemmer

Linear regression is an important tool across many fields that work with sensitive human-sourced data. Significant prior work has focused on producing differentially private point estimates, which provide a privacy guarantee to individuals…

Machine Learning · Computer Science 2019-10-30 Garrett Bernstein , Daniel Sheldon

Differentially Private methods for training Deep Neural Networks (DNNs) have progressed recently, in particular with the use of massive batches and aggregated data augmentations for a large number of training steps. These techniques require…

Machine Learning · Computer Science 2023-05-25 Tom Sander , Pierre Stock , Alexandre Sablayrolles

Privacy-preserving data analysis has become more prevalent in recent years. In this study, we propose a distributed group differentially private Majority Vote mechanism, for the sign selection problem in a distributed setup. To achieve…

Cryptography and Security · Computer Science 2024-06-05 Weidong Liu , Jiyuan Tu , Xiaojun Mao , Xi Chen

We systematically investigate the preservation of differential privacy in functional data analysis, beginning with functional mean estimation and extending to varying coefficient model estimation. Our work introduces a distributed learning…

Statistics Theory · Mathematics 2026-02-11 Gengyu Xue , Zhenhua Lin , Yi Yu

Deep neural networks with their large number of parameters are highly flexible learning systems. The high flexibility in such networks brings with some serious problems such as overfitting, and regularization is used to address this…

Machine Learning · Statistics 2017-12-20 Beyza Ermis , Ali Taylan Cemgil

We study a class of distributed convex constrained optimization problems where a group of agents aim to minimize the sum of individual objective functions while each desires that any information about its objective function is kept private.…

Optimization and Control · Mathematics 2016-09-30 Erfan Nozari , Pavankumar Tallapragada , Jorge Cortés